# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # allow everything User-agent: * Allow: / # CloudFlare stuff Disallow: /cdn-cgi/