Robots.txt Rules Builder Default Search Engines (Googlebot, Bingbot): Allow All Crawlers Disallow All Crawlers Block AI Crawlers (GPTBot, PerplexityBot, CCBot): Block AI Bots (Recommended for Data Privacy) Allow AI Bots Sitemap URL: Copy Robots.txt
