# OpenAI Bots User-agent: GPTBot Disallow: /downloads/ Allow: / User-agent: ChatGPT-User Disallow: /downloads/ Allow: / User-agent: OAI-SearchBot Disallow: /downloads/ Allow: / # Anthropic / Claude Bots User-agent: ClaudeBot Disallow: /downloads/ Allow: / # Google AI Bots User-agent: GoogleOther Disallow: /downloads/ Allow: / User-agent: Google-Extended Disallow: /downloads/ Allow: / # Google Search Bot User-agent: Googlebot Disallow: /downloads/ Allow: / # Google Image Bot User-agent: Googlebot-Image Disallow: /downloads/ Allow: / # Apple Bot User-agent: Applebot Disallow: /downloads/ Allow: / # Microsoft Bing Bot User-agent: Bingbot Disallow: /downloads/ Allow: / # Perplexity AI Bot User-agent: PerplexityBot Disallow: /downloads/ Allow: / # Screaming Frog User-agent: ScreamingFrogCrawler Disallow: /downloads/ Allow: / # Brightbot - blocked entirely User-agent: Brightbot Disallow: / # BX Studio - Bot Control User-agent: PetalBot Disallow: / User-agent: Bytespider Disallow: / User-agent: jscrawler Disallow: / # START YOAST BLOCK # --------------------------- # All other bots User-agent: * Disallow: /downloads/ Allow: / Sitemap: https://www.madisonlogic.com/sitemap_index.xml # --------------------------- # END YOAST BLOCK