User-agent: * Disallow: / # Search Engines User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: YandexBot Allow: / User-agent: YandexImages Allow: / User-agent: Baiduspider Allow: / User-agent: Sogou Allow: / User-agent: Exabot Allow: / User-agent: NaverBot Allow: / # Chinese Search Engines User-agent: 360Spider Allow: / User-agent: HaoSouSpider Allow: / User-agent: ShenmaSpider Allow: / User-agent: ToutiaoSpider Allow: / User-agent: ByteSpider Allow: / User-agent: Bytespider Allow: / User-agent: DouyinBot Allow: / User-agent: TikTokBot Allow: / User-agent: BaiduSpider Allow: / User-agent: SogouSpider Allow: / User-agent: SogouMobileSpider Allow: / User-agent: SogouImageSpider Allow: / User-agent: SogouVideoSpider Allow: / User-agent: SogouNewsSpider Allow: / # Social Media User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / User-agent: TelegramBot Allow: / User-agent: SkypeUriPreview Allow: / User-agent: Slackbot Allow: / User-agent: DiscordBot Allow: / User-agent: PinterestBot Allow: / User-agent: redditbot Allow: / # AI/LLM Crawlers User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: YouBot Allow: / User-agent: Anthropic-ai Allow: / User-agent: cohere-ai Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: meta-externalagent Crawl-delay: 3600 Allow: / User-agent: ImagesiftBot Allow: / User-agent: Omigilibot Allow: / # News/RSS Aggregators User-agent: Feedly Allow: / User-agent: NewsBlur Allow: / User-agent: FlipboardProxy Allow: / User-agent: Apple-PubSub Allow: / User-agent: NewsNow Allow: / # Archive Services User-agent: ia_archiver Allow: / User-agent: archive.org_bot Allow: / User-agent: wayback_machine Allow: / User-agent: WebCite Allow: / # Additional Google Crawlers User-agent: Googlebot-Image Allow: / User-agent: Googlebot-Video Allow: / User-agent: Googlebot-News Allow: / User-agent: Google-InspectionTool Allow: / User-agent: GoogleOther Allow: / User-agent: GoogleOther-Image Allow: / User-agent: GoogleOther-Video Allow: / # Content/Media User-agent: Applebot Allow: / User-agent: Snapchat Allow: / User-agent: Qwantify Allow: / User-agent: DuckDuckGo-Favicons-Bot Allow: / # Academic/Research User-agent: Citoid Allow: / User-agent: ResearchBot Allow: / User-agent: AcademicBotRTU Allow: / User-agent: ScholarBot Allow: / # Protected directories Disallow: /cast Disallow: /analysis Disallow: /welcome/ Disallow: /settings/ Disallow: /conversation/ Disallow: /conversations/ Disallow: /update-password Disallow: /forgot-password Sitemap: https://qching.ai/sitemap.xml