# Origin robots.txt for www.cybret.ai # # Cloudflare AI Crawl Control prepends a managed block on this zone # (shared with cybret.ai and app.cybret.ai): # User-agent: * / Content-Signal: search=yes,ai-train=no,use=reference / Allow: / # Disallow for training crawlers (GPTBot, ClaudeBot, Google-Extended, CCBot, Bytespider, etc.) # # Do not turn off Cloudflare managed robots for this PR. That setting is # zone-wide and would also change app.cybret.ai. # # Retrieval and citation agents (OAI-SearchBot, ChatGPT-User, PerplexityBot, # Claude-Web, and similar live-answer UAs) are not in the Cloudflare Disallow # list, so they stay allowed under User-agent: *. WAF / AI Crawl Control can # still block those bots even when robots.txt allows them. Sitemap: https://www.cybret.ai/sitemap.xml