# robots.txt for https://www.enigma.com # Policy: allow all search, AI answer, user-triggered and AI training crawlers. # Note: a crawler that matches a named group below ignores the "*" group, # so every named group repeats Allow and Content-Signal on purpose. # ---------- Default: everyone ---------- User-agent: * Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Google (Search, AI Overviews, AI Mode, Gemini) ---------- User-agent: Googlebot User-agent: Google-Extended Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Microsoft (Bing, Copilot) ---------- User-agent: bingbot Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- OpenAI (ChatGPT) ---------- User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Anthropic (Claude) ---------- User-agent: Claude-SearchBot User-agent: Claude-User User-agent: ClaudeBot Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Perplexity ---------- User-agent: PerplexityBot User-agent: Perplexity-User Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Apple (Siri, Spotlight, Apple Intelligence) ---------- User-agent: Applebot User-agent: Applebot-Extended Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Amazon (Alexa, Amazon search, Amazon AI) ---------- User-agent: Amazonbot User-agent: Amzn-SearchBot User-agent: Amzn-User Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Meta (Meta AI) ---------- User-agent: Meta-ExternalAgent User-agent: Meta-WebIndexer User-agent: Meta-ExternalFetcher Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Mistral ---------- User-agent: MistralAI-Index User-agent: MistralAI-User User-agent: MistralAI-Training Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- DuckDuckGo (search and AI-assisted answers) ---------- User-agent: DuckDuckBot User-agent: DuckAssistBot Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Common Crawl (open repository of web crawl data) ---------- User-agent: CCBot Allow: / Content-Signal: ai-train=yes, search=yes, ai-input=yes # ---------- Sitemaps ---------- Sitemap: https://www.enigma.com/sitemap-index.xml Sitemap: https://www.enigma.com/directory/sitemap_index.xml