# Public pages are available to search engines and AI search/answer crawlers. # The wildcard group also applies to OAI-SearchBot, ChatGPT-User, # PerplexityBot, Perplexity-User, Claude-SearchBot, and Claude-User. # Avoid crawling APIs, reviewer tools, and authenticated customer case studies. # These rules are crawl guidance, not a substitute for authentication. User-agent: * Disallow: /api/ Disallow: /enterprise/review Disallow: /casestudy/ Sitemap: https://faradaycompute.com/sitemap.xml