# robots.txt for RevExOS # Search engines and AI crawlers are welcome on every public page. # All agents share one group: a crawler obeys only the most specific group that # names it, so a separate "User-agent: GPTBot / Allow: /" group would drop the # Disallow rules for that bot. /_next/ (CSS/JS for rendering) and /opengraph-image # (link previews, e.g. LinkedIn) must stay crawlable. User-agent: * User-agent: Googlebot User-agent: bingbot User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: anthropic-ai User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /auth/ Disallow: /internal/ Disallow: /account Disallow: /login Sitemap: https://revexos.com/sitemap.xml