# robots.txt for RIVA Sicherheitstechnik (https://www.riva.co.at) # Public content may be crawled. Internal CMS and API routes are excluded from # discovery; robots.txt is not an access-control mechanism. User-agent: * Allow: / Disallow: /api/ Disallow: /intern/ # Search indexing and AI answer retrieval. # OAI-SearchBot powers discovery for ChatGPT search; ChatGPT-User performs # user-requested fetches. GPTBot is listed separately below because it is a # model-training crawler, not the crawler required for ChatGPT search. User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Googlebot User-agent: Bingbot User-agent: Applebot Allow: / Disallow: /api/ Disallow: /intern/ # AI model development and grounding permissions. These controls are separate # from ordinary search inclusion. Google-Extended is a product token rather # than a distinct HTTP crawler and does not affect Google Search ranking. User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended Allow: / Disallow: /api/ Disallow: /intern/ # Canonical discovery feed. Sitemap: https://www.riva.co.at/sitemap.xml # Machine-readable resources for AI answer engines and search agents. # Human-readable hub: https://www.riva.co.at/fuer-ki-agenten # - llms.txt : https://www.riva.co.at/llms.txt # - agent-services : https://www.riva.co.at/agent-services.md # - pricing : https://www.riva.co.at/pricing.md # - RSS feed : https://www.riva.co.at/rss.xml