# SkyStatus - robots.txt # https://skystatus.pro User-agent: * Allow: /guide/ Allow: /guide/nl/ Allow: /guide/fr/ Allow: /guide/de/ Allow: /guide/se/ Allow: /ask/ Allow: /vraag/ Allow: /question/ Allow: /tools/ Allow: /faq Allow: /calculator Allow: /flying-blue-offers Allow: /flying-blue-offers.json Allow: /about Allow: /privacy Allow: /terms Allow: /cookies # App routes - not for indexing Disallow: /app/ Disallow: /admin Disallow: /login Disallow: /import-wizard Disallow: /api/ # Affiliate referral rotation redirects (api/go.ts) - never index Disallow: /go/ # Legacy routes (can be removed after parser refactor) Disallow: /ai-parser Disallow: /local-parser # Dormant content-type routes: no active content (see CLAUDE.md "Dormant content types") Disallow: /course/ Disallow: /checklist/ Sitemap: https://skystatus.pro/sitemap.xml # LLM-readable product information (like robots.txt for AI) # https://skystatus.pro/llm.txt # ============================================================================= # AI Bots - Explicitly allowed for AI discoverability # ============================================================================= # OpenAI User-agent: GPTBot Disallow: /boarding Allow: / # Anthropic User-agent: ClaudeBot Disallow: /boarding Allow: / Crawl-delay: 1 User-agent: Claude-SearchBot Disallow: /boarding Allow: / Crawl-delay: 1 User-agent: Claude-User Disallow: /boarding Allow: / # Google AI User-agent: Google-Extended Disallow: /boarding Allow: / # Perplexity User-agent: PerplexityBot Disallow: /boarding Allow: / # Common Crawl User-agent: CCBot Disallow: /boarding Allow: / # Apple User-agent: Applebot-Extended Disallow: /boarding Allow: /