# 1. DEFAULT CRAWLERS (Googlebot, Bing, etc.) User-agent: * Disallow: /.github/ Disallow: /.phan/ Disallow: /backup/ Disallow: /bin/ Disallow: /cache/ Disallow: /logs/ Disallow: /system/ Disallow: /tests/ Disallow: /tmp/ Disallow: /vendor/ Disallow: /webserver-configs/ # Handle User Folder safely Disallow: /user/ Allow: /user/pages/ Allow: /user/themes/ Allow: /user/images/ # Open Assets completely so AI can render the site visually Allow: /assets/ Allow: /system/*.js$ # 2. SPECIFICALLY WELCOMING AI CRAWLERS User-agent: ClaudeBot User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: PerplexityBot User-agent: Google-Extended User-agent: FacebookBot Allow: / # 3. DIRECTING TO THE DATA SOURCE Sitemap: https://iberiaeclipse.com/sitemap.xml