User-agent: Googlebot Disallow: *_ga= Disallow: *_openstat= Disallow: *cmp= Disallow: *dclid= Disallow: *from= Disallow: *gclid= Disallow: *k50id= Disallow: *kw= Disallow: *ppc= Disallow: *tc= Disallow: *tid= Disallow: *utm_*= Disallow: *utmz*= Disallow: *yclid= Disallow: *ymclid= Disallow: *.pdf Disallow: *.PDF Disallow: *.doc Disallow: *.DOC Disallow: *.xls Disallow: *.XLS Disallow: *.ppt Disallow: *.PPT Disallow: /? Disallow: /index.php Disallow: /index.html User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: Google-Extended Allow: / User-agent: Bingbot Allow: / # AI model-training crawlers. # Search/retrieval bots above remain allowed. User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CCBot Disallow: / User-agent: * Allow: / Sitemap: https://thalorium.com/sitemap.xml # IndexNow key file (keyLocation): https://thalorium.com/7d3ff1c9-29bf-4637-a62c-2e48ccdf4348.txt