# --- Traditional Search Engines (Full Access) --- User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / # --- AI & Answer Engine Bots (Full Access with Crawl Delay) --- # OpenAI's GPTBot User-agent: GPTBot Allow: / # ChatGPT-User (Associated with OpenAI/Microsoft services) User-agent: ChatGPT-User Allow: / # Anthropic's ClaudeBot User-agent: ClaudeBot Allow: / # Perplexity AI's bot User-agent: PerplexityBot Allow: / # Google DeepMind's GeminiBot User-agent: GeminiBot Allow: / # --- General Crawlers (Full Access) --- User-agent: * Allow: / # --- Sitemap Location --- Sitemap: https://hyperblog.io/sitemap.xml