User-Agent: * Allow: / Disallow: /admin Disallow: /api Disallow: /go Disallow: /search User-Agent: OAI-SearchBot User-Agent: Claude-SearchBot User-Agent: PerplexityBot User-Agent: ChatGPT-User User-Agent: Claude-User User-Agent: Perplexity-User Allow: / Disallow: /admin Disallow: /api Disallow: /go Disallow: /search User-Agent: GPTBot User-Agent: ClaudeBot User-Agent: Google-Extended User-Agent: CCBot User-Agent: Applebot-Extended User-Agent: Bytespider User-Agent: meta-externalagent Disallow: / Host: https://www.smallstepsjapan.com Sitemap: https://www.smallstepsjapan.com/sitemap.xml