# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # Facebook/Meta crawlers - 明示的に許可 User-agent: facebookexternalhit User-agent: facebookcatalog User-agent: meta-externalagent Allow: / # 全般的なクローラー設定 User-agent: * Disallow: /admin Disallow: /admin/* Disallow: /mypage Disallow: /login Disallow: /sign_up Disallow: /api Disallow: /api/* Disallow: /affiliate Disallow: /affiliate/* Disallow: /maintenance Disallow: /group/login Disallow: /group/* Disallow: /*/shops/*/guest/adresses Disallow: /*/shops/*/guest/orders/*$ Disallow: /*/shops/*/cart Disallow: /*/owner/login Disallow: /*/owner/* # AI クローラー明示 Allow(AI 検索での引用促進) User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://furusatos.com/sitemap.xml.gz Sitemap: https://furusatos.com/sitemap-video.xml