AI crawlers
Google-Extended
Updated 2026-05-17
Google-Extended is Google's user-agent for AI training and AI Overviews — separate from Googlebot, which still controls classic search indexing. Blocking Google-Extended opts you out of Gemini training and AI Overviews surfacing without affecting your standard Google ranking.
Block AI training only
User-agent: Google-Extended Disallow: / User-agent: Googlebot Allow: /
This posture keeps you indexed in classic Google search while opting out of Gemini training + AI Overviews.
Where this comes up
See how your site scores on Google-Extended + every other AI-discoverability signal.
Free audit