Attrape-Robots

Google-Extended

Google-Extended is a Google crawler. Category: Training. Blocking protects your content at no visibility cost.

Google-Extended is not a crawler but a directive: crawling is still done by Googlebot. Refusing it does not remove you from search results.

Block Google-Extended

Add these lines to your robots.txt:

User-agent: Google-Extended
Disallow: /

Block or allow AI crawlers in robots.txt

Verify the IP address

No IP range is published in the sources we follow: an agent name alone proves nothing. Check the publisher’s documentation.

Verify an AI crawler’s IP address · AI crawlers behind a CDN: recover the real IP

Official documentation

Other Google crawlers

AI crawlers