Attrape-Robots

Claude-SearchBot

Claude-SearchBot is a Anthropic crawler. Category: Indexing for answers. Blocking removes you from AI answers: the heaviest choice.

Block Claude-SearchBot

Add these lines to your robots.txt:

User-agent: Claude-SearchBot
Disallow: /

Block or allow AI crawlers in robots.txt

Verify the IP address

14 official ranges collected on 15 Nov 2026: publisher’s JSON file. Compare the origin IP with these ranges, never the agent name.

Verify an AI crawler’s IP address · AI crawlers behind a CDN: recover the real IP

Official documentation

Other Anthropic crawlers

AI crawlers