See what AI bots really read on your site
Attrape-Robots shows what AI bots (OpenAI, Anthropic, Google, Perplexity…) receive when they visit a page, and helps you decide who to let in.
Crawl diagnostic
Compare the HTML served to OAI-SearchBot, GPTBot, ChatGPT-User, Chrome and Googlebot.
AI crawler list
24 bots, their purpose, official IP ranges and the robots.txt rule to block them.
FAQ
Training, indexing, on-demand fetch: what blocking really changes.
Three uses, three decisions
Blocking training protects your content at no visibility cost. Blocking indexing removes you from sourced answers. Blocking on-demand fetch breaks reading of your pages. Details in the crawler list.
This test emulates HTTP access with different User-Agents. It does not perfectly reproduce a real visit: source IP, CDN, WAF and anti-bot rules can change real behaviour. A user-agent name proves nothing; only the origin IP does.