AI Crawlers Co-Pilot
a plain-language read of this page & where to look next
How AI crawlers use your site — GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot, ChatGPT-User, Google-Extended, Bytespider, CCBot and more — split by purpose (training / AI search / user-triggered) and verified against operators' published IP ranges.
AI & LLMs
AI crawlers
Last 30 days
Verified means the request IP matched the operator’s published crawler ranges (Google, OpenAI, Bing, Perplexity…) — genuine, not spoofed. Some operators (e.g. Anthropic’s ClaudeBot) publish no IP list, so they can be genuine yet stay unverified.
AI crawler sessions
—
Pages crawled
—
Unique AI bots
—
IP-verified
—
By purpose
Loading…
Daily crawl volume
Loading…
AI crawlers seen
| Crawler | Purpose | Sessions | Pages | Countries | Verification | Last seen |
|---|---|---|---|---|---|---|
| Loading… | ||||||