Watch AI crawlers work your site.
GPTBot, ClaudeBot, PerplexityBot and eleven more — what they read, what they're blocked from, and what that costs you in answers. One edge snippet, live in minutes.
CrawlersReferralsPagesLogs
Agents · 30d48.2K REQUESTS · 14 AGENTS
GPTBotOpenAI21,408ALLOWED
PerplexityBotPerplexity11,872ALLOWED
ClaudeBotAnthropic8,455PARTIAL
Google-ExtendedGoogle6,203ALLOWED
Alert: ClaudeBot 403s on 214 /help URLs — robots.txt rule from 2024. Action #87 →