Which AI crawlers read this site.

25 named AI and search crawlers, logged at the edge of benian.ai since August 20, 2026, matched by user agent. The log stores no IP addresses and nothing that identifies a human visitor; aggregates only.

10,000Crawler page fetches loggedmeasured
16 of 25Watched crawlers seenmeasured
103Distinct pages fetchedmeasured
Per-crawler totals, most active firstSince Aug 20, 2026
CrawlerFetchesPages
meta-externalagentMeta2,45168
AmazonbotAmazon2,09250
ChatGPT-UserOpenAI1,58240
OAI-SearchBotOpenAI1,32323
ClaudeBotAnthropic58019
PerplexityBotPerplexity56930
GPTBotOpenAI5179
Google-ExtendedGoogle4905
GooglebotGoogle24626
BingbotMicrosoft7310
CCBotCommon Crawl231
ApplebotApple223
Claude-UserAnthropic167
BytespiderByteDance102
DuckAssistBotDuckDuckGo42
YouBotYou.com22

Totals cover the first 10,000 logged fetches; the full ledger has grown past what this page tallies.

First seen on this site
  1. Bingbot
  2. meta-externalagent
  3. Amazonbot
  4. ChatGPT-User
  5. GPTBot
  6. OAI-SearchBot
  7. Google-Extended
  8. ClaudeBot
  9. PerplexityBot
  10. Applebot
  11. Googlebot
  12. Bytespider
  13. Claude-User
  14. CCBot
  15. DuckAssistBot
  16. YouBot

The date each named crawler first fetched a page here, oldest first.

Watched, not seen yet (9)
  • Claude-SearchBot · Anthropic
  • Claude-Web · Anthropic
  • anthropic-ai · Anthropic
  • Perplexity-User · Perplexity
  • FacebookBot · Meta
  • Applebot-Extended · Apple
  • cohere-training-data-crawler · Cohere
  • cohere-ai · Cohere
  • MistralAI-User · Mistral

All figures on this page are measured: first-party logs written at the edge by this site’s own middleware, one row per page fetch by a named crawler. A traffic report, nothing more; it shows who reads the site, not what they say about it. The page re-renders at most once an hour.