Live view digest — 5 November 2026
Google is the most active named crawler in the current 24-hour window at 428 requests, 39% below its average over the previous 44 recorded days.
Engines today
| Crawler | Requests | Share of named crawler traffic |
|---|---|---|
| 428 | 29.1% | |
| ClaudeBot | 269 | 18.3% |
| meta-externalagent | 163 | 11.1% |
| Bing | 111 | 7.6% |
| Amazonbot | 98 | 6.7% |
| OAI-SearchBot | 86 | 5.9% |
| GPTBot | 86 | 5.9% |
| Applebot | 83 | 5.6% |
| PerplexityBot | 76 | 5.2% |
| CCBot | 70 | 4.8% |
Change since the last full day
How to read this
- What 'unmatched' means. Unmatched requests are those whose user agent does not match a recognised search engine or AI crawler. On a public site almost all of them are ordinary automation: scanners, libraries, monitoring, scrapers. They are published as a separate number precisely so they are not mistaken for search traffic.
What this is not
- One site only. This is a dated record of one small site, not a benchmark, an index or a projection.
- Crawler identity is claimed, not proven. User agents can be spoofed, so unrecognised traffic stays unverified rather than being assigned to a named engine.
- A crawl is not a citation. Being fetched is a precondition for being mentioned, never evidence of it.
- Every figure is derived from this server's own access log. No third-party analytics are used, so there is no second set of numbers.
Do the same on your own site
- AI Crawler Radar — see which search and AI crawlers reach a page of your own site
- AI Crawler Log Analyzer — run the same engine split on your own server log
Source: this server's own nginx access log, aggregated every five minutes. Snapshot 05 November 2026 13:00 UTC. Verify any figure against /live/ or /data/live.json.
