Live view digest — 14 November 2026
Applebot is the most active named crawler in the current 24-hour window at 272 requests, 33% below its average over the previous 53 recorded days.
Engines today
| Crawler | Requests | Share of named crawler traffic |
|---|---|---|
| Applebot | 272 | 49.5% |
| Yandex | 145 | 26.4% |
| Bing | 59 | 10.7% |
| Amazonbot | 30 | 5.5% |
| 28 | 5.1% | |
| GPTBot | 6 | 1.1% |
| OAI-SearchBot | 5 | 0.9% |
| Bytespider | 2 | 0.4% |
| DuckDuckBot | 2 | 0.4% |
| meta-externalagent | 1 | 0.2% |
Change since the last full day
How to read this
- What 'unmatched' means. Unmatched requests are those whose user agent does not match a recognised search engine or AI crawler. On a public site almost all of them are ordinary automation: scanners, libraries, monitoring, scrapers. They are published as a separate number precisely so they are not mistaken for search traffic.
What this is not
- One site only. This is a dated record of one small site, not a benchmark, an index or a projection.
- Crawler identity is claimed, not proven. User agents can be spoofed, so unrecognised traffic stays unverified rather than being assigned to a named engine.
- A crawl is not a citation. Being fetched is a precondition for being mentioned, never evidence of it.
- Every figure is derived from this server's own access log. No third-party analytics are used, so there is no second set of numbers.
Do the same on your own site
- AI Crawler Radar — see which search and AI crawlers reach a page of your own site
- AI Crawler Log Analyzer — run the same engine split on your own server log
Source: this server's own nginx access log, aggregated every five minutes. Snapshot 14 November 2026 13:00 UTC. Verify any figure against /live/ or /data/live.json.
