Live view digest — 30 September 2026
Of the 5,088 requests in the current 24-hour window, 957 came from recognised crawlers and AI agents (18.8% of all traffic). That share is 48% below the average of the previous 8 days.
The split
Today in numbers
- 5,088 requests in the current 24-hour window.
- 957 of them from recognised search engines and AI crawlers (18.8%).
- 4,131 unrecognised automation requests (81.2%).
- 502 requests to known scan paths, blocked at the edge.
- 319 distinct visiting addresses, 52 of them in Europe or the United States.
| Crawler | Requests | Share of named crawler traffic |
|---|---|---|
| 210 | 23.5% | |
| ClaudeBot | 147 | 16.4% |
| PerplexityBot | 98 | 10.9% |
| Amazonbot | 85 | 9.5% |
| OAI-SearchBot | 66 | 7.4% |
| Bytespider | 64 | 7.2% |
| ChatGPT-User | 59 | 6.6% |
| GPTBot | 57 | 6.4% |
| Applebot | 56 | 6.3% |
| meta-externalagent | 53 | 5.9% |
How to read this
- Why a crawl is not a citation. Being crawled means a page was fetched. It does not mean it was indexed, retrieved for an answer, or cited. Crawling is a precondition for visibility, never proof of it.
What this is not
- One site only. This is a dated record of one small site, not a benchmark, an index or a projection.
- Crawler identity is claimed, not proven. User agents can be spoofed, so unrecognised traffic stays unverified rather than being assigned to a named engine.
- A crawl is not a citation. Being fetched is a precondition for being mentioned, never evidence of it.
- Every figure is derived from this server's own access log. No third-party analytics are used, so there is no second set of numbers.
Do the same on your own site
- AI Crawler Log Analyzer — measure the crawler share of your own traffic
Source: this server's own nginx access log, aggregated every five minutes. Snapshot 30 September 2026 12:00 UTC. Verify any figure against /live/ or /data/live.json.