Live view digest — 1 October 2026
/data/live.json took 340 crawler requests in the current window. That is 72% below its recent daily average.
Most-crawled pages
| Path | Requests |
|---|---|
| /data/live.json | 340 |
| / | 265 |
| /article/ | 82 |
| /case/ | 81 |
| /tools/ | 80 |
| /manifest.json | 79 |
| /disclaimer/ | 79 |
| /live/ | 9 |
| /article/layer-3-behaviour-analysis-without-hurting-crawlers.html | 6 |
| /robots.txt | 5 |
Change since the last full day
How to read this
- Why a crawl is not a citation. Being crawled means a page was fetched. It does not mean it was indexed, retrieved for an answer, or cited. Crawling is a precondition for visibility, never proof of it.
What this is not
- One site only. This is a dated record of one small site, not a benchmark, an index or a projection.
- Crawler identity is claimed, not proven. User agents can be spoofed, so unrecognised traffic stays unverified rather than being assigned to a named engine.
- A crawl is not a citation. Being fetched is a precondition for being mentioned, never evidence of it.
- Every figure is derived from this server's own access log. No third-party analytics are used, so there is no second set of numbers.
Do the same on your own site
- AI Crawler Log Analyzer — find which of your own pages are fetched most
- AI Crawler Radar — see what those crawlers can actually read there
Source: this server's own nginx access log, aggregated every five minutes. Snapshot 01 October 2026 12:00 UTC. Verify any figure against /live/ or /data/live.json.