Live view digest — 28 September 2026

4,228 requests in the current window went to paths only a scanner would ask for, and were blocked at the edge. They are published separately so they never inflate the crawler figures.

Snapshot 28 September 2026 20:35 UTC · read from this server’s own nginx log · live view · all digests

Blocked at the edge

11,7614,22818,570recognised crawlers 34.0%known scan paths 12.2%everything else 53.7%
The current 24-hour window split three ways. Scan-path requests are blocked at the edge and never counted as crawler traffic. Source: this server's own nginx access log, aggregated every five minutes. Snapshot 28 September 2026 20:35 UTC. Verify any figure against /live/ or /data/live.json.

Why this is reported

  • Why the window is 24 hours and 7 days. The 24-hour figure answers 'what is happening now'; the seven-day figure shows whether that is normal for this site. A single day can be distorted by one large crawl, so the trend matters more than the snapshot.

What this is not

  • One site only. This is a dated record of one small site, not a benchmark, an index or a projection.
  • Crawler identity is claimed, not proven. User agents can be spoofed, so unrecognised traffic stays unverified rather than being assigned to a named engine.
  • A crawl is not a citation. Being fetched is a precondition for being mentioned, never evidence of it.
  • Every figure is derived from this server's own access log. No third-party analytics are used, so there is no second set of numbers.

Do the same on your own site

Source: this server's own nginx access log, aggregated every five minutes. Snapshot 28 September 2026 20:35 UTC. Verify any figure against /live/ or /data/live.json.