Live view digest — 16 October 2026

1,110 requests in the current window went to paths only a scanner would ask for, and were blocked at the edge. They are published separately so they never inflate the crawler figures.

Snapshot 16 October 2026 12:00 UTC · read from this server’s own nginx log · live view · all digests

Blocked at the edge

3,1411,1107,918recognised crawlers 25.8%known scan paths 9.1%everything else 65.1%
The current 24-hour window split three ways. Scan-path requests are blocked at the edge and never counted as crawler traffic. Source: this server's own nginx access log, aggregated every five minutes. Snapshot 16 October 2026 12:00 UTC. Verify any figure against /live/ or /data/live.json.

Why this is reported

  • What counts as a scan path. Requests to paths that only an automated scanner would ask for (credential files, admin panels, common CMS probes). They are blocked at the edge and counted separately, never inside the crawler figures. They are listed here only to show the noise a public site attracts.

What this is not

  • One site only. This is a dated record of one small site, not a benchmark, an index or a projection.
  • Crawler identity is claimed, not proven. User agents can be spoofed, so unrecognised traffic stays unverified rather than being assigned to a named engine.
  • A crawl is not a citation. Being fetched is a precondition for being mentioned, never evidence of it.
  • Every figure is derived from this server's own access log. No third-party analytics are used, so there is no second set of numbers.

Do the same on your own site

Source: this server's own nginx access log, aggregated every five minutes. Snapshot 16 October 2026 12:00 UTC. Verify any figure against /live/ or /data/live.json.