Live view digest — 18 November 2026

11,393 of the 13,293 requests in the current window carry a user agent that matches no recognised search engine or AI crawler.

Snapshot 18 November 2026 13:00 UTC · read from this server’s own nginx log · live view · all digests

Recognised vs unrecognised

1,61898710,688recognised crawlers 12.2%known scan paths 7.4%everything else 80.4%
The current 24-hour window split three ways. Scan-path requests are blocked at the edge and never counted as crawler traffic. Source: this server's own nginx access log, aggregated every five minutes. Snapshot 18 November 2026 13:00 UTC. Verify any figure against /live/ or /data/live.json.

What that includes

  • Requests whose user agent string matches no recognised search engine or AI crawler.
  • On a public site this is mostly ordinary automation: libraries, monitors, scrapers, scanners that did not use a known scan path.
  • It is published separately so it is never mistaken for search or AI traffic.

How to read this

  • Why visitor addresses are masked. Visitor IP addresses are used to count distinct visitors and countries, then truncated before anything is published. No full address appears on this site, and no third-party analytics package sees the rest.

What this is not

  • One site only. This is a dated record of one small site, not a benchmark, an index or a projection.
  • Crawler identity is claimed, not proven. User agents can be spoofed, so unrecognised traffic stays unverified rather than being assigned to a named engine.
  • A crawl is not a citation. Being fetched is a precondition for being mentioned, never evidence of it.
  • Every figure is derived from this server's own access log. No third-party analytics are used, so there is no second set of numbers.

Do the same on your own site

Source: this server's own nginx access log, aggregated every five minutes. Snapshot 18 November 2026 13:00 UTC. Verify any figure against /live/ or /data/live.json.