Live view digest — 15 November 2026

Of the 12,197 requests in the current 24-hour window, 4,334 came from recognised crawlers and AI agents (35.5% of all traffic). That share is 37% above the average of the previous 54 days.

Snapshot 15 November 2026 13:00 UTC · read from this server’s own nginx log · live view · all digests

The split

3,6941,5666,937recognised crawlers 30.3%known scan paths 12.8%everything else 56.9%
The current 24-hour window split three ways. Scan-path requests are blocked at the edge and never counted as crawler traffic. Source: this server's own nginx access log, aggregated every five minutes. Snapshot 15 November 2026 13:00 UTC. Verify any figure against /live/ or /data/live.json.

Today in numbers

  • 12,197 requests in the current 24-hour window.
  • 4,334 of them from recognised search engines and AI crawlers (35.5%).
  • 7,863 unrecognised automation requests (64.5%).
  • 1,566 requests to known scan paths, blocked at the edge.
  • 675 distinct visiting addresses, 60 of them in Europe or the United States.
previouslatestRequests 24h2,32012,197Recognised crawlers4714,334
The last completed day (left) against the current 24-hour window (right). Columns are drawn to the same scale. Source: this server's own nginx access log, aggregated every five minutes. Snapshot 15 November 2026 13:00 UTC. Verify any figure against /live/ or /data/live.json.
CrawlerRequestsShare of named crawler traffic
ClaudeBot72619.7%
meta-externalagent52314.2%
Google51513.9%
Applebot3489.4%
Bing3108.4%
Bytespider2637.1%
PerplexityBot2556.9%
Amazonbot2526.8%
GPTBot2516.8%
ChatGPT-User2516.8%

How to read this

  • What counts as a scan path. Requests to paths that only an automated scanner would ask for (credential files, admin panels, common CMS probes). They are blocked at the edge and counted separately, never inside the crawler figures. They are listed here only to show the noise a public site attracts.

What this is not

  • One site only. This is a dated record of one small site, not a benchmark, an index or a projection.
  • Crawler identity is claimed, not proven. User agents can be spoofed, so unrecognised traffic stays unverified rather than being assigned to a named engine.
  • A crawl is not a citation. Being fetched is a precondition for being mentioned, never evidence of it.
  • Every figure is derived from this server's own access log. No third-party analytics are used, so there is no second set of numbers.

Do the same on your own site

Source: this server's own nginx access log, aggregated every five minutes. Snapshot 15 November 2026 13:00 UTC. Verify any figure against /live/ or /data/live.json.