Live view digest — 29 September 2026

The most-crawled path in the current window is /article/ with 187 requests, against a recent daily average of 56 for the same path on this site.

Snapshot 29 September 2026 12:00 UTC · read from this server’s own nginx log · live view · all digests

The page moving most

ClaudeBot3,166PerplexityBot2,127Google1,178OAI-SearchBot1,129Applebot1,082Bytespider1,077GPTBot1,066Amazonbot1,062
Requests by engine, current 24-hour window. AI answer engines and AI training crawlers are highlighted; search engines are grey. Source: this server's own nginx access log, aggregated every five minutes. Snapshot 29 September 2026 12:00 UTC. Verify any figure against /live/ or /data/live.json.
CrawlerRequestsShare of named crawler traffic
ClaudeBot3,16622.7%
PerplexityBot2,12715.2%
Google1,1788.4%
OAI-SearchBot1,1298.1%
Applebot1,0827.7%
Bytespider1,0777.7%
GPTBot1,0667.6%
Amazonbot1,0627.6%
CCBot1,0527.5%
ChatGPT-User1,0277.4%

Today in numbers

  • 41,008 requests in the current 24-hour window.
  • 15,010 of them from recognised search engines and AI crawlers (36.6%).
  • 25,998 unrecognised automation requests (63.4%).
  • 4,888 requests to known scan paths, blocked at the edge.
  • 338 distinct visiting addresses, 51 of them in Europe or the United States.

How to read this

  • How fresh these numbers are. The log is processed every five minutes, so the figures on the live page are never more than a few minutes old. If the page and the raw file ever disagree, the raw file is right.

What this is not

  • One site only. This is a dated record of one small site, not a benchmark, an index or a projection.
  • Crawler identity is claimed, not proven. User agents can be spoofed, so unrecognised traffic stays unverified rather than being assigned to a named engine.
  • A crawl is not a citation. Being fetched is a precondition for being mentioned, never evidence of it.
  • Every figure is derived from this server's own access log. No third-party analytics are used, so there is no second set of numbers.

Do the same on your own site

Source: this server's own nginx access log, aggregated every five minutes. Snapshot 29 September 2026 12:00 UTC. Verify any figure against /live/ or /data/live.json.