AI crawler report — 2026, week 43 (2026-10-19 to 2026-10-25)
7 day(s) of data in this period, read directly from this site's own access log. Complete period.
Summary
- 121,895 total requests, of which 33,930 were recognised crawler requests (27.8%).
- 6 distinct crawlers identified. Largest: ClaudeBot (6,416 requests).
Crawlers by engine
| Crawler | Requests | Share of crawler traffic |
|---|---|---|
| ClaudeBot | 6,416 | 18.9% |
| meta-externalagent | 4,300 | 12.7% |
| 4,194 | 12.4% | |
| Bing | 2,380 | 7.0% |
| Applebot | 1,537 | 4.5% |
| Amazonbot | 678 | 2.0% |
Most-crawled pages
| Path | Requests |
|---|---|
| / | 2,294 |
| /disclaimer/ | 496 |
| /article/ | 466 |
| /manifest.json | 455 |
| /tools/ | 454 |
| /case/ | 450 |
| /robots.txt | 285 |
| /guide/thin-content-identification-and-repair.html | 222 |
| /sitemap.xml | 78 |
| /.well-known/security.txt | 56 |
| /guide/complete-duplicate-content-solution.html | 55 |
| /guide/complete-website-internal-link-strategy.html | 52 |
Method, and what this is not
- Source: our own nginx access log, aggregated per day, then summed for this period. No third-party analytics, no cookies, no client script.
- Crawlers are identified by user agent string. This can over-count: some automated traffic claims a crawler identity. We treat these numbers as indicative, not audited.
- One site only. This is not a benchmark, index, or projection. It is a dated, first-hand record — useful precisely because it is small, local and verifiable.
- Data file for this period: /reports/data/2026-w43.json
See also: live crawler view · all reports