AI Crawler Radar

See how AI engines read your site. Enter a domain and we fetch its robots.txt and homepage, then report which AI crawlers are allowed, whether your structured data is machine-readable, and what is blocking AI citation.

No sign-up. Nothing is stored.

AI crawler access is decided by two public files. The AI Crawler Radar reads a site's robots.txt and homepage and reports, in plain language, which named AI and search crawlers are allowed, whether the structured data parses, and what is blocking AI citation. It checks public files only: no account, no analytics access, nothing uploaded.

Questions

What does the AI Crawler Radar check?

It fetches a domain's robots.txt and homepage, then reports which named AI and search crawlers are allowed, whether the structured data on the page parses, and what would block an AI engine from citing the site.

Does it need access to my analytics?

No. The radar reads only two public files: robots.txt and the homepage HTML. Nothing is uploaded, no account is needed, and we do not store the domains you check.

Why do robots.txt and llms.txt both matter?

robots.txt states the rules crawlers must follow; llms.txt states the same policy in human-readable form. If the two disagree on AI training, AI engines receive mixed signals, so the radar reports both.

Can a good score guarantee AI citations?

No. Access is a precondition, not a guarantee. Being crawlable means an engine can read you; whether it cites you depends on content quality, structure and demand.

Need this read for your own site? Ask us a question.

Related reading: How We Audit a Site: The Checklist We Use · Why We Moved Scanner Blocking to the Edge, and What It Changed · Freshness Signals: What AI Crawlers Actually Notice

Related tools: AI Access Badge · Edge vs Origin Check

More on this site: live crawler signals · how we work

Related reading: How to read your own server log for ai crawlers · What a content signal line does

Need this read for your own site? Ask us a question.