Can AI actually read your website?

Is my website blocking ChatGPT, Claude and Perplexity from reading it?

AI engines can only recommend businesses they can read. A surprising share of websites block the AI crawlers without knowing it — some CDNs have blocked them by default since 2025 — and none of the major AI crawlers execute JavaScript, so a page whose content only appears after scripts run is invisible to them even when it is allowed in.

Enter your domain. The check reads your robots.txt, fetches your homepage the way the crawlers do, and tells you plainly which engines can see you and what they find.

How this is calculated:

Your robots.txt is read and each AI crawler's rules are resolved the way the crawlers themselves resolve them — most specific user-agent wins. The verdicts distinguish blocking a training crawler, which is a preference, from blocking a citation crawler, which removes you from AI answers.

Your homepage is fetched twice: once as a normal browser and once as the crawler that produces ChatGPT's citations. A site that answers the first and refuses the second is being filtered at the CDN, whatever its robots.txt says.

The static text of the page is counted after scripts and styles are stripped, because that is all a non-JavaScript crawler reads. Under 200 words usually means the real content lives in JavaScript.

Every verdict is computed in code from what your site returned. Nothing is stored, and no email is asked for.

Questions people ask about this tool:

Which crawler matters most?

OAI-SearchBot. It is the one that produces ChatGPT's citations and referral clicks. Blocking GPTBot is a training-data preference; blocking OAI-SearchBot removes your site from ChatGPT's answers.

My robots.txt allows everyone. Am I fine?

Not necessarily. CDN bot protection can refuse AI crawlers before robots.txt is ever consulted, which is why the check fetches your page as a crawler rather than trusting the file. And an allowed crawler still reads only your static HTML.

Why does JavaScript matter?

As of 2026 no major AI crawler executes it. Only Google renders JavaScript, so a script-built page can rank in Google while not existing at all for ChatGPT, Claude or Perplexity.

The check found problems. What now?

Unblocking a crawler is usually one CDN setting or one robots.txt line, and your developer can do it in an afternoon. Making the readable page say something worth citing is the longer work, and it is what our AI visibility program does.