See your site the way ChatGPT, Claude and Perplexity see it.
Most AI crawlers don't run JavaScript. They read the raw HTML your server sends, and plenty of sites send almost nothing. Get a free score out of 100 and the fixes that matter.
Free, no signup. We fetch your homepage, robots.txt, llms.txt and sitemap.xml. Takes about 10 seconds.
What GPTBot receives
<title>Acme Analytics</title> <body> <div id="root"></div> <script src="/app.3f9a.js"></script> </body>
14 characters of readable text
How the score works
- We fetch your homepage like an AI crawler. One plain HTTP request, no browser, no JavaScript.
- We read what came back. robots.txt rules for each AI bot, the text in your HTML, your structured data, llms.txt and your sitemap.
- You get a score out of 100. Plus a page you can share, and fixes ranked by how many points each one is worth.
What counts, and how much
Readable content is 40 of the 100 points, because it's where most sites fail. llms.txt is only 4, because almost no AI system requests it yet.
- Access, 26 points
- Whether AI crawlers are allowed in: robots.txt rules for GPTBot, ClaudeBot and PerplexityBot, plus llms.txt.
- Content, 40 points
- Whether there's real text in the HTML before any JavaScript runs. The biggest category, because it's the most common failure.
- Structure, 20 points
- Whether the page describes itself: title, description, Open Graph, canonical link and JSON-LD.
- Discovery, 10 points
- Whether crawlers can find your other pages: a sitemap with recent dates.
- Interface, 4 points
- Whether AI agents can do more than read: an OpenAPI description or a full-text llms file.
Every check and its weight is on the methodology page.
Questions
What does the CrawlReadable score measure?
It measures what an AI crawler that runs no JavaScript gets from your site: whether robots.txt lets GPTBot, ClaudeBot and PerplexityBot in, whether the HTML contains your actual text, whether the page describes itself with a title, description and structured data, and whether a sitemap lists your pages. 100 means nothing is in the way.
Do AI crawlers run JavaScript?
Mostly no. Analyses of crawler traffic, including one by Vercel and MERJ in December 2024, found that OpenAI's and Anthropic's crawlers download JavaScript files but don't execute them. Googlebot renders JavaScript, which is why a site can rank in Google and still be invisible to ChatGPT.
Is llms.txt worth adding?
It's cheap, so yes, but don't expect much from it alone. Server log studies in 2026 found that 97% of llms.txt files receive no requests from AI systems. Readable HTML and open robots.txt rules matter far more, which is why llms.txt is worth 4 of our 100 points.
Why did my site get no score?
Your server answered our fetcher with an error or a bot challenge page. That tells us nothing about how real AI crawlers are treated, so we don't guess. Firewall rules that only block certain bots by IP address are also invisible from outside.
What happens to my results?
Each scored audit gets a public page at crawlreadable.com/r/your-domain and a spot on the leaderboard. We store the score and what we fetched, nothing else. We don't set cookies.