About CrawlReadable

CrawlReadable shows you what AI crawlers actually receive when they fetch your website, and fixes what's in the way.

Why it exists

More people now ask ChatGPT, Claude and Perplexity before they search. Those assistants learn about your business from crawlers, and most of those crawlers don't run JavaScript. A site that looks complete in a browser can arrive at a crawler as an empty page, or be blocked by a robots.txt rule nobody remembers writing. We built CrawlReadable to make that visible in ten seconds, for free.

How it works

We fetch your homepage the way most AI crawlers do: one plain HTTP request, no browser, no JavaScript. Then we run 20 checks worth 100 points: robots.txt rules for each AI crawler, how much readable text your HTML carries, structured data, llms.txt and your sitemap. Every check and its weight is on the methodology page.

Who runs it

CrawlReadable is an independent product run by Franco Smit from Cape Town, South Africa. It isn't affiliated with OpenAI, Anthropic, Perplexity or Google.

Contact

Questions, fix pack orders, removal requests or partnership enquiries: hello@crawlreadable.com. We reply within one business day.