AI crawlers can read almost nothing on this site.
The first 400 characters of text in the HTML, before any JavaScript runs.
Best of Web → Bowora
20 characters of readable text, under the 400 we count as readable
| Crawler | robots.txt says |
|---|---|
| GPTBot | Blocked |
| OAI-SearchBot | Blocked |
| ClaudeBot | Blocked |
| Claude-SearchBot | Blocked |
| PerplexityBot | Blocked |
| Perplexity-User | Blocked |
| Google-Extended | Blocked |
| CCBot | Blocked |
| Bytespider | Blocked |
| Amazonbot | Blocked |
A crawler that runs no JavaScript found under 400 characters of text. Whatever your page says after scripts run, it doesn't say to them.
The page is a JavaScript shell: scripts plus almost no text. To most AI crawlers it looks blank.
Your robots.txt blocks OpenAI's crawler, so ChatGPT learns about you only from other sites.
Your robots.txt blocks Anthropic's crawler, so Claude learns about you only from other sites.
Your robots.txt blocks Perplexity's crawler, so it can't cite your pages in answers.
Machine-readable facts about your business: name, logo, what you sell. AI systems use it to describe you accurately.
A list of every page you want found. Without one, crawlers only find what's linked.
Readable text is a tiny share of the page's code, or there's very little of it. Crawlers summarise words, not markup.
One clear main heading tells a crawler what the page is about.
Tags like main, nav, article and footer show which part is content and which is chrome.
Organization or WebSite objects tie your site to a known entity, so answers name you correctly.
No lastmod date in the last 90 days, so crawlers can't tell what changed and may not come back.
A valid /openapi.json or /llms-full.txt lets AI agents use your product or read your docs in full, not just your homepage.
A short Markdown summary of your site at /llms.txt. Cheap to add, but few AI systems request it yet, so it's worth 3 points.
og:title, og:description and og:image control how your link looks when shared, including in AI chat apps.
Tells crawlers which URL is the real one when the same page is reachable at several.
Some tools look in the .well-known folder instead. A copy of the same file covers both.
We're building monitoring: a re-score every week and an email when the score moves. Leave your email to get it first.
Add this badge to your site or README. It always shows the latest score.
