AI crawlers miss most of this site.
The first 400 characters of text in the HTML, before any JavaScript runs.
PitPicks - F1 Predictions
25 characters of readable text, under the 400 we count as readable
| Crawler | robots.txt says |
|---|---|
| GPTBot | Allowed |
| OAI-SearchBot | Allowed |
| ClaudeBot | Allowed |
| Claude-SearchBot | Allowed |
| PerplexityBot | Allowed |
| Perplexity-User | Allowed |
| Google-Extended | Allowed |
| CCBot | Allowed |
| Bytespider | Allowed |
| Amazonbot | Allowed |
Each finding shows the points it would add to the score once fixed.
A crawler that runs no JavaScript found under 400 characters of text. Whatever your page says after scripts run, it doesn't say to them.
The page is a JavaScript shell: scripts plus almost no text. To most AI crawlers it looks blank.
Readable text is a tiny share of the page's code, or there's very little of it. Crawlers summarise words, not markup.
One clear main heading tells a crawler what the page is about.
Tags like main, nav, article and footer show which part is content and which is chrome.
No lastmod date in the last 90 days, so crawlers can't tell what changed and may not come back.
A valid /openapi.json or /llms-full.txt lets AI agents use your product or read your docs in full, not just your homepage.
Tells crawlers which URL is the real one when the same page is reachable at several.
Some tools look in the .well-known folder instead. A copy of the same file covers both.
Send us your domain and we'll write the fixes, ready to paste:
Delivered by email within 2 business days. We re-score your site once you've applied it. See a sample fix pack.
one site, one payment, charged as R2,450 (South African rand)
Get the fix packOr do it yourself: $49 (charged as R800). The same files, generated for your site and emailed within 1 business day, without the hand-written note or re-score. Get the DIY pack
Payments by Paystack
Money-back guarantee. Full refund if we miss the 2-day delivery, or if your score doesn't go up after you apply the fixes within 30 days. Refund policy
We're building monitoring: a re-score every week and an email when the score moves. Leave your email to get it first.
Add this badge to your site or README. It always shows the latest score.
