Can AI crawlers read seocheckr.com?
AI crawlers can read some of this site. The fixes below close the gaps. 7 of 20 checks failed.
Scored 76/100 on 2026-10-17 from https://www.seocheckr.com/
What an AI crawler gets
The first 400 characters of text in the HTML, before any JavaScript runs.
Free SEO Tools - SEOCheckr SEOCheckr SEO Checker SERP Preview Tool Free SEO Analysis → Free SEO Tools Access a range of free SEO tools to help you optimize your website and boost your online presence. Try SEO Checker SERP Preview SEO Tools That Work - 100% Free Our suite of free SEO tools is designed to help you optimize your website’s performance and boost your visibility in search results. From ...
2,855 characters of readable text
Which AI crawlers are allowed
| Crawler | robots.txt says |
|---|---|
| GPTBot | Allowed |
| OAI-SearchBot | Allowed |
| ClaudeBot | Allowed |
| Claude-SearchBot | Allowed |
| PerplexityBot | Allowed |
| Perplexity-User | Allowed |
| Google-Extended | Allowed |
| CCBot | Allowed |
| Bytespider | Allowed |
| Amazonbot | Allowed |
Score by category
Fixes, biggest first
Add structured data (JSON-LD)
Machine-readable facts about your business: name, logo, what you sell. AI systems use it to describe you accurately.
Add real copy to the page
Readable text is a tiny share of the page's code, or there's very little of it. Crawlers summarise words, not markup.
Describe your organisation in JSON-LD
Organization or WebSite objects tie your site to a known entity, so answers name you correctly.
Offer a machine-readable interface
A valid /openapi.json or /llms-full.txt lets AI agents use your product or read your docs in full, not just your homepage.
Add an llms.txt file
A short Markdown summary of your site at /llms.txt. Cheap to add, but few AI systems request it yet, so it's worth 3 points.
Add Open Graph tags
og:title, og:description and og:image control how your link looks when shared, including in AI chat apps.
Mirror llms.txt at /.well-known/llms.txt
Some tools look in the .well-known folder instead. A copy of the same file covers both.
13 checks passed
- Publish a robots.txt file (4 points)
- Let GPTBot crawl the site (6 points)
- Let ClaudeBot crawl the site (6 points)
- Let PerplexityBot crawl the site (6 points)
- Put your words in the HTML (18 points)
- Stop serving an empty app shell (10 points)
- Give the page an h1 heading (4 points)
- Use semantic HTML tags (4 points)
- Write a descriptive page title (3 points)
- Add a meta description (3 points)
- Add a canonical link (2 points)
- Publish a sitemap.xml (6 points)
- Keep sitemap dates fresh (4 points)