Can AI crawlers read makeitclear.com?
AI crawlers can read some of this site. The fixes below close the gaps. 8 of 20 checks failed.
Scored 68/100 on 2026-10-16 from https://makeitclear.com/
What an AI crawler gets
The first 400 characters of text in the HTML, before any JavaScript runs.
Design Agency London, Design Agency UK - Make it Clear Skip to content Still not sure if we’re a good fit for your project? Schedule a free consultation to discuss your project in more detail, and we’ll be happy to advise you. Please leave this field empty. Name Email Case studies Services Services Services Consultancy and research With ongoing consultancy, we are an extension of your team, provid...
12,218 characters of readable text
Which AI crawlers are allowed
| Crawler | robots.txt says |
|---|---|
| GPTBot | Blocked |
| OAI-SearchBot | Blocked |
| ClaudeBot | Blocked |
| Claude-SearchBot | Blocked |
| PerplexityBot | Blocked |
| Perplexity-User | Blocked |
| Google-Extended | Blocked |
| CCBot | Blocked |
| Bytespider | Blocked |
| Amazonbot | Blocked |
Score by category
Fixes, biggest first
Let GPTBot crawl the site
Your robots.txt blocks OpenAI's crawler, so ChatGPT learns about you only from other sites.
Let ClaudeBot crawl the site
Your robots.txt blocks Anthropic's crawler, so Claude learns about you only from other sites.
Let PerplexityBot crawl the site
Your robots.txt blocks Perplexity's crawler, so it can't cite your pages in answers.
Add real copy to the page
Readable text is a tiny share of the page's code, or there's very little of it. Crawlers summarise words, not markup.
Offer a machine-readable interface
A valid /openapi.json or /llms-full.txt lets AI agents use your product or read your docs in full, not just your homepage.
Add an llms.txt file
A short Markdown summary of your site at /llms.txt. Cheap to add, but few AI systems request it yet, so it's worth 3 points.
Add Open Graph tags
og:title, og:description and og:image control how your link looks when shared, including in AI chat apps.
Mirror llms.txt at /.well-known/llms.txt
Some tools look in the .well-known folder instead. A copy of the same file covers both.
Get told when this changes
We're building monitoring: a re-score every week and an email when the score moves. Leave your email to get it first.
Show your score
Add this badge to your site or README. It always shows the latest score.
12 checks passed
- Publish a robots.txt file (4 points)
- Put your words in the HTML (18 points)
- Stop serving an empty app shell (10 points)
- Give the page an h1 heading (4 points)
- Use semantic HTML tags (4 points)
- Add structured data (JSON-LD) (6 points)
- Describe your organisation in JSON-LD (4 points)
- Write a descriptive page title (3 points)
- Add a meta description (3 points)
- Add a canonical link (2 points)
- Publish a sitemap.xml (6 points)
- Keep sitemap dates fresh (4 points)