Can AI crawlers read easytraveldeal.com?
AI crawlers can read almost nothing on this site. 14 of 20 checks failed.
Scored 31/100 on 2026-10-15 from https://www.easytraveldeal.com/
What an AI crawler gets
The first 400 characters of text in the HTML, before any JavaScript runs.
Easy Travel Deal | Budget Travel from the UK
44 characters of readable text, under the 400 we count as readable
Which AI crawlers are allowed
| Crawler | robots.txt says |
|---|---|
| GPTBot | Allowed |
| OAI-SearchBot | Allowed |
| ClaudeBot | Allowed |
| Claude-SearchBot | Allowed |
| PerplexityBot | Allowed |
| Perplexity-User | Allowed |
| Google-Extended | Allowed |
| CCBot | Allowed |
| Bytespider | Allowed |
| Amazonbot | Allowed |
Score by category
Fixes, biggest first
Put your words in the HTML
A crawler that runs no JavaScript found under 400 characters of text. Whatever your page says after scripts run, it doesn't say to them.
Stop serving an empty app shell
The page is a JavaScript shell: scripts plus almost no text. To most AI crawlers it looks blank.
Add structured data (JSON-LD)
Machine-readable facts about your business: name, logo, what you sell. AI systems use it to describe you accurately.
Add real copy to the page
Readable text is a tiny share of the page's code, or there's very little of it. Crawlers summarise words, not markup.
Give the page an h1 heading
One clear main heading tells a crawler what the page is about.
Use semantic HTML tags
Tags like main, nav, article and footer show which part is content and which is chrome.
Describe your organisation in JSON-LD
Organization or WebSite objects tie your site to a known entity, so answers name you correctly.
Keep sitemap dates fresh
No lastmod date in the last 90 days, so crawlers can't tell what changed and may not come back.
Offer a machine-readable interface
A valid /openapi.json or /llms-full.txt lets AI agents use your product or read your docs in full, not just your homepage.
Add an llms.txt file
A short Markdown summary of your site at /llms.txt. Cheap to add, but few AI systems request it yet, so it's worth 3 points.
Add a meta description
A one-sentence summary that crawlers and link previews reuse.
Add Open Graph tags
og:title, og:description and og:image control how your link looks when shared, including in AI chat apps.
Add a canonical link
Tells crawlers which URL is the real one when the same page is reachable at several.
Mirror llms.txt at /.well-known/llms.txt
Some tools look in the .well-known folder instead. A copy of the same file covers both.
6 checks passed
- Publish a robots.txt file (4 points)
- Let GPTBot crawl the site (6 points)
- Let ClaudeBot crawl the site (6 points)
- Let PerplexityBot crawl the site (6 points)
- Write a descriptive page title (3 points)
- Publish a sitemap.xml (6 points)