Can AI crawlers read sltcreative.com?
AI crawlers can find and read this site well. 4 of 20 checks failed.
Scored 87/100 on 2026-10-16 from https://www.sltcreative.com/
What an AI crawler gets
The first 400 characters of text in the HTML, before any JavaScript runs.
Salt Creative | Web Design For Small Business Home Testimonials Portfolio Resources Small Business Infrastructure Guide Small Business Marketing System How to Start a Small Business Contact Get Seasoned. Get Seen. A full-service web design agency. Button Is your website working for you? Button Salt Creative Web Design For Small Business Websites for Business, E-Commerce, & SEO Salt Creat...
13,353 characters of readable text
Which AI crawlers are allowed
| Crawler | robots.txt says |
|---|---|
| GPTBot | Allowed |
| OAI-SearchBot | Allowed |
| ClaudeBot | Allowed |
| Claude-SearchBot | Allowed |
| PerplexityBot | Allowed |
| Perplexity-User | Allowed |
| Google-Extended | Allowed |
| CCBot | Allowed |
| Bytespider | Allowed |
| Amazonbot | Allowed |
Score by category
Fixes, biggest first
Add real copy to the page
Readable text is a tiny share of the page's code, or there's very little of it. Crawlers summarise words, not markup.
Use semantic HTML tags
Tags like main, nav, article and footer show which part is content and which is chrome.
Offer a machine-readable interface
A valid /openapi.json or /llms-full.txt lets AI agents use your product or read your docs in full, not just your homepage.
Mirror llms.txt at /.well-known/llms.txt
Some tools look in the .well-known folder instead. A copy of the same file covers both.
16 checks passed
- Publish a robots.txt file (4 points)
- Let GPTBot crawl the site (6 points)
- Let ClaudeBot crawl the site (6 points)
- Let PerplexityBot crawl the site (6 points)
- Add an llms.txt file (3 points)
- Put your words in the HTML (18 points)
- Stop serving an empty app shell (10 points)
- Give the page an h1 heading (4 points)
- Add structured data (JSON-LD) (6 points)
- Describe your organisation in JSON-LD (4 points)
- Write a descriptive page title (3 points)
- Add a meta description (3 points)
- Add Open Graph tags (2 points)
- Add a canonical link (2 points)
- Publish a sitemap.xml (6 points)
- Keep sitemap dates fresh (4 points)