Can AI crawlers read esotericai.xyz?
AI crawlers can find and read this site well.
- Site inspected
- esotericai.xyz
- Fetched from
- https://esotericai.xyz/landing
- Date
- 2026-10-17
- Checks failed
- 4 of 20
AI crawlers can find and read this site well.
The first 400 characters of text in the HTML, before any JavaScript runs.
esotericAI - AI-Powered Tarot Readings and Astrology Unlock Your Destiny When life feels uncertain, find clarity in the patterns shaping your path. What is esotericAI? esotericAI is an AI-powered tarot reading platform that combines ancient tarot and astrology wisdom with modern artificial intelligence. Users can receive personalized tarot readings and unlock and ask questions to their cosmic blue...
2,681 characters of readable text
| Crawler | robots.txt says |
|---|---|
| GPTBot | Allowed |
| OAI-SearchBot | Allowed |
| ClaudeBot | Allowed |
| Claude-SearchBot | Allowed |
| PerplexityBot | Allowed |
| Perplexity-User | Allowed |
| Google-Extended | Allowed |
| CCBot | Allowed |
| Bytespider | Allowed |
| Amazonbot | Allowed |
A list of every page you want found. Without one, crawlers only find what's linked.
No lastmod date in the last 90 days, so crawlers can't tell what changed and may not come back.
A valid /openapi.json or /llms-full.txt lets AI agents use your product or read your docs in full, not just your homepage.
Some tools look in the .well-known folder instead. A copy of the same file covers both.