CrawlReadable
Certificate of AI readabilityNo. CR-20261017-agentswarms.fyi

Can AI crawlers read agentswarms.fyi?

AI crawlers can find and read this site well.

Site inspected
agentswarms.fyi
Fetched from
https://agentswarms.fyi/
Date
2026-10-17
Checks failed
2 of 20

What an AI crawler gets

The first 400 characters of text in the HTML, before any JavaScript runs.

AgentSwarms — Learn Agentic AI Hands-On (Free) AgentSwarms School of Agentic AI GitHub Discord Curriculum Blog Free Tools Free · No sign-up View all → Data & Context URL to LLM-Ready Markdown Converter RAG Document Chunking Visualizer GraphRAG Knowledge Triplet Extractor Synthetic RAG Evaluation Dataset Generator Semantic Chunking Visualizer Prompting & Guardrails LLM-as-a-Judge Prompt Bui...

9,978 characters of readable text

Which AI crawlers are allowed

Crawlerrobots.txt says
GPTBotAllowed
OAI-SearchBotAllowed
ClaudeBotAllowed
Claude-SearchBotAllowed
PerplexityBotAllowed
Perplexity-UserAllowed
Google-ExtendedAllowed
CCBotAllowed
BytespiderAllowed
AmazonbotAllowed

Score by category

Access25 / 26 Content40 / 40 Structure20 / 20 Discovery10 / 10 Interface0 / 4

Findings, biggest first

  1. Finding 1

    Offer a machine-readable interface

    Needs a developer

    A valid /openapi.json or /llms-full.txt lets AI agents use your product or read your docs in full, not just your homepage.

    +4 points
  2. Finding 2

    Mirror llms.txt at /.well-known/llms.txt

    About 5 min

    Some tools look in the .well-known folder instead. A copy of the same file covers both.

    +1 points

Get told when this changes

We're building monitoring: a re-score every week and an email when the score moves. Leave your email to get it first.

Show your score

Add this badge to your site or README. It always shows the latest score.

CrawlReadable score for agentswarms.fyi

18 checks passed
  • Publish a robots.txt file (4 points)
  • Let GPTBot crawl the site (6 points)
  • Let ClaudeBot crawl the site (6 points)
  • Let PerplexityBot crawl the site (6 points)
  • Add an llms.txt file (3 points)
  • Put your words in the HTML (18 points)
  • Stop serving an empty app shell (10 points)
  • Add real copy to the page (4 points)
  • Give the page an h1 heading (4 points)
  • Use semantic HTML tags (4 points)
  • Add structured data (JSON-LD) (6 points)
  • Describe your organisation in JSON-LD (4 points)
  • Write a descriptive page title (3 points)
  • Add a meta description (3 points)
  • Add Open Graph tags (2 points)
  • Add a canonical link (2 points)
  • Publish a sitemap.xml (6 points)
  • Keep sitemap dates fresh (4 points)