IsItAgentReady

Canonical version: IsItAgentReady.

IsItAgentReady is a free scanner from Cloudflare. Give it a URL and it scores how well the site supports the standards AI Agents use to find, read, access and pay for things on the web. Cloudflare introduced this "Agent Readiness score" during its Agents Week.

Think of it as Search Engine Optimization (SEO) for agents: SEO made sites readable for crawlers, this checks whether they're readable for agents (some call it "agent experience"). I have it on my backlog for my DeveloPassion site, dsebastien.net.

What it checks

Five categories:

  • Discoverability: robots.txt, sitemap, Link response headers, and DNS for AI Discovery (DNS-AID)
  • Content accessibility: Markdown content negotiation, i.e., serving a Markdown version of a page when the client asks for one
  • Bot access control: AI bot rules in robots.txt, Content Signals (what crawlers may do with your content) and Web Bot Auth (bots proving who they are)
  • Protocol discovery: MCP Server Card, Agent Skills, WebMCP, API Catalog, OAuth discovery, OAuth Protected Resource, Auth.md and ARD
  • Commerce: x402, MPP, UCP and ACP (agent payment and checkout protocols)

There are three scan profiles (All, Content Site, API/Application), so a blog doesn't lose points for not exposing an OAuth server.

Fixes come as prompts

For each missing item, the tool writes a prompt you paste into a coding agent (Claude Code, Cursor, Windsurf) to implement the fix. The prompts are AI-generated, so review what the agent changes before you ship it.

Cloudflare suggests starting with the easy ones: a valid robots.txt with AI bot rules and sitemap directives, and discovery headers or metadata on the homepage.

According to Korben, Cloudflare measured 31% fewer tokens consumed and 66% faster responses on its own docs after turning these features on.

The site also exposes an MCP server at /.well-known/mcp.json with a scan_site tool, so an agent can run the scan itself.

References


About Sébastien

Ready to get to the next level?

Found this valuable? Share it with someone who needs it.

Join 6,000+ readers. Get practical systems for knowledge & AI. Free.

Subscribe ✨

Free: Knowledge System Checklist

A clear roadmap to building your own knowledge system. Subscribe and get it straight to your inbox.

6,000+ readers. No spam. Unsubscribe anytime.

Subscribe