Docs/Getting Started

What is CrawlReady

CrawlReady scores your website's AI readiness and tracks which AI crawlers visit, what they access, and how often.

CrawlReady scores your website's AI readiness (0-100) and tracks which AI crawlers visit your site, what pages they access, and how often. You see exactly what AI crawlers see — and where they lose content.

What it does

Run a scan to see your AI Readiness Score (0–100). The score measures how well your site serves AI crawlers across three dimensions: crawlability, agent readiness, and agent interaction. You get a breakdown of what's failing and what to fix.

Set up analytics to track which AI crawlers visit your site, how often, and which pages they hit. Analytics runs server-side via middleware, so it captures crawlers that never execute JavaScript.

Who it's for

Developers with JS-heavy sites — React SPAs, Next.js apps, hybrid-rendered sites — that need to show up in AI-generated answers. If you're building for GEO (Generative Engine Optimization) or AI SEO, CrawlReady gives you the instrumentation to measure and improve your position.

Infrastructure, not a tool

You add CrawlReady once. The middleware intercepts every inbound request, detects AI crawlers by User-Agent, and reports the visit to your dashboard. No ongoing integration work. Score data is available at a public URL (crawlready.app/score/yourdomain.com) you can share or embed.

The two capabilities are independent: you can run scans without setting up analytics, and you can track analytics without ever running a scan.

What's coming

A content optimization pipeline is in development. It will intercept AI crawler requests at the middleware level and serve clean, structured content while human visitors see the normal site. This is not yet available.

Need Help?

Can't find what you're looking for? Reach out and we'll help.

Contact us