How do I install Agent Crawl Readiness?

Pick a client above and copy the generated config. Cursor and VS Code also have a deep link when the server can run locally or remotely.

Is Agent Crawl Readiness official?

No. Registry-listed is not the same as vendor-official. Read the methodology for the difference.

How is the trust score calculated?

This listing scores 52 (Fair). The formula is published on the methodology page.

MCPpedia

Agent Crawl Readiness MCP Server | MCPpedia

Agent Crawl Readiness MCP Server

Name: Agent Crawl Readiness MCP Server
Author: sadri-dridi

Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.

Tools Versions Alternatives

RegistryRemotesadri-dridi

52Fair

Install

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "sadri-dridi-agent-crawl-readiness": {
      "url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-crawl-readiness/mcp"
    }
  }
}

Install guide

Related servers

doc-scraper

69Good

Crawl documentation sites into local corpora agents can search, read, and diff fully offline.

Registrysriram-pr107 stars

chrome-bridge

68Good

Borrow a tab from your own logged-in Chrome, hand it back; 2FA and CAPTCHA stay yours. 67 tools.

Agent Crawl Readiness MCP Server

Install

Related servers

doc-scraper

chrome-bridge

Environment

Tools

About

FAQ

Reviews

Next AI Draw.io

moontide

mcp

seo-audit-console