Robot Resources Scraper

Alternatives to Robot Resources Scraper

Same category, ordered by trust score.

• F

  Firecrawl MCP Server

  77Good

  MCP server for Firecrawl — web search, scraping, and biomedical/arXiv paper search.

  RegistryRemotefirecrawl7.6K stars
• P

  pagespeed-insights-mcp

  75Good

  Google PageSpeed Insights and CrUX: six workflow tools for web performance.

  Registryruslanlap72 stars500/wk
• H

  Hive Intelligence MCP

  73Good

  Evidence-backed crypto due diligence with sources, freshness, and a runtime receipt on every call.

  RegistryRemotehive-intel20 stars200/wk
• S

  Screaming Frog SEO Spider MCP Server (headless)

  71Good

  Headless Screaming Frog SEO Spider via its CLI: run crawls, export and filter data, no GUI needed.

  Registrybzsasson93 stars
• S

  shift-mcp-server

  70Good

  Lightweight coordination layer for multiple AI agents working on the same codebase simultaneously.

  Registrycyanheads1 stars217/wk
• A

  Agent Passport System — Cryptographic Identity for AI Agents

  70Good

  Cryptographic identity, delegation, governance, and commerce for AI agents. 152 tools.

  RegistryRemoteagent-passport-system4 stars134/wk