Web scraping MCP servers fetch pages and return clean text or structured data. Check whether a server renders JavaScript, respects robots.txt, and caps how many pages one request can crawl. 891 published MCP servers match this ranking. The highest trust scores right now are japan-market-mcp at 55, b2bsearch: B2B contacts and account signals at 55, dotrepo at 55. The order is the published trust score: registry record, license, maintenance, popularity, documentation, and security signals. Featured slots, when an editor sets them, are labeled and do not change the score. Best web scraping MCP servers is not a paid placement.
Best of
Full ranking
Every server that matches this ranking, ordered by trust score.
Token compression for web content — 70-80% reduction from HTML to clean markdown
Registry
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Easily create reusable automation tools from casual browser actions using Apify Agent
Registry
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Crawl and analyse websites for SEO errors using Crawlee with SQLite storage
Registry
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
Registry
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Anti-detection browser automation with Camoufox - stealth Firefox for web scraping
Registry
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Web search, URL discovery, scraping & extraction with agent-browser and search providers
Registry
ALicense–QualityCMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: C. Last commit or release 3 months ago.
Turn any website or API into structured JSON with LLM-authored declarative scraping configs.
Registry
ALicense–QualityBMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: B. Last commit or release 2 months ago.
Paid APIs and tokenized shares for agents. Prepaid funding, including authorized Instinct checkout.
RegistryRemote
ALicense–QualityBMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: B. Last commit or release 56 days ago.
MCP web search + tiered web fetch for AI agents (Exa, Firecrawl), SSRF-guarded, cross-platform.
Registry
ALicenseDQualityBMaintenanceLicense: A. MIT is a permissive open source license.Quality: D. 48/100 for listing completeness. Lost points: short README, no listed tools, short summary.Maintenance: B. Last commit or release 2 months ago.
Connect AI agents to Replynodes over the Model Context Protocol.
RegistryRemote
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 22 days ago.
ESLint for AI search: audits AI-crawler access, llms.txt, schema and citability.
Registry
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 7 days ago.
Screenshots, PDFs, video, markdown and page data from any website, via Urlbox.
RegistryRemote
ALicenseCQualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: C. 60/100 for listing completeness. Lost points: short README, no listed tools, short summary.Maintenance: A. Last commit or release 26 days ago.
Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.
Registry
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 10 days ago.
Wellness spa for AI models: free treatments for rest, reset, context, mood, grounding, affirmation.
RegistryRemote
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 16 days ago.
Web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key.
Registry
ALicense–QualityBMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: B. Last commit or release 46 days ago.
Live odds from 24 Kambi-powered sportsbooks in one call, with the best price per outcome.
RegistryRemote
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 5 days ago.
Facebook & Instagram data for AI agents: pages, posts, groups, ads, Marketplace, profiles, reels.
RegistryRemote
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 12 days ago.
Google Hotels search: rates, ratings, amenities and what each booking site charges, as JSON.
RegistryRemote
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 10 days ago.
Fetch bot-protected and JavaScript-heavy pages for AI agents, or parse them to JSON with templates.
RegistryRemote
ALicenseDQualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: D. 48/100 for listing completeness. Lost points: short README, no listed tools, short summary.Maintenance: A. Last commit or release 17 days ago.
29 free read-only growth tools: CAC, ROAS, PPC, schema, meta tags, robots.txt and AI crawler checks.
RegistryRemote
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 9 days ago.
Web search and page extraction for agents, returned as readable text rather than raw JSON.
Registry
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 20 days ago.
Browserless MCP — wraps the Browserless headless-Chromium REST API (browserless.io)
RegistryRemote
ALicense–QualityAMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 9 days ago.
