Web scraping MCP servers fetch pages and return clean text or structured data. Check whether a server renders JavaScript, respects robots.txt, and caps how many pages one request can crawl. 891 published MCP servers match this ranking. The highest trust scores right now are mcp-journalist-media-list-builder at 65, mcp-news-media-mention-monitor at 65, mcp-recent-funding-rounds-feed at 65. The order is the published trust score: registry record, license, maintenance, popularity, documentation, and security signals. Featured slots, when an editor sets them, are labeled and do not change the score. Best web scraping MCP servers is not a paid placement.
Best of
Full ranking
Every server that matches this ranking, ordered by trust score.
Public website health scan, AI-crawler and structured-data readiness, and a local presence score.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Web search, crawling and ranking evaluation on your own YaCy peer: no API key, no central service.
Registry
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Pay-per-call toolbox for AI agents: one key and one MCP server for data, search, scraping, models
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
Registry
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Pay-per-result data tools: bulk APIs, docs to Markdown, OCR, files, datasets, papers, tech stack.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Paste an Amazon product URL: reviews are collected for you and turned into a seller-ready action…
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Scrape job listings from companies using Greenhouse ATS via a fast API.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Find and compare named scrapers using saved evidence; compare APIs, proxies and RAG extractors.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Current pricing, cost estimates and recommendations for web scraping APIs, with official sources.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Google Jobs listings billed per result, via the Apify Google Jobs Scraper API, hosted MCP.
RegistryRemote
–LicenseCQuality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: C. 65/100 for listing completeness. Lost points: no listed tools, short summary.Maintenance: Not graded. No commit or release date has been recorded.
Scrape websites by following links and extract structured data from natural language instructions.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Scrape, crawl, and search the web via Firecrawl’s official hosted MCP.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
YouTube channels for AI agents, no API key: exact views, subscribers, videos, playlists, hashtags.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Scrape any Open Collective's public expenses and transactions as clean JSON — amounts, dates…
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Commodity futures, FX, Treasury yields, CFTC positioning, coins and vessel tracking as agent tools.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
DuckDuckGo web search results, news and related searches. Paid, on Apify's hosted MCP.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Check if a site is ready for AI search: AI crawler access, llms.txt, JSON-LD, scored out of 100.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Scrape any company's Recruitee job board with this scraper.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
Cited AI crawler registry (training, search or user fetch) plus robots.txt checks. No fetching.
RegistryRemote
–License–Quality–MaintenanceLicense: Not graded. No license is recorded for this server.Quality: Not graded. No README or tool list has been captured yet.Maintenance: Not graded. No commit or release date has been recorded.
