Web scraping MCP servers
MCP servers for web scraping and crawling: Firecrawl, Apify, Crawl4AI, and fetch tools that turn pages into clean Markdown for your AI client.
What to know about Web scraping MCP servers
Scraping servers specialise in getting text out of websites rather than clicking through them. A good one fetches a URL, renders JavaScript when it has to, strips navigation and ads, and hands the model clean Markdown or structured JSON. Crawl tools go further and follow links across a whole site, which is what you want when building a dataset or indexing documentation.
The catalog splits between self-hosted libraries such as Crawl4AI or plain fetch servers, and API-backed services such as Firecrawl, Apify, ScrapingBee, or Bright Data. API services handle proxies, rate limits, and blocking for you but charge per page. Local servers are free and private but will hit bot protection on larger sites.
Respect robots.txt and each site's terms, and set crawl limits before you let an agent loose on a domain. A single prompt can request thousands of pages if the server does not cap depth or page count.
Web scraping MCP servers
The 12 strongest of 980 matching servers. Servers that name the topic directly come first, then by trust score.
- 77Trust score 77 of 100, Good
Firecrawl MCP Server
by firecrawl · JavaScript
Firecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.
RegistryRemoteLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 12 days ago. 
74Trust score 74 of 100, Goodapify-mcp-server
by apify · TypeScript
Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡
RegistryRemoteLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 22 days ago.
74Trust score 74 of 100, GoodXquik MCP Server
by xquik-dev · JavaScript
Xquik is the world's fastest and cheapest X (Twitter) data API with the most complete X data.
RegistryRemoteLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 19 days ago.- 72Trust score 72 of 100, Good
CRW Web Scraper
by fastcrw · Rust
Open-source web scraper for AI agents with scrape, crawl, and map tools
RegistryLicenseQualityMaintenanceLicense: C. AGPL-3.0 is a strong copyleft license: derived works must use the same license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 22 days ago. - 71Trust score 71 of 100, Good
proxy-scraper
by maximilianfeix · Python
Free proxies that actually work: checked HTTP/SOCKS proxies, and pages fetched through them
RegistryLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 18 days ago. - 69Trust score 69 of 100, Good
doc-scraper
by sriram-pr · Go
Crawl documentation sites into local corpora agents can search, read, and diff fully offline.
RegistryLicenseQualityMaintenanceLicense: A. Apache-2.0 is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 4 days ago. - 68Trust score 68 of 100, Good
Firecrawl
by pipeworx-io · JavaScript
Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web scraping / crawling / search…
RegistryRemoteLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 9 days ago. - 68Trust score 68 of 100, Good
Jina Reader
by pipeworx-io · JavaScript
Jina AI Reader/Search MCP — turn any URL into clean LLM-ready markdown, plus web search.
RegistryRemoteLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 9 days ago. - 67Trust score 67 of 100, Good
ScrapeBadger
by scrape-badger · Python
Twitter/X, Google Search, Yelp, GitHub repositories and AutoScout24 listings for AI agents.
RegistryLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: B. Last commit or release 38 days ago. - 67Trust score 67 of 100, Good
Scrapingbee
by pipeworx-io · JavaScript
ScrapingBee MCP — wraps the ScrapingBee headless-scraping API (scrapingbee.com)
RegistryRemoteLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 9 days ago. - 65Trust score 65 of 100, Good
Find Reddit leads and brand mentions. AI buyer labels and Slack or Notion delivery. $1.50/1k results
RegistryRemoteLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: C. 65/100 for listing completeness. Lost points: no listed tools, short summary.Maintenance: A. Last commit or release 15 days ago. - 65Trust score 65 of 100, Good
mcp-substack-scraper
by mambalabsdev · TypeScript
Substack publications, posts, subscriber counts, and keyword search.
RegistryLicenseQualityMaintenanceLicense: A. MIT is a permissive open source license.Quality: Not graded. No README or tool list has been captured yet.Maintenance: A. Last commit or release 5 days ago.
How to install one
- Compare the shortlist. Firecrawl MCP Server leads this topic. Open two or three listings and compare their tools, transport, and required API keys.
- Copy the config for your client. Each listing has an install guide, for example Claude Desktop, Claude Code, Cursor, or VS Code. The client guides show where each config file lives.
- Scope credentials, then restart. Use the narrowest token or folder the server needs, restart the client, and check that the new tools appear.
Web scraping MCP questions
What is the difference between a scraping server and a browser automation server?
Scraping servers return page content and stop there. Browser automation servers keep a session open so the agent can click, type, and navigate. If you only need the text of a page, a scraper is faster and uses fewer tokens.
Can MCP scrapers read JavaScript-rendered pages?
Many can. Firecrawl, Apify actors, and Crawl4AI render pages in a headless browser before extracting text. Simple fetch servers only see the raw HTML, so single-page apps often come back nearly empty.
Are web scraping MCP servers free?
The servers themselves are usually open source. Hosted scraping APIs bill per page or credit, typically with a free tier. Self-hosted scrapers cost nothing beyond your own compute and bandwidth.