Crawlerpeek MCP Server
Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.
Crawlerpeek scores 39 (Limited), licensed MIT and written in TypeScript. It installs as a local process. It does not declare tools yet. Filed under Web scraping. GitHub shows 3 stars. Install configs are generated for 10 clients. Being listed in the registry is not the same as being vendor-official.
Limited trust
39 of 100 from six public signals. Nobody can buy a point.
- OSI-style license: mit.
License, quality and maintenance
Where the 39 comes from
0 + 20 + 2 + 10 + 4 + 3 = 39. Each factor is capped, so no single signal can carry a listing.
Active in the official MCP registry, plus a known vendor namespace.
Registry: 0 of 30 points.How recently the repository saw a commit or release.
Maintenance: 20 of 20 points.GitHub stars and weekly downloads, on a log scale.
Popularity: 2 of 20 points.A clear, OSI-style open-source license.
License: 10 of 10 points.Not archived, a secure install path, a pinned version.
Security: 4 of 10 points.A real summary, a README with depth, listed tools.
Docs: 3 of 10 points.Install
Pick your client, copy the config, paste it in.
Needs Cursor or VS Code installed on this device. The button opens the app and asks you to confirm before it adds the server.
{ "mcpServers": { "crawlerpeek-crawlerpeek": { "command": "npx", "args": [ "-y", "crawlerpeek@0.3.1" ] } }}
Environment variables
This server does not declare environment variables.
Tools
All capabilitiesTools show up when the registry metadata or the repository README lists them. Public READMEs are read directly. A GitHub token is used only when one is already configured.
About
Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more) can access your site. CLI, library, MCP server and GitHub Action.
Frequently asked questions
What is Crawlerpeek MCP Server?
Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.
How do I install Crawlerpeek MCP Server in Claude Desktop, Cursor, or VS Code?
Pick your client in the Install section on this page and copy the generated config into the client's config file. Step-by-step guides: Claude Desktop, Cursor, and VS Code. Crawlerpeek MCP Server runs locally from the npm package crawlerpeek with the command npx -y crawlerpeek@0.3.1.
Is Crawlerpeek MCP Server free and open source?
Yes. Crawlerpeek MCP Server is released under the MIT license, an OSI-approved open-source license, so you can use, modify, and self-host it under those terms.
Does Crawlerpeek MCP Server support remote (HTTP) connections?
No remote endpoint is listed for Crawlerpeek MCP Server. It runs locally on your machine over stdio, started by your MCP client.
How is Crawlerpeek MCP Server's trust score calculated?
Crawlerpeek MCP Server scores 39 out of 100 (Limited). The score adds six capped public signals: registry status, maintenance, popularity, license, documentation, and security. Nobody can pay for points. Read the methodology for the full formula.
Reviews
No reviews yet—Be the first to review
No published reviews yet. Used it? Tell the next person how it went.
Sign inA verified email is required to review this server.
Add badge to your README
Paste either snippet into the repository README. The image links to this listing.
Manage this listing
Claim this serverRelated servers
Scrapling MCP Server
by d4vinci · Python
Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.
mobile-mcp
by mobile-next · TypeScript
MCP server for iOS and Android Mobile Development, Automation and Testing
Firecrawl MCP Server
by firecrawl · JavaScript
Firecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.
Xquik MCP Server
by xquik-dev · JavaScript
Xquik is the world's fastest and cheapest X (Twitter) data API with the most complete X data.
apify-mcp-server
by apify · TypeScript
Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡
Pages, crawls and URL batches as clean Markdown and JSON for AI agents, with an Evidence Record.