How do I install TheCrawler?

Pick a client above and copy the generated config. Cursor and VS Code also have a deep link when the server can run locally or remotely.

Is TheCrawler official?

No. Registry-listed is not the same as vendor-official. Read the methodology for the difference.

How is the trust score calculated?

This listing scores 45 (Fair). The formula is published on the methodology page.

MCPpedia

TheCrawler MCP Server | MCPpedia

TheCrawler MCP Server

Name: TheCrawler MCP Server
Author: manchittlab

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Tools Versions Alternatives

Registrymanchittlab

45Fair

Install

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "manchittlab-thecrawler": {
      "command": "npx",
      "args": [
        "-y",
        "thecrawler@0.5.8"
      ]
    }
  }
}

Install guide

Related servers

SuperLocalMemory

78Good

Local-first memory for AI agents: recall with sources, answer checks, documents, mesh, governance.

Registryqualixar249 stars1.3K/wk

Codebase Memory

77Good

Codebase knowledge graph for AI agents — 162 languages, sub-ms queries, 99% fewer tokens.

TheCrawler MCP Server

Install

Related servers

SuperLocalMemory

Codebase Memory

Environment

Tools

About

FAQ

Reviews

haiku.rag

openInvest

M3 Memory

Codigest