How do I install evals-mcp-server?

Pick a client above and copy the generated config. Cursor and VS Code also have a deep link when the server can run locally or remotely.

Is evals-mcp-server official?

No. Registry-listed is not the same as vendor-official. Read the methodology for the difference.

How is the trust score calculated?

This listing scores 37 (Limited). The formula is published on the methodology page.

MCPpedia

evals-mcp-server MCP Server | MCPpedia

evals-mcp-server MCP Server

Name: evals-mcp-server MCP Server
Author: cyanheads

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

Tools Versions Alternatives

Registrycyanheads

37Limited

Install

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "cyanheads-evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server@0.1.6"
      ],
      "env": {
        "EVALS_DATA_DIR": "./evals-data",
        "EVALS_REQUIRE_CONFIRMATION": "false",
        "EVALS_DEFAULT_LICENSE": "",
        "EVALS_CAPTURE_DIR": "",
        "MCP_LOG_LEVEL": "info"
      }
    }
  }
}

Install guide

Related servers

kordoc

83Excellent

Parse Korean documents (HWP, HWPX, PDF, XLSX, DOCX, PPTX) to Markdown; fill forms, diff, render.

Registrychrisryugj2.5K stars44.2K/wk

pagespeed-insights-mcp

75Good

Google PageSpeed Insights and CrUX: six workflow tools for web performance.

Environment

Name	Required	Notes
EVALS_DATA_DIR	No	Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.
EVALS_REQUIRE_CONFIRMATION	No	When 'true', evals_submit_draft requests human confirmation before finalizing.
EVALS_DEFAULT_LICENSE	No	Default metadata.license applied when a draft omits one.
EVALS_CAPTURE_DIR	No	Directory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps.
MCP_LOG_LEVEL	No	Sets the minimum log level for output (e.g., 'debug', 'info', 'warn').
MCP_TRANSPORT_TYPE	No	Selects the HTTP transport.
MCP_HTTP_HOST	No	The hostname for the HTTP server.
MCP_HTTP_PORT	No	The port to run the HTTP server on.
MCP_HTTP_ENDPOINT_PATH	No	The endpoint path for the MCP server.
MCP_AUTH_MODE	No	Authentication mode to use: 'none', 'jwt', or 'oauth'.
EVALS_DATA_DIR	No	Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.
EVALS_REQUIRE_CONFIRMATION	No	When 'true', evals_submit_draft requests human confirmation before finalizing.
EVALS_DEFAULT_LICENSE	No	Default metadata.license applied when a draft omits one.
EVALS_CAPTURE_DIR	No	Directory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps.
MCP_LOG_LEVEL	No	Sets the minimum log level for output (e.g., 'debug', 'info', 'warn').

evals-mcp-server MCP Server

Install

Related servers

kordoc

pagespeed-insights-mcp

Environment

Tools

About

FAQ

Reviews

Hive Intelligence MCP

Screaming Frog SEO Spider MCP Server (headless)

Assay MCP Server

Kilotest