Skip to content
MCPpedia
Submit
evalsmith-mcp
Install guide · VS Code

Install evalsmith-mcp for VS Code

Workspace file .vscode/mcp.json uses the servers key. User settings can hold the same shape.

Official VS Code docs
Add to Cursor: evalsmith-mcpInstall in VS Code: evalsmith-mcpInstall in VS Code Insiders: evalsmith-mcp

Needs Cursor or VS Code installed on this device. The button opens the app and asks you to confirm before it adds the server.

  1. Open .vscode/mcp.json on macOS, .vscode/mcp.json on Windows, or .vscode/mcp.json on Linux.

  2. Paste the JSON config below.

  3. Replace placeholder secrets, then restart the client if it does not reload on its own.

.vscode/mcp.json
{  "servers": {    "diegoperezg7-evalsmith-mcp": {      "type": "stdio",      "command": "npx",      "args": [        "-y",        "evalsmith-mcp@0.1.0"      ],      "env": {        "EVALSMITH_JUDGE_BASE_URL": "http://localhost:11434/v1",        "EVALSMITH_JUDGE_MODEL": "llama3.1:8b",        "EVALSMITH_JUDGE_API_KEY": "YOUR_EVALSMITH_JUDGE_API_KEY",        "LOG_LEVEL": "info"      }    }  }}

Where the config lives

SystemPath
macOS.vscode/mcp.json
Windows.vscode/mcp.json
Linux.vscode/mcp.json