Install guide · Claude Desktop
Install evalsmith-mcp for Claude Desktop
Claude Desktop reads mcpServers from claude_desktop_config.json. Restart the app after saving.
Add to Cursor: evalsmith-mcpInstall in VS Code: evalsmith-mcpInstall in VS Code Insiders: evalsmith-mcp
Needs Cursor or VS Code installed on this device. The button opens the app and asks you to confirm before it adds the server.
Open ~/Library/Application Support/Claude/claude_desktop_config.json on macOS, %APPDATA%\Claude\claude_desktop_config.json on Windows, or ~/.config/Claude/claude_desktop_config.json on Linux.
Paste the JSON config below.
Replace placeholder secrets, then restart the client if it does not reload on its own.
{ "mcpServers": { "diegoperezg7-evalsmith-mcp": { "command": "npx", "args": [ "-y", "evalsmith-mcp@0.1.0" ], "env": { "EVALSMITH_JUDGE_BASE_URL": "http://localhost:11434/v1", "EVALSMITH_JUDGE_MODEL": "llama3.1:8b", "EVALSMITH_JUDGE_API_KEY": "YOUR_EVALSMITH_JUDGE_API_KEY", "LOG_LEVEL": "info" } } }}
Where the config lives
| System | Path |
|---|---|
| macOS | ~/Library/Application Support/Claude/claude_desktop_config.json |
| Windows | %APPDATA%\Claude\claude_desktop_config.json |
| Linux | ~/.config/Claude/claude_desktop_config.json |