Install guide · Cursor
Install evalsmith-mcp for Cursor
Cursor reads ~/.cursor/mcp.json. A project can also commit .cursor/mcp.json.
Add to Cursor: evalsmith-mcpInstall in VS Code: evalsmith-mcpInstall in VS Code Insiders: evalsmith-mcp
Needs Cursor or VS Code installed on this device. The button opens the app and asks you to confirm before it adds the server.
Open ~/.cursor/mcp.json on macOS, %USERPROFILE%\.cursor\mcp.json on Windows, or ~/.cursor/mcp.json on Linux.
Paste the JSON config below.
Replace placeholder secrets, then restart the client if it does not reload on its own.
{ "mcpServers": { "diegoperezg7-evalsmith-mcp": { "command": "npx", "args": [ "-y", "evalsmith-mcp@0.1.0" ], "env": { "EVALSMITH_JUDGE_BASE_URL": "http://localhost:11434/v1", "EVALSMITH_JUDGE_MODEL": "llama3.1:8b", "EVALSMITH_JUDGE_API_KEY": "YOUR_EVALSMITH_JUDGE_API_KEY", "LOG_LEVEL": "info" } } }}
Where the config lives
| System | Path |
|---|---|
| macOS | ~/.cursor/mcp.json |
| Windows | %USERPROFILE%\.cursor\mcp.json |
| Linux | ~/.cursor/mcp.json |