agent-eval
50FairStatistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.
Loading the directory
MCP servers linked to github.com/rudrendupaul.
35 servers
Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.
Wraps the AgenticWorkspace CLI as a single generic MCP tool for repo workspace scans.
Evaluates whether an AI agent is safe to operate internal web apps via an MCP run_suite tool.
Wraps the evolveguard CLI as a single generic MCP tool for agent-skill file safety checks.
Mines git history for file co-change patterns into a queryable knowledge graph via MCP.
Benchmarks local LLM inference speed (tokens/sec) on your own hardware via MCP tools.
Wraps the MasteryTrace CLI as a single generic MCP tool for skill-mastery tracking.
Verifies Ed25519-signed attestation records and builds audit reports via MCP tools.
Scans datasets/models for PII/secrets, redacts, and packages a public-release bundle via MCP.
Security scanner for third-party AI agent-skill files (SKILL.md, hooks, scripts) via MCP.
Append-only event log for cross-agent context/memory sharing via 3 MCP tools.
Wraps the taskswarm CLI as a single generic MCP tool for multi-agent task coordination.
Wraps the toolgovern CLI as a single generic MCP tool for agent-tool policy validation.
Wraps the WorkspaceGuard CLI as a single generic MCP tool for workspace usage checks.
AI agent observability with deterministic record/replay for debugging agent failures.
BYOK Reddit/YouTube research CLI with a tamper-evident audit log and an MCP server.
Wraps the ContinuityGuard CLI as a single generic MCP tool for video-clip continuity scans.
AI quoting agent for electronics distributors. RFQ in, quote out via MCP tools.
Wraps the fpp CLI as a single generic MCP tool for freelancer client payment-risk checks.
Fail-closed deterministic checks and hash-chained receipts for AI agent outputs via MCP.
Zero-config SEO and GEO checker: 21 technical-SEO and generative-engine checks for a live site.
Independent, reproducible benchmark harness for agent-memory backends.
Traces which neurons and attention heads drive a language model's output via MCP tools.
Wraps the ownvoice CLI as a single generic MCP tool for voice/identity checks.