evals mcp servers

29 tagged evals, measured the same way as everything else here.

Browse within: Multi-Agent 5nextjs 5

runtime_proof

01

harbor-framework/harbor

MCP server Claude CodeCodexCursor +2

MCP server "runtimeproof", hosted remotely at runtime-mcp-server, as configured in harbor-framework/harbor.

4.8k 2d ago A tokens not measured original Apache-2.0

tools

02

NiceEval/NiceEval

MCP server Claude CodeCodexCursor +2

MCP server that exercises all the features of the MCP protocol. Runs locally from the @modelcontextprotocol/server-everything npm package.

139 2d ago A tokens not measured

maf-doctor

03

AgentEvalHQ/AgentEval

MCP server Claude CodeCodexCursor +2

MCP server "maf-doctor" as configured in AgentEvalHQ/AgentEval. Launched with maf-doctor. Needs 1 environment variable to run.

138 yesterday A tokens not measured original MIT

prefect

04

PrefectHQ/prefect-mcp-server

MCP server Claude CodeCodexCursor +2

MCP server "prefect", hosted remotely at prefect.fastmcp.app, as configured in PrefectHQ/prefect-mcp-server.

52 16d ago A tokens not measured original MIT

scenario-assistant

05

prime-radiant-inc/scenarios

MCP server Claude CodeCodexCursor +2

MCP server "scenario-assistant" as configured in prime-radiant-inc/scenarios. Runs locally from the ../../tools/mcp_server.py Python package.

10 2mo ago A tokens not measured original Apache-2.0

commutescout

06

nicglazkov/commutescout

MCP server Claude CodeCodexCursor +2

Live California road conditions: CHP incidents, Caltrans closures, chain controls, and wildfires. Remote server at mcp.commutescout.com.

4 6d ago A tokens not measured original MIT

evals-mcp-server

07

cyanheads/evals-mcp-server

MCP server Claude CodeCodexCursor

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders. Runs locally from the @cyanheads/evals-mcp-server npm package. Needs 5 environment variables to run.

1 9d ago A tokens not measured original Apache-2.0

opengate-mcp

08

nickjlamb/opengate

MCP server Claude CodeCodexCursor

Check whether an AI answer is grounded in its context — deterministic, no LLM judge. Runs locally from the @pharmatools/opengate-mcp npm package.

1 8d ago A tokens not measured original MIT

querypilot

09

nickklos10/QueryPilot

MCP server Claude CodeCodexCursor

Eval-driven SQL reliability for AI agents. Runs locally from the querypilot Python package. Needs 6 environment variables to run.

1 1mo ago A tokens not measured original MIT

rule-drift

10

ri7in/rule-drift

MCP server Claude CodeCodexCursor

Test whether AI agents retain critical instructions as conversations grow. Runs locally from the rule-drift npm package.

1 yesterday A tokens not measured original MIT

safetyreplay-mcp

11

clauxel/safety-replay-gate-mcp

MCP server Claude CodeCodexCursor

Paid remote MCP for safety replays, policy gates, eval receipts, and release evidence. Remote server at safetyreplay.clauxel.com.

0 3mo ago A tokens not measured

auxiliar

12

auxiliar-ai/auxiliar-mcp

MCP server Claude CodeCodexCursor

Eval-backed tool discovery for AI agents on the auxiliar.ai web-access gateway. recommendtools picks the best search, scraping, browser-automation or voice provider for a job from measured benchmarks (quality, latency, cost, error rate), returning routes. Runs locally from the auxiliar-mcp npm package.

0 1mo ago A tokens not measured original MIT archived

auxiliar-mcp

13

auxiliar-ai/auxiliar-mcp

MCP server Claude CodeCodexCursor

Eval-backed discovery for the auxiliar.ai gateway — the best web-access provider per job, measured. Runs locally from the auxiliar-mcp npm package.

0 1mo ago A tokens not measured original MIT archived

redline

14

gowtham0992/redline

MCP server Claude CodeCodexCursor

Generate eval suites from prompt logs and catch LLM regressions locally. Runs locally from the redline-ai Python package.

0 27d ago A tokens not measured original MIT

ai-workbench-mcp

15

hrishikesh-thakre/ai-workbench-mcp

MCP server Claude CodeCodexCursor

Goose-first acceptance, validation, routing, and audit layer for agentic work. Runs locally from the ai-workbench-mcp Python package.

0 2mo ago A tokens not measured original Apache-2.0

multivon-mcp

16

multivon-ai/multivon-mcp

MCP server Claude CodeCodexCursor

MCP server exposing multivon-eval + pdfhell as agent-callable tools. Drop into Claude Desktop, Cursor, Cline, or any MCP-compatible AI coding agent. Runs locally from the multivon-mcp Python package.

0 12d ago A tokens not measured

pantry-local

17

ketankshukla/learn-mcp-agent-crew

MCP server Claude CodeCodexCursor

MCP server "pantry-local", hosted remotely at localhost, as configured in ketankshukla/learn-mcp-agent-crew.

0 21d ago A tokens not measured

cookie-jar-live

18

ketankshukla/learn-mcp-agent-crew

MCP server Claude CodeCodexCursor

MCP server "cookie-jar-live", hosted remotely at learn-mcp-agent-crew.vercel.app, as configured in ketankshukla/learn-mcp-agent-crew.

0 21d ago A tokens not measured

ketankshukla/learn-mcp-agent-crew

MCP server Claude CodeCodexCursor

MCP server "cookie-jar-forgetful", hosted remotely at learn-mcp-5-year-old.vercel.app, as configured in ketankshukla/learn-mcp-agent-crew.

0 21d ago A tokens not measured

grounded-mcp

20

rich-atkins/grounded-mcp

MCP server Claude CodeCodexCursor +2

MCP server for real-time package versions, download counts, and service status. Covers 1,000+ npm/PyPI packages and 76 cloud services. Runs locally from the grounded-mcp Python package.

0 yesterday A tokens not measured original MIT

agent-eval-gate

21

linus10x/agent-eval-gate

MCP server Claude CodeCodexCursor +2

MCP server "agent-eval-gate" as configured in linus10x/agent-eval-gate. Runs locally from the agent-eval-gate Python package.

0 2mo ago A tokens not measured original MIT

canopy

22

kruslim/canopy

MCP server Claude CodeCodexCursor +2

Python Client for the Canopy Simulation API. Runs locally from the canopy Python package.

0 1mo ago A tokens not measured

repo-rag

23

amangit1314/repo-rag

MCP server Claude CodeCodexCursor +2

Local RAG indexer and MCP server for AI coding agents (Claude, GPT, Gemini, Cursor, Factory Droid, and more). Runs locally from the repo-rag Python package.

0 1mo ago A tokens not measured

rigforge

24

mrodgersjs-web/rigforge

MCP server Claude CodeCodexCursor +2

MCP server "rigforge" as configured in mrodgersjs-web/rigforge. Runs locally from the rigforge Python package.

0 6d ago A tokens not measured original MIT