Evaluation MCP servers

24 tagged Evaluation, measured the same way as everything else here.

Browse within: LLM 11

playwright

01

langwatch/langwatch

MCP server Claude CodeCodexCursor +2

One of 2 in .mcp.json

MCP server "playwright" as configured in langwatch/langwatch. Launched with bash -c d=$PWD; while [ "$d" != / ] && [ ! -f "$d/dev/scripts/playwright-mcp.sh".

not rated 5.0k +32 today A tokens not measured original Apache-2.0

codebase-memory-mcp

02

suyoumo/ClawProBench

MCP server Claude CodeCodexCursor +2

MCP server "codebase-memory-mcp" as configured in suyoumo/ClawProBench. Launched with codebase-memory-mcp.

not rated 827 +3 1mo ago A tokens not measured original Apache-2.0

tuneforge

03

JustVugg/tuneforge

MCP server Claude CodeCodexCursor +2

MCP server "tuneforge" as configured in JustVugg/tuneforge. Launched with tuneforge. Needs 3 environment variables to run.

not rated 16 6mo ago A tokens not measured original MIT

ragscore

04

HZYAI/RagScore

MCP server Claude CodeCodexCursor +2

The Fastest Way to Audit Your RAG - Generate QA datasets & evaluate RAG systems in Colab, Jupyter, or CLI. Privacy-first, any LLM, visual reports. Runs locally from the ragscore Python package. Needs 2 environment variables to run.

not rated 15 4mo ago A tokens not measured original Apache-2.0

mcp-docs

05

0717376/cowork_bench

MCP server Claude CodeCodexCursor +2

The MCP documentation itself, served as an MCP server: lets the agent search the protocol spec and guides. Remote server at modelcontextprotocol.io.

not rated 9 2mo ago A tokens not measured copy · 100% Apache-2.0

lore-context-mcp

06

Lore-Context/lore-context

MCP server Claude CodeCodexCursor +2

Governed AI-agent memory, Evidence Ledger traces, evals, and portable context tools. Runs locally from the @lore-context/server npm package. Needs 3 environment variables to run.

not rated 4 7d ago A tokens not measured

DanceNitra/agora

MCP server Claude CodeCodexCursor +2

MCP server "agora-memory-toolkit" as configured in DanceNitra/agora. Runs locally from the agora-memory-toolkit Python package.

not rated 3 8d ago A tokens not measured original MIT

opengate-mcp

08

nickjlamb/opengate

MCP server Claude CodeCodexCursor +2

Check whether an AI answer is grounded in its context — deterministic, no LLM judge. Runs locally from the @pharmatools/opengate-mcp npm package.

not rated 1 20d ago A tokens not measured original MIT

judge-mcp

09

egoring/judge-mcp

MCP server Claude CodeCodexCursor +2

MCP server "judge-mcp" as configured in egoring/judge-mcp. Launched with judge-mcp. Needs 3 environment variables to run.

not rated 1 1mo ago A tokens not measured original MIT

forgejudge

10

ahmedEid1/forgejudge

MCP server Claude CodeCodexCursor +2

Open, always-on leaderboard + CI gate for autonomous coding agents — every patch sandboxed, every run traced, every regression fails the build. Runs locally from the forgejudge Python package.

not rated 0 20d ago A tokens not measured original MIT

agenttrust

11

assister-xyz/quality-oracle

MCP server Claude CodeCodexCursor +2

AgentTrust MCP Server — verify AI agent and MCP server quality from your IDE. Runs locally from the mcp-agenttrust Python package. Needs 3 environment variables to run.

not rated 0 5mo ago A tokens not measured original MIT

rendercheck

12

rogermsc/rendercheck

MCP server Claude CodeCodexCursor +2

Assertions for AI-generated media. The bugs don't throw; rendercheck makes them throw. Runs locally from the rendercheck Python package. Needs 1 environment variable to run.

not rated 0 1mo ago A tokens not measured original MIT

mcp-llm-eval

13

berkayildi/mcp-llm-eval

MCP server Claude CodeCodexCursor +2

MCP server that packages LLM evaluation gates as reusable CI/CD primitives. Runs locally from the mcp-llm-eval Python package.

not rated 0 5mo ago A tokens not measured original MIT

reasonforge

14

euuuuuuan/reasonforge-public

MCP server Claude CodeCodexCursor +2

MCP server "reasonforge" as configured in euuuuuuan/reasonforge-public. Runs locally from the reasonforge npm package.

not rated 0 2mo ago A tokens not measured original Apache-2.0

engramia

15

engramia/engramia

MCP server Claude CodeCodexCursor +2

Reusable execution memory and evaluation infrastructure for AI agent frameworks. Runs locally from the engramia Python package. Needs 8 environment variables to run.

not rated 0 5mo ago A tokens not measured

gq-insight-mcp

16

yusufdxb/gq-insight-mcp

MCP server Claude CodeCodexCursor +2

MCP server "gq-insight-mcp" as configured in yusufdxb/gq-insight-mcp. Runs locally from the gq-insight-mcp Python package.

not rated 0 2mo ago A tokens not measured original MIT

evalmine

17

hishamalward/evalmine

MCP server Claude CodeCodexCursor +2

MCP server "evalmine" as configured in hishamalward/evalmine. Runs locally from the evalmine Python package.

not rated 0 8d ago A tokens not measured original MIT

posthog-context-mcp

18

josephruocco/posthog-mcp-mini

MCP server Claude CodeCodexCursor +2

MCP server "posthog-context-mcp" as configured in josephruocco/posthog-mcp-mini. Runs locally from the posthog-context-mcp Python package.

not rated 0 2mo ago A tokens not measured original MIT

mcp-research-server

19

RobackaB/novelty-research-mcp

MCP server Claude CodeCodexCursor +2

MCP server "mcp-research-server" as configured in RobackaB/novelty-research-mcp. Runs locally from the mcp-research-server Python package.

not rated 0 27d ago A tokens not measured original MIT

mcp-trustlayer

20

neelbarm/mcp-trustlayer

MCP server Claude CodeCodexCursor +2

MCP server "mcp-trustlayer" as configured in neelbarm/mcp-trustlayer. Runs locally from the mcp-trustlayer Python package.

not rated 0 1mo ago A tokens not measured original MIT

louislaurent1/kryve-agent-eval-mcp

MCP server Claude CodeCodexCursor +2

MCP server "kryve-agent-eval-mcp" as configured in louislaurent1/kryve-agent-eval-mcp. Runs locally from the kryve-agent-eval-mcp npm package.

not rated 0 2mo ago A tokens not measured original MIT

ai-ticket-triage

22

Mohemed-Amine-Chalhy/ai-ticket-triage

MCP server Claude CodeCodexCursor +2

MCP server "ai-ticket-triage" as configured in Mohemed-Amine-Chalhy/ai-ticket-triage. Runs locally from the ai-ticket-triage Python package.

not rated 0 1mo ago A tokens not measured original MIT

mcp-audit

23

archonics/mcp-audit

MCP server Claude CodeCodexCursor +2

Free context-engineering audits for AI agents. BYOK Anthropic key. Top-3 findings per scan. Runs locally from the @archonics/mcp-audit npm package. Needs 1 environment variable to run.

not rated 0 5mo ago A tokens not measured original MIT