agentmods.dev

eval MCP servers

4 tagged eval, measured the same way as everything else here.

Browse within: LLM 5

Sort RelevanceRecently updatedFewest tokensSecurity gradeRepo starsStars this weekTop rated 4 mods

memtrust

01

RudrenduPaul/memtrust

MCP server Claude CodeCodexCursor +2

Independent, reproducible benchmark harness for agent-memory backends (MemPalace, Mem0, Zep/Graphiti, OpenViking): runs LongMemEval, LoCoMo, contradiction-detection, and a dozen other evals against all four and publishes the raw logs, not vendor-curated numbers. Runs locally from the memtrust-cli Python package.

not rated 2 1mo ago A tokens not measured original Apache-2.0

invarianteval

02

AlpharomeroJL/invarianteval

MCP server Claude CodeCodexCursor +2

MCP server "invarianteval" as configured in AlpharomeroJL/invarianteval. Runs locally from the invarianteval Python package.

not rated 1 4mo ago A tokens not measured original MIT

truthroute

03

RudrenduPaul/TruthRoute

MCP server Claude CodeCodexCursor +2

Sends the same prompt to multiple LLM providers in parallel and returns a divergence score via MCP. Runs locally from the truthroute-cli npm package.

not rated 0 yesterday A tokens not measured original MIT

kaigo-gap

04

ossudesu-lab/kaigo_mcp

MCP server Claude CodeCodexCursor +2

MCP server "kaigo-gap" as configured in ossudesu-lab/kaigomcp. Runs kaigo_mcp with python.

not rated 0 19d ago A tokens not measured