A local service that runs coding patches in sandboxes, records each run, and maintains a leaderboard. It can also act as a CI gate, meaning failed checks can stop a software build.

Use it to test autonomous coding-agent patches in isolation, trace their runs, rank results, and fail CI when a regression is detected.

It provides a repeatable way to inspect agent-written changes and catch regressions, which are new failures caused by a change.

forgejudge — MCP server for Claude Code and Codex by ahmedEid1

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Clone the repo

git clone --depth 1 https://github.com/ahmedEid1/forgejudge

Made for: Claude Code, Codex, Cursor, Gemini CLI, OpenCode.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

README.md

[![agentmods](https://agentmods.dev/badge/mcp/ahmedeid1/forgejudge/mcp-forgejudge/github.svg)](https://agentmods.dev/mcp/ahmedeid1/forgejudge/mcp-forgejudge)

Your own site

<a href="https://agentmods.dev/mcp/ahmedeid1/forgejudge/mcp-forgejudge"><img src="https://agentmods.dev/badge/mcp/ahmedeid1/forgejudge/mcp-forgejudge/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

Your own site · 80×15

<a href="https://agentmods.dev/mcp/ahmedeid1/forgejudge/mcp-forgejudge"><img src="https://agentmods.dev/badge/mcp/ahmedeid1/forgejudge/mcp-forgejudge.svg" alt="Reviewed on agentmods" width="80" height="20"></a>

Per session not measured What this adds to a session before it is invoked.

When invoked not measured Not applicable: nothing here is loaded into a session.

Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.

Origin original No closer match found in the catalogue.

Security

Grade A, and why

forgejudge scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 11d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

forgejudge/mcp/server.json · 13 lines

What it actually says

{
  "forgejudge": {
    "command": "uvx",
    "args": [
      "forgejudge",
      "forgejudge[mcp]==0.1.0",
      "python",
      "-m",
      "forgejudge.mcp.server"
    ],
    "env": {}
  }
}

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

11d ago First seen · 13 lines scan A 69f853fd7ad1

Subscribe to this mod's changes

forgejudge is an MCP server published in the GitHub repository ahmedEid1/forgejudge (0 stars, last pushed 21d ago), licensed MIT. Its token cost is not measured: an MCP server costs its tool schemas, not its config file. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Autonomous Agents Evaluation Testing ai-agents ci langfuse leaderboard

playwright

MCP server "playwright" as configured in langwatch/langwatch. Launched with bash -c d=$PWD; while [ "$d" != / ] && [ ! -f "$d/dev/scripts/playwright-mcp.sh".

langwatch/langwatch · not measured

codebase-memory-mcp

MCP server "codebase-memory-mcp" as configured in suyoumo/ClawProBench. Launched with codebase-memory-mcp.

suyoumo/ClawProBench · not measured

CodSpeed

MCP server "CodSpeed", hosted remotely at mcp.codspeed.io, as configured in CodSpeedHQ/codspeed.

CodSpeedHQ/codspeed · not measured

evalview

MCP server "evalview" as configured in hidai25/eval-view. Launched with evalview mcp serve. Needs 2 environment variables to run.

hidai25/eval-view · not measured

evalview-mcp

Open-source testing and regression detection framework for AI agents. Golden baseline diffing, CI/CD integration, works with LangGraph, CrewAI, OpenAI, Anthropic Claude, HuggingFace, Ollama, and MCP. Runs locally from the evalview Python package. Needs 1 environment variable to run.