jfrog/agent-belt

Reproducible evaluation for AI coding agents. Multi-turn scenarios against Claude Code, Codex, Copilot, Cursor, Gemini CLI, Goose, OpenCode, or any custom agent you plug in; verify behavior with rule checks, workspace diffs, multi-judge LLM consensus; pin reliability with pass^k variance across trials. Git worktrees, optional Docker sandbox.

This repository also configures its own agents. See what agent-belt tells them →

19Stars on the repository
2Mods indexed here, across every type
22d agoLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

belt

01

jfrog/agent-belt

Skill Claude CodeCodex needs its repo

Operate the belt CLI to evaluate headless coding agents (Claude Code, Cursor, Codex, Gemini, and others) end to end. Use when the user asks to write or run eval scenarios, compare agents, score outputs with rules or LLM judges, register a new agent adapter, interpret reports or benchmark cards, or set up evals in CI.…

not rated 19 22d ago A SkillSpector: pass 116 tokens original Apache-2.0