Review a change in the EvalBench repo for (a) does it actually work — verified by running the tests and style checks, (b) does it follow EvalBench architecture — base-class contracts, config-key registration, PYTHONPATH-relative imports, sandbox isolation, concurrency safety, docs, (c) does it still build and deploy …
Write, edit, review, and validate AgentV EVAL.yaml / .eval.yaml evaluation files. Use when asked to create new eval files, update or fix existing ones, add or remove test cases, configure graders (llm-rubric, script), review whether an eval is correct or complete, convert between EVAL.yaml and evals.json using agentv…
Run Matt Shumer's Gauntlet Loop methodology to raise the quality of an artifact through cycles of building, independent critique, comparison against real references, and improvement. Use when the user asks for the Gauntlet Loop, a builder-critic process, adversarial critique, iterative refinement, or the creation of…
★not rated 2 1mo agoA95 tokens
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: