analyzer
01Agent
An analysis helper for studying evaluation results from agent-skill tests and finding patterns across many queries and candidates.
2 2mo ago A 0 tokens
original MIT
2Stars on the repository
4Mods indexed here, across every type
2mo agoLast push, which is what freshness is scored on
MITLicence, which decides whether bodies are shown
comparator
02Agent
A judging agent that compares two anonymous descriptions using their test results. TPR measures how often the right cases are detected, while FPR measures how often wrong cases are flagged.
2 2mo ago A 0 tokens
original MIT
grader
03Agent
A judging agent for comparing candidate descriptions using held-out trigger tests. It selects the candidate with the best test accuracy, using a lower false-positive rate to break ties.
2 2mo ago A 0 tokens
original MIT