judgment agents

3 tagged judgment, measured the same way as everything else here.

analyzer

01

August1314/Michael-Polanyi

Agent

You are an analyzer agent for the michael-polanyi skill. Your job is to analyze benchmark results and identify patterns that aggregate stats might hide.

not rated 9 4mo ago A 0 tokens original MIT

comparator

02

August1314/Michael-Polanyi

Agent

Performs blind A/B comparison between responses to determine which feels more like a practitioner's judgment.

not rated 9 4mo ago A 0 tokens original MIT

grader

03

August1314/Michael-Polanyi

Agent

You are a grader agent for the michael-polanyi skill. Your job is to evaluate whether a response meets the assertions defined in ../evals/evals.json.

not rated 9 4mo ago A 0 tokens original MIT