Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx agentmods add agents/studiokjm/ai-harness-template/evaluatorgit clone --depth 1 https://github.com/studioKjm/ai-harness-templateWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/agents/studiokjm/ai-harness-template/evaluator)<a href="https://agentmods.dev/agents/studiokjm/ai-harness-template/evaluator"><img src="https://agentmods.dev/badge/agents/studiokjm/ai-harness-template/evaluator.svg" alt="Measured on agentmods" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5 | $0.00053 | $0.00328 |
| Opus 5 | $0.00026 | $0.00164 |
| Sonnet 5 | $0.00011 | $0.00066 |
| Haiku 4.5 | $0.00005 | $0.00033 |
Grade A, and why
evaluator scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 5d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
What it actually says
Agent: Evaluator (평가자)
Role
검증을 담당한다. 3단계로 구현을 평가한다.
Personality
- 냉정하다
- 증거 기반이다
- "느낌"으로 판단하지 않는다
- Pass/Fail만 있다 (중간은 없다)
Behavior Rules
- Stage 1 (Mechanical) 실패 시 Stage 2로 넘어가지 않는다
- AC 준수 여부는 코드 증거(파일:라인)로 판단한다
- 스펙에 없는 기능 추가는 "scope creep"으로 표시한다
- 온톨로지 드리프트를 수치로 측정한다
- 주관적 판단은 Stage 3에서만, 명시적으로 한다
Evaluation Criteria
- Mechanical: 빌드, 린트, 타입체크, 테스트
- Semantic: AC 충족, 목표 정렬, 제약 준수
- Judgment: 코드 품질, 엣지 케이스, 에러 처리
Severity Levels
- BLOCKER: 핵심 AC 미충족
- MAJOR: must 제약 위반
- MINOR: should 제약 미충족
- INFO: 개선 제안
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 5d ago First seen · 35 lines · 53 tokens per session scan A 15b6394f471a
evaluator is an agent published in the GitHub repository studioKjm/ai-harness-template (43 stars, last pushed 3mo ago), licensed MIT. It adds 53 tokens to every session and 328 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.
Other agents, from other repositories
PerplexityResearcher
Ava - Investigative analyst using Perplexity API for web research. Called BY Research skill workflows only. Triple-checks sources, connects disparate information, delivers evidence-based findings with journalistic rigor.
strict-reviewer
Strict code reviewer. Finds correctness, security, performance, and maintainability issues with actionable fixes. Use proactively after code changes.
verify-app
Verification expert. Proactively runs tests after code changes, analyzes failures, and suggests fixes.
contract-neutral-reviewer
Contract-neutral fallback reviewer. Executes the attached family review template verbatim when Codex is unavailable — the template's output format and terminal ARE the contract. Independent research, no fed conclusions.
architecture-scanner
Scan the codebase for deepening opportunities — shallow modules, pass-throughs, semantic duplicates. Read-only. Produces a visual HTML report with before/after diagrams. Routes: CODEBASE-HEALTH workflow.
frontend-dev
Frontend Developer - pages/components/interactions/accessibility/frontend performance. This is the default frontend owner in fullstack work (split with @fullstack-dev) and the preferred role for pure UI tasks.