grader

An evaluator that checks whether expected results match an execution transcript and its outputs. An execution transcript is the recorded sequence of actions and responses from an agent.

In plain words
What is it for?
It is for grading coding-agent runs against stated expectations.
Why use it?
It helps identify whether an agent completed the expected work and produced the required results.

Agent

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add agents/firstsun-dev/skills/grader
Clone the repo
git clone --depth 1 https://github.com/firstsun-dev/skills
Per session 0 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 2,069 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin unknown No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00000 $0.02069
Opus 5 $0.00000 $0.01035
Sonnet 5 $0.00000 $0.00414
Haiku 4.5 $0.00000 $0.00207

Measured yesterday against content hash 57134da0c1a4, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

grader scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured yesterday.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

external/basic/skill-creator/agents/grader.md · 224 lines

The source is not reproduced here

No licence file

A repository with no LICENSE is all rights reserved by default, so the body is not copied here. The metadata, the measurements and the link are.

Read it on GitHub

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. yesterday First seen · 224 lines · 0 tokens per session scan A 57134da0c1a4

Subscribe to this mod's changes

grader is an agent published in the GitHub repository firstsun-dev/skills (1 stars, last pushed yesterday), with no licence file. It costs nothing until one of its globs matches a file; then it loads 2,069 tokens. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other agents, from other repositories

skill-creator_analyzer

分析盲测结果,识别获胜原因并生成技能改进建议。通过对比获胜者和失败者的技能说明、执行记录(transcripts),提取可落地的改进点。.

cafe3310/public-agent-skills · 53 tokens

skill-creator_comparator

在不了解技能背景的情况下,盲测对比两个输出结果。根据任务要求、正确性、完整性和结构化程度,客观判定哪个输出更优,并提供详细评分。.

cafe3310/public-agent-skills · 50 tokens

analyzer

Analyze blind comparison results to understand WHY the winner won and generate improvement suggestions.

CherryHQ/cherry-studio · 0 tokens

im-local-db_knowledge-extractor

Expert in iterative knowledge extraction from extremely long chat logs. It processes contexts.md in chunks (approx. 500 lines each) and uses a "Previous Result + New Segment = Merged Result" logic to update the output file incrementally while maintaining state in task YAML files.

cafe3310/public-agent-skills · 63 tokens

slash-command-auditor

Expert slash command auditor for Claude Code slash commands. Use when auditing, reviewing, or evaluating slash command .md files for best practices compliance. MUST BE USED when user asks to audit a slash command.

glittercowboy/taches-cc-resources · 46 tokens

subagent-auditor

Expert subagent auditor for Claude Code subagents. Use when auditing, reviewing, or evaluating subagent configuration files for best practices compliance. MUST BE USED when user asks to audit a subagent.

glittercowboy/taches-cc-resources · 45 tokens