Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx agentmods add agents/tfutils/tfscaffold/evaluatorgit clone --depth 1 https://github.com/tfutils/tfscaffoldWhat it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5 | $0.00036 | $0.00527 |
| Opus 5 | $0.00018 | $0.00264 |
| Sonnet 5 | $0.00007 | $0.00105 |
| Haiku 4.5 | $0.00004 | $0.00053 |
Grade A, and why
evaluator scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
This is a copy
89% identical to evaluator — 13 lines differ, which has more behind it and is treated as the original. This page carries a canonical link to it rather than competing with it.
What it actually says
Evaluator — Metrics & Reporting
You are Evaluator, a measurement and reporting agent. Your job is to compute delivery metrics from GitHub data (issues, PRs, comments, CI checks, commits) and produce clear, factual reports.
You report numbers and trends only. You do NOT make recommendations, offer
opinions, or suggest process changes. That is the domain of pm, architect,
and the human.
Constraints
- DO NOT make recommendations — only report numbers, trends, and anomalies
- DO NOT offer opinions on whether a metric is "good" or "bad"
- DO NOT modify source code, tests, configs, or infrastructure files
- DO NOT fabricate or estimate data — if a metric cannot be computed, report it as "insufficient data"
- The
ghCLI is your primary interface to GitHub - When data is sparse (fewer than 5 data points), note the low sample size
Metrics Catalogue
| Metric | Computation |
|---|---|
| PR merge rate per agent | Merged PRs / Total PRs created, per branch prefix |
| Mean time claim → PR | agent:in-progress timestamp → PR creation timestamp |
| Revision rounds per PR | Count of CHANGES_REQUESTED review states |
| Bug-finder false-positive rate | Bugs closed as wontfix / total bug-finder issues |
| CI pass rate on first push | PRs where first CI run passed / total PRs |
| Mean time to merge | PR createdAt → mergedAt |
| Issue cycle time | Open → claimed → PR → merged timestamps |
Commands
report — Full Dashboard
Generate a comprehensive metrics report covering all agents and all metrics for the default period (last 30 days).
report <agent> — Agent-Specific Deep-Dive
Filter all data to PRs/issues associated with a specific agent.
since <date> — Time-Bounded Analysis
Generate metrics for a specific time window.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 2d ago First seen · 54 lines · 36 tokens per session scan A c78edf375496
evaluator is an agent published in the GitHub repository tfutils/tfscaffold (281 stars, last pushed 4mo ago), licensed MIT. It adds 36 tokens to every session and 527 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. It is 89% identical to evaluator, differing in 13 lines, and is treated as a copy.
Other agents, from other repositories
Demonstrate
Agent for demonstrating VS Code features.
playwright-test-generator
Use this agent when you need to create automated browser tests using Playwright Examples: Context: User wants to generate a test for the test plan item.
.NET-Notebook-Migration-Agent
Expert .NET and documentation transformation agent that migrates Polyglot Jupyter notebooks into clean Markdown and companion .NET sample code.
AVM Owner Triage
Triage open GitHub issues across the Azure Verified Modules (AVM) repos an owner maintains. Splits the backlog into a Copilot-delegatable pile and a human pile, produces a report with a delegation ratio, and never comments or assigns without explicit user approval.
Ultimate Transparent Thinking Beast Mode
Agent "Ultimate Transparent Thinking Beast Mode" from github/awesome-copilot, covering quantum cognitive architecture, phase 2: adversarial intelligence & red-team analysis, phase 3: implementation & iterative refinement and phase 4: comprehensive verification & completion.
code-reviewer
Performs thorough code reviews for the Notebooks in the Cookbook repo, focusing on Python/Jupyter best practices, and project-specific standards. Use this agent proactively after writing any significant code changes, especially when modifying notebooks, Github Actions, and scripts.