agentmods.dev

run-iteration-eval

run-iteration-eval is a skill for Claude Code from hyhmrright/logic-lens. It costs 108 tokens per session (759 once invoked), scanned A, original, MIT.

A procedure for running one iteration of the Logic-Lens content-evaluation pipeline and producing a scored summary file.

In plain words
What is it for?
Use it to run smoke tests or selected cases, grade outputs, and save results under a named iteration directory.
Why use it?
It ensures the evaluation uses the current cached skill and avoids spending new model calls just to re-score existing results.

Skill for Claude Code

Written for Claude Code: disable-model-invocation in frontmatter. Also seen: reads .claude/ paths; positional $N argument.

Needs its repository: it runs a file that does not travel with it, so clone the repository first. The line is bash .claude/skills/sync-skill-cache/scripts/sync-cache.sh.

Part of the logic-lens plugin — 11 skills, 6 commands, 3 agents, 2 hooks shipped together

not rated 22repo 11d ago A scan SkillSpector: pass 108 tokens original MIT

Good fit Use it to run smoke tests or selected cases, grade outputs, and save results under a named iteration directory.

Compare 6 skills from other repositories ↓
View source ↗ hyhmrright/logic-lens
Install

Getting it into your agent

It runs from inside its repository, so the clone comes first — what it calls does not travel with the file alone.

Clone the repo
git clone --depth 1 https://github.com/hyhmrright/logic-lens
agentmods
npx agentmods add skills/hyhmrright/logic-lens/run-iteration-eval

Made for: Claude Code.

Or install logic-lens, the plugin that ships this one along with the rest of its 11 skills, 6 commands, 3 agents, 2 hooks.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for run-iteration-eval

README.md
[![agentmods](https://agentmods.dev/badge/skills/hyhmrright/logic-lens/run-iteration-eval/github.svg)](https://agentmods.dev/skills/hyhmrright/logic-lens/run-iteration-eval)
Your own site
<a href="https://agentmods.dev/skills/hyhmrright/logic-lens/run-iteration-eval"><img src="https://agentmods.dev/badge/skills/hyhmrright/logic-lens/run-iteration-eval/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for run-iteration-eval

Your own site · 80×15
<a href="https://agentmods.dev/skills/hyhmrright/logic-lens/run-iteration-eval"><img src="https://agentmods.dev/badge/skills/hyhmrright/logic-lens/run-iteration-eval.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 108 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 759 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector pass 7 Sept 2026
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00108 $0.00759
Opus 5 $0.00054 $0.00380
Sonnet 5 $0.00022 $0.00152
Haiku 4.5 $0.00011 $0.00076

Measured 10d ago against content hash 0755688051d7, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-09, from the pricing page.

Security

Grade A, and why

run-iteration-eval scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 10d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.claude/skills/run-iteration-eval/SKILL.md · 56 lines

How it starts

The opening of the file, as written. The whole thing — 56 lines — stays where its author put it; the contents beside it link to each section on GitHub.

run-iteration-eval

Measures a skill change by running the content cases in evals/content/v2/evals-v2.json through claude -p and grading the outputs. Outputs land in skills-workspace/iteration-<TAG>/.

The runner and grader are split on purpose: running calls Claude and costs tokens; grading is pure regex Python and is free to re-run on outputs that already exist. Never re-run the runner just to re-score — re-grade instead.

Steps

  1. Sync the cache first — non-negotiable. The runner loads the skill from the plugin cache, not skills/. Run the sync-skill-cache skill (or its script directly). If you skip this, the eval grades the previously-published skill and the entire run is wasted:

    bash .claude/skills/sync-skill-cache/scripts/sync-cache.sh

  2. Pick a scope. Full runs cost real tokens; scope down while iterating:

    SMOKE=1 bash scripts/run-content-evals.sh              # one case per mode (~$0.10) — fast sanity
CASES="200 201 202" bash scripts/run-content-evals.sh  # only the cases a diagnosis flagged
TAG=myfix bash scripts/run-content-evals.sh            # full run, named tag
bash scripts/run-content-evals.sh                      # full run, tag = git short SHA

    The runner is idempotent — a case with an existing output.md is skipped. Delete the eval-<id>/ dir to force a re-run of that case.

  3. Read summary.json in the iteration dir. It carries overall pass rate plus the per-mode and per-subscore (logic vs format) breakdown. The logic subscore reflects reasoning quality; format reflects Output-Skeleton compliance and is the historical bottleneck with high single-run variance. Judge a change on the right subscore — a format wobble is not a reasoning regression.

  4. Re-grade without re-running (free) after editing the grader or to recompute on existing outputs:

    python3 scripts/grade-iteration.py skills-workspace/iteration-<TAG>

Read the full file on GitHub · 56 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 10d ago First seen · 56 lines · 108 tokens per session scan A 0755688051d7

Subscribe to this mod's changes

run-iteration-eval is a skill published in the GitHub repository hyhmrright/logic-lens (22 stars, last pushed 11d ago), licensed MIT. It adds 108 tokens to every session and 759 once invoked, about $0.0005 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Testingai-code-reviewbug detectionclaude-code-plugincode-qualitygemini-cli-extension
Related

Other skills, from other repositories

integration-e2e-testing

Integration and E2E test design principles, ROI calculation, test skeleton specification, and review criteria. Use when designing integration tests, E2E tests, or reviewing test quality.

shinpr/claude-code-workflows · 42 tokens

brooks-health

Combined codebase health dashboard that scores a project across all four quality dimensions — PR quality, architecture, tech debt, and test quality — in a single pass, drawing on twelve classic engineering books. Triggers when: user wants an overall quality assessment, asks "how healthy is this codebase?", "run all…

hyhmrright/brooks-lint · 156 tokens

brooks-sweep

Full-sweep mode: runs a unified analysis across all quality dimensions — code decay, architecture, tech debt, and test quality — then applies fixes directly to the codebase. Safe changes are auto-applied; risky changes are confirmed before execution. Drawing on twelve classic engineering books. Triggers when: user…

hyhmrright/brooks-lint · 178 tokens

brooks-test

Test quality review drawing on twelve classic engineering books — with primary focus on xUnit Test Patterns, The Art of Unit Testing, How Google Tests Software, and Working Effectively with Legacy Code — that diagnoses structural problems in an existing test suite: brittleness, mock abuse, coverage illusions, slow…

hyhmrright/brooks-lint · 161 tokens

recipe-add-integration-tests

Add integration/E2E tests to existing codebase using Design Docs.

shinpr/claude-code-workflows · 19 tokens

testing-principles

Language-agnostic testing principles including TDD, test quality, coverage standards, and test design patterns. Use when writing tests, designing test strategies, or reviewing test quality.

shinpr/claude-code-workflows · 40 tokens