A checking system for a job-search software pipeline: a set of scripts that reviews its code, checks its results after a run, and monitors its ongoing health.

Use it after changing pipeline code, after a pipeline run, or regularly to monitor the pipeline. It covers the career-manager/job-search scripts, data, and caches.

It helps catch coding problems, incorrect pipeline results, and declining reliability before they cause bigger issues.

evals — Skill for Claude Code and Codex by muggl3mind/career-manager

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent

npx skills add muggl3mind/career-manager --skill evals

Clone the repo

git clone --depth 1 https://github.com/muggl3mind/career-manager

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

README.md

[![agentmods](https://agentmods.dev/badge/skills/muggl3mind/career-manager/evals/github.svg)](https://agentmods.dev/skills/muggl3mind/career-manager/evals)

Your own site

<a href="https://agentmods.dev/skills/muggl3mind/career-manager/evals"><img src="https://agentmods.dev/badge/skills/muggl3mind/career-manager/evals/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

Your own site · 80×15

<a href="https://agentmods.dev/skills/muggl3mind/career-manager/evals"><img src="https://agentmods.dev/badge/skills/muggl3mind/career-manager/evals.svg" alt="Reviewed on agentmods" width="80" height="20"></a>

Per session 43 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.

When invoked 433 The whole file, excluding the scripts and references it only reads on demand.

Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.

Origin original No closer match found in the catalogue.

Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

Model	Per session	Once invoked
Fable 5.1	$0.00043	$0.00433
Opus 5.5	$0.00017	$0.00173
Sonnet 5.5	$0.00009	$0.00087
Haiku 4.5	$0.00004	$0.00043

Measured 28d ago against content hash 512ecc0f9063, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

evals scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 28d ago.

The scan reads SKILL.md. This mod also ships 45 executable files (scripts/code_review.py, scripts/health_monitor.py, scripts/runtime_verify.py, …), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

evals/SKILL.md · 52 lines

What it actually says

Evals

Independent evaluation suite for the job-search pipeline. Lives outside the pipeline it evaluates.

Evaluation Levels

Level	Script	When to Run
0. Test Suite	`evals/tests/` (pytest)	After any code change
1. Code Review	`evals/scripts/code_review.py`	After building or changing pipeline code
2. Runtime Verify	`evals/scripts/runtime_verify.py`	After a pipeline run completes
3. Health Monitor	`evals/scripts/health_monitor.py`	Recurring — every pipeline run or 2-3x/week

Process

Run the relevant eval script for your situation
Review the report output
Fix issues (or flag for user approval if touching shared data)
Re-run the eval to verify fixes

Usage

# Level 0: Full test suite
uv run python3 -m pytest evals/tests/ -v

# Level 1: Static code review of job-search pipeline
uv run evals/scripts/code_review.py

# Level 2: Validate outputs after a pipeline run
uv run evals/scripts/runtime_verify.py

# Level 3: Ongoing health monitoring
uv run evals/scripts/health_monitor.py
uv run evals/scripts/health_monitor.py --json

Scope

Evaluates: job-search/ (scripts, data, caches)
Does NOT evaluate: itself, other career-manager skills, or non-pipeline code
Also owns: the pytest suite in evals/tests/ and evals/schemas/eval-results.schema.json

Output Format

Each script prints a check-by-check report with pass/warn/fail status and returns non-zero exit code if critical checks fail.

Files

What ships with it

47 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

28d ago Changed · +4 lines 512ecc0f9063
1mo ago First seen · 48 lines · 43 tokens per session scan A 9caed4946f35

Subscribe to this mod's changes

evals is a skill published in the GitHub repository muggl3mind/career-manager (24 stars, last pushed 27d ago), licensed MIT. It adds 43 tokens to every session and 433 once invoked, about $0.0002 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Claude Code Code review Testing agent-skills job-search resume

adk-go-self-review

Review an ADK Go change the way a maintainer will — a fresh-context pass over the whole diff, five lenses (correctness and tests, scope, simplicity, style, adk-python parity), and the mutation check that proves your tests pin the change. Use before opening a PR, before any later push that changes code, and when asked…

google/adk-go · 87 tokens

adversarial-reviewer

Stress-test a code change for concrete correctness defects, unsafe assumptions, and failure modes. Use when the user explicitly asks for an adversarial review, a deep bug hunt, or to tear a change apart, or to check your own change before submitting it. Do not use for ordinary review, style feedback, or general…

emdash-cms/emdash · 72 tokens

go-testing

Trigger: Go tests, go test coverage, Bubbletea teatest, golden files. Apply focused Go testing patterns.

Gentleman-Programming/gentle-ai · 26 tokens

brooks-sweep

Full-sweep mode: runs a unified analysis across all quality dimensions — code decay, architecture, tech debt, and test quality — then applies fixes directly to the codebase. Safe changes are auto-applied; risky changes are confirmed before execution. Drawing on twelve classic engineering books. Triggers when: user…

hyhmrright/brooks-lint · 178 tokens

plugin-review

Review plugin quality with tiered checks and dependency scoping. Use for PR and pre-release audits.

athola/claude-night-market · 23 tokens

audit-ci

Run and analyze Elements cold CI performance profiles and propose evidence-backed build, test, lint, and dependency-graph improvements. Use whenever asked to profile or benchmark pnpm run ci, rerun ci:profile, create a CI performance audit, compare CI timings, find bottlenecks or the completion path, investigate a CI…

NVIDIA/elements · 78 tokens