diagnose-hard-problem

diagnose-hard-problem is a skill for Claude Code from sammcj/agentic-coding. It costs 37 tokens per session (2,101 once invoked), scanned A, a copy of diagnosing-bugs, Apache-2.0.

A step-by-step method for investigating difficult bugs and regressions, which are problems introduced by a change. It works by reproducing the problem, narrowing it down, testing explanations, fixing it, and adding a regression test.

In plain words
What is it for?
Diagnosing persistent bugs, isolating the smallest failing case, examining evidence, testing hypotheses, and verifying fixes with tests.
Why use it?
It replaces guesswork with a repeatable investigation loop and helps prevent the same failure from returning.

Skill for Claude Code

Written for Claude Code: disable-model-invocation in frontmatter.

Good fit Diagnosing persistent bugs, isolating the smallest failing case, examining evidence, testing hypotheses, and verifying fixes with tests.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/sammcj/agentic-coding/diagnose-hard-problem
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add sammcj/agentic-coding --skill diagnose-hard-problem
Clone the repo
git clone --depth 1 https://github.com/sammcj/agentic-coding

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for diagnose-hard-problem

README.md
[![agentmods](https://agentmods.dev/badge/skills/sammcj/agentic-coding/diagnose-hard-problem/github.svg)](https://agentmods.dev/skills/sammcj/agentic-coding/diagnose-hard-problem)
Your own site
<a href="https://agentmods.dev/skills/sammcj/agentic-coding/diagnose-hard-problem"><img src="https://agentmods.dev/badge/skills/sammcj/agentic-coding/diagnose-hard-problem/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for diagnose-hard-problem

Your own site · 80×15
<a href="https://agentmods.dev/skills/sammcj/agentic-coding/diagnose-hard-problem"><img src="https://agentmods.dev/badge/skills/sammcj/agentic-coding/diagnose-hard-problem.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 37 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,101 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. A grade says what 26 rules found in the file — not that it is safe.
Origin 83% copy Near-identical to another mod in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00037 $0.02101
Opus 5.5 $0.00015 $0.00840
Sonnet 5.5 $0.00007 $0.00420
Haiku 4.5 $0.00004 $0.00210

Measured 1mo ago against content hash 6f565736f83a, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

diagnose-hard-problem scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

The scan reads SKILL.md. This mod also ships 1 executable file (scripts/hitl-loop.template.sh), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

Phase 1 is done when you can name **one command** - a script path, a test invocation, a curl - that you have **already run at least once** (show the invocation and its output, redacted), and that is:
Origin

This is a copy

83% identical to diagnosing-bugs — 81 lines differ, which has more behind it and is treated as the original. This page carries a canonical link to it rather than competing with it.

Skills_disabled/diagnose-hard-problem/SKILL.md · 146 lines

How it starts

The opening of the file, as written. The whole thing — 146 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Diagnose

A discipline for hard bugs. Skip phases only when explicitly justified.

When exploring the codebase, use the project's domain glossary to get a clear mental model of the relevant modules, and check ADRs in the area you're touching.

Note: In addition to this skill, you may consider activating the systematic-debugging skill when diagnosing complex, persistent issues.

Redact

This skill has you show commands, outputs and captured artifacts. Redact every secret first - write <REDACTED> in its place. Build loops against env vars, so the credential stays in the environment rather than in what you show. Captured artifacts carry auth headers: quote only the lines that carry the signal.

If the redacted output is not enough to diagnose the bug, say so and ask the user.

Phase 1 - Build a feedback loop

This is the skill. Everything else is mechanical. If you have a fast, deterministic, agent-runnable pass/fail signal for the bug, you will find the cause - bisection, hypothesis-testing, and instrumentation all just consume that signal. If you don't have one, no amount of staring at code will save you.

Spend disproportionate effort here. Be aggressive. Be creative. Refuse to give up.

Ways to construct one - try them in roughly this order

  1. Failing test at whatever seam reaches the bug - unit, integration, e2e.
  2. Curl / HTTP script against a running dev server.
  3. CLI invocation with a fixture input, diffing stdout against a known-good snapshot.
  4. Headless browser script (Playwright / Puppeteer) - drives the UI, asserts on DOM/console/network.
  5. Replay a captured trace. Save a real network request / payload / event log to disk; replay it through the code path in isolation.
  6. Throwaway harness. Spin up a minimal subset of the system (one service, mocked deps) that exercises the bug code path with a single function call.
  7. Property / fuzz loop. If the bug is "sometimes wrong output", run 1000 random inputs and look for the failure mode.
  8. Bisection harness. If the bug appeared between two known states (commit, dataset, version), automate "boot at state X, check, repeat" so you can git bisect run it.
  9. Differential loop. Run the same input through old-version vs new-version (or two configs) and diff outputs.
  10. HITL bash script. Last resort. If a human must click, drive them with scripts/hitl-loop.template.sh so the loop is still structured. Captured output feeds back to you.

Read the full file on GitHub · 146 lines

Files

What ships with it

1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago First seen · 146 lines · 37 tokens per session scan A 6f565736f83a

Subscribe to this mod's changes

diagnose-hard-problem is a skill published in the GitHub repository sammcj/agentic-coding (165 stars, last pushed yesterday), licensed Apache-2.0. It adds 37 tokens to every session and 2,101 once invoked, about $0.0001 per session on Opus 5.5. A static security scan graded it A with 1 finding (makes network calls). It is 83% identical to diagnosing-bugs, differing in 81 lines, and is treated as a copy.

Related

Other skills, from other repositories

resolve-author-fix

Find the root cause, implement a focused fix, and prove behavior with targeted tests and recordings.

omnigent-ai/omnigent · 24 tokens

hatch3r-bug-fix

Step-by-step bug fix workflow. Diagnose root cause, implement minimal fix, write regression test. Use when fixing bugs, working on bug report issues, or when the user mentions a bug.

hatch3r/hatch3r · 47 tokens

ap-policies

Attach a completion policy gate (shell check or judge-agent rubric) to a session or fan-in group so turn-end only passes when the gate is green, then optionally auto-commit pending human ack. Use when the user says "gate this session on tests passing", "attach a policy", "commit only if tests are green", "judge…

agentproto/ts · 83 tokens

systematic-debugging

Structured root-cause debugging loop — reproduce, isolate, form a hypothesis, verify the fix. Use whenever a bug, crash, test failure, or unexpected behavior is reported.

metaspartan/cybara · 40 tokens

pn-systematic-debugging

Root cause analysis with triage mode — Phase 0 feedback loop, investigate first, one question max, then isolate, hypothesize, confirm. Outputs TDD fix plan with RED-GREEN cycles; optional GitHub issue via GitHub MCP. Use when debugging a failure or bug.

perniemann/pnCore · 63 tokens

pn-discipline-philosophy

Defines engineering discipline: test-first, root-cause before fix, minimal change, measure-before-optimize, review/second look, evidence over guess. Use when implementing features, debugging, planning, or establishing development practices. Aligns with TDD, systematic debugging, and RCA practices (current).

perniemann/pnCore · 66 tokens