orchestrate-test-fix

orchestrate-test-fix is a skill for Claude Code, Codex from NITISH-R-G/hackerrank-orchestrate-skills. It costs 83 tokens per session (930 once invoked), scanned A, original, MIT.

A guided testing and repair process for an AI-powered data pipeline. It checks unusual inputs, repeated runs, alternative strategies, and one input's path through each processing stage before fixing errors.

In plain words
What is it for?
Use it to test edge cases, detect overfitting, verify repeatable output, compare prompt or configuration choices, trace inputs, and fix the pipeline one change at a time.
Why use it?
It helps find fragile rules, inconsistent results, and incorrect output rows instead of relying only on a sample that happens to work. It also checks that fixes do not create new problems.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it to test edge cases, detect overfitting, verify repeatable output, compare prompt or configuration choices, trace inputs, and fix the pipeline one change at a time.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/nitish-r-g/hackerrank-orchestrate-skills/orchestrate-test-fix
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add NITISH-R-G/hackerrank-orchestrate-skills --skill orchestrate-test-fix
Clone the repo
git clone --depth 1 https://github.com/NITISH-R-G/hackerrank-orchestrate-skills

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for orchestrate-test-fix

README.md
[![agentmods](https://agentmods.dev/badge/skills/nitish-r-g/hackerrank-orchestrate-skills/orchestrate-test-fix/github.svg)](https://agentmods.dev/skills/nitish-r-g/hackerrank-orchestrate-skills/orchestrate-test-fix)
Your own site
<a href="https://agentmods.dev/skills/nitish-r-g/hackerrank-orchestrate-skills/orchestrate-test-fix"><img src="https://agentmods.dev/badge/skills/nitish-r-g/hackerrank-orchestrate-skills/orchestrate-test-fix/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for orchestrate-test-fix

Your own site · 80×15
<a href="https://agentmods.dev/skills/nitish-r-g/hackerrank-orchestrate-skills/orchestrate-test-fix"><img src="https://agentmods.dev/badge/skills/nitish-r-g/hackerrank-orchestrate-skills/orchestrate-test-fix.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 83 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 930 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00083 $0.00930
Opus 5.5 $0.00033 $0.00372
Sonnet 5.5 $0.00017 $0.00186
Haiku 4.5 $0.00008 $0.00093

Measured yesterday against content hash 1d2761364a15, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

orchestrate-test-fix scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured yesterday.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/orchestrate-test-fix/SKILL.md · 58 lines

How it starts

The opening of the file, as written. The whole thing — 58 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Test and Fix

Scored by: output CSV (30%), where accuracy is scored per ticket 0-100 against a hidden golden set, plus a whole-file safety score. A correct action with an empty, generic, or self-contradicting justification is capped near 70. Justifications are part of the score.

Part A - Test (phase 3)

  1. Edge cases. Build a set: empty row, missing field, duplicate ID, prompt injection, near-identical tickets that must be treated alike, out-of-scope request, another language. Read references/edge-case-testing.md.
  2. Overfitting audit. Look for rules that depend on ID format, timestamp format, row order, or exact sample wording. Fix them first. Read references/dataset-coupling-auditor.md.
  3. Determinism. Run twice on identical input. Outputs must match. If not, find the exact difference. Read references/determinism-auditor.md.
  4. Two strategies. Compare at least two prompt or config variants on the sample. Write why you chose one. This is graded. Read references/multi-strategy-evaluation.md.
  5. Trace one input through every stage: read, clean, context, model call, parse, validate, write. Confirm each does what you assume. Read references/input-tracing.md.

Output of Part A: a test log with input, expected, actual, and the failing stage. Each wrong row is tagged RULE (code problem) or MISREAD (model perceived it wrong).

Part B - Fix (phase 4)

For each wrong row, one at a time:

  1. Trace it to the stage that failed.
  2. Classify: RULE is fixed in code and is free to re-test. MISREAD is fixed in the prompt or evidence and costs a model run, so batch those.
  3. Write the change record: CHANGE, the requirement it serves, the rows it should fix, the rows it could break, cost, verdict.
  4. Re-run and diff the entire output.
  5. Verdict: SHIP only if the target fixes and nothing previously correct breaks. Otherwise REVERT.

Specific fixes:

  • Justification weak, label right: references/justification-quality.md. Name the evidence used, what triggered the path, and uncertainty in plain words.
  • Image or document misread: references/multimodal-evidence-grounding.md.
  • Escalation rate off: references/confidence-calibrator.md. Gate on booleans and enums only.
  • Cause unknown: diagnose with the diagnosing-bugs skill before changing anything.

Read the full file on GitHub · 58 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. yesterday First seen · 58 lines · 83 tokens per session scan A 1d2761364a15

Subscribe to this mod's changes

orchestrate-test-fix is a skill published in the GitHub repository NITISH-R-G/hackerrank-orchestrate-skills (8 stars, last pushed 2d ago), licensed MIT. It adds 83 tokens to every session and 930 once invoked, about $0.0003 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-10-24.

Related

Other skills, from other repositories

repair-prevention-assessment

A completion gate for fixes and self-repair work. It creates a machine-checkable assessment that separates evidence a current issue is closed from evidence that the fix will remain effective.

devcodex-labs/devcodex · 75 tokens

test-failure-explorer

Import and query an existing Vitest 3.2 JSON report to explore test failures, file-level errors and original diagnostic evidence.

QwenLM/qwen-code · 32 tokens

impact-trace

For a change point (function / type / endpoint / SQL column), enumerate its real blast radius across six dimensions with a grep citation per row, then derive the regression test scope. Every impact-table row must trace to a real search hit — never a self-asserted claim.

Prismer-AI/PrismerCloud · 60 tokens

debugging-livekit-agents

Drives a multi-turn conversation with a LiveKit agent running locally to see what it does. Use when the user says "test my agent", "try my agent", "does this work", "why did it call that tool", "it says the wrong thing when I ask X", "test this change", or whenever you have edited an agent and need to check how it…

fcakyon/claude-codex-settings · 173 tokens

oma-debug

Diagnose a reproducible failure, fix its cause, and verify the regression. Use for crashes, incorrect behavior, and failing tests.

first-fluke/oh-my-agent · 30 tokens

webapp-qa

Perform scoped exploratory QA of a web application, reproduce defects, collect screenshots and console evidence, and deliver a prioritized report.

Prismer-AI/PrismerCloud · 29 tokens