CORAL: Skill for Claude Code

.claude/skills/coral-new-task/SKILL.md

coral-new-task is a skill for Claude Code from Human-Agent-Society/CORAL. It costs 138 tokens per session (3,292 once invoked), scanned A, original, Apache-2.0.

A recipe for creating a CORAL evaluation task, where an agent's work is tested by a separate grader. Each task includes configuration, starter code, and a packaged Python grader.

In plain words
What is it for?
Use it to add tasks under the examples directory, write their graders, include hidden data, and run CORAL validation and smoke tests.
Why use it?
It helps keep the task setup, files, grader, hidden answers, and validation steps aligned so the evaluation runs correctly.

Skill for Claude Code

Written for Claude Code: installed under .claude/. Also seen: mentions Codex; mentions OpenCode.

This is Human-Agent-Society/CORAL's own configuration. It tells Claude Code how to work on CORAL itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything CORAL configures →

Reuse

Borrowing it

Nothing to install: this file belongs to Human-Agent-Society/CORAL. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/Human-Agent-Society/CORAL/main/.claude/skills/coral-new-task/SKILL.md
Clone the repo
git clone --depth 1 https://github.com/Human-Agent-Society/CORAL

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for coral-new-task

README.md
[![agentmods](https://agentmods.dev/badge/skills/human-agent-society/coral/coral-new-task/github.svg)](https://agentmods.dev/skills/human-agent-society/coral/coral-new-task)
Your own site
<a href="https://agentmods.dev/skills/human-agent-society/coral/coral-new-task"><img src="https://agentmods.dev/badge/skills/human-agent-society/coral/coral-new-task/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for coral-new-task

Your own site · 80×15
<a href="https://agentmods.dev/skills/human-agent-society/coral/coral-new-task"><img src="https://agentmods.dev/badge/skills/human-agent-society/coral/coral-new-task.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 138 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 3,292 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector warn 7 Sept 2026
SkillSpector: 1 finding, up to medium

These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →

  • medium Prompt Injection · line 117
    Subtle instructions detected that may alter agent decision-making or introduce hidden biases.
    Fix: Review content for implicit steering or bias. Ensure instructions are explicit and align with the skill's stated purpose.
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00138 $0.03292
Opus 5 $0.00069 $0.01646
Sonnet 5 $0.00028 $0.00658
Haiku 4.5 $0.00014 $0.00329

Measured 12d ago against content hash 8f586badcd29, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-11, from the pricing page.

Security

Grade A, and why

coral-new-task scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 12d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.claude/skills/coral-new-task/SKILL.md · 234 lines

How it starts

The opening of the file, as written. The whole thing — 234 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Creating a new CORAL task

A CORAL task is three things that must line up:

examples/<task>/
├── task.yaml      # config: name, description, grader entrypoint, agent count
├── seed/          # starter code agents see when they begin (the repo_path)
│   └── solution.py
└── grader/        # standalone Python package
    ├── pyproject.toml
    └── src/<task>_grader/
        ├── __init__.py
        └── grader.py     # class Grader(TaskGrader): ...

The packaged form is the only supported form. The package gives the grader its own venv and ships everything the eval needs — grader code, helper modules, and hidden data (see "Hidden data" below).

Reference implementations

Look at these before writing anything new — copy the closest one and edit:

Reference When to copy it
examples/erdos/ Minimal packaged grader, single grader file, numpy-only deps
examples/dna_design/ Packaged grader with bundled data files (importlib.resources) and [ml] optional-deps for heavy libs
examples/swebench-verified/ Tiered eval (different instance counts per tier), private answer keys, harbor integration
examples/circle_packing/ Smallest packaged task end-to-end — single solution file, single grader file
examples/mnist/ Packaged grader with a hidden answer key (note: secret data belongs under grader.private in a taskdata/ sibling of grader/, never inside the grader package)

1. The seed

Whatever lives in seed/ is what the agent sees on first checkout — it's the working directory the grader will later score. The contract between seed/ and the grader is the program file: a Python file with a function the grader imports and calls.

The convention across examples is:

  • solution.py (or initial_program.py) defining a top-level run() function.
  • The grader passes program_file: "solution.py" via grader.args.
  • run()'s signature is whatever the grader expects — usually () -> result or (input_path) -> result.

Read the full file on GitHub · 234 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 12d ago First seen · 234 lines · 138 tokens per session scan A 8f586badcd29

Subscribe to this mod's changes

coral-new-task is a skill published in the GitHub repository Human-Agent-Society/CORAL (975 stars, last pushed 3d ago), licensed Apache-2.0. It adds 138 tokens to every session and 3,292 once invoked, about $0.0007 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

e2e-testing

Guide for running end-to-end tests of the Qwen Code CLI, including headless mode, MCP server testing, and API traffic inspection. Use this skill whenever you need to verify CLI behavior with real model calls, reproduce user-reported bugs end-to-end, test MCP tool integrations, or inspect raw API request/response…

QwenLM/qwen-code · 94 tokens

terminal-capture

Automates terminal UI screenshot testing for CLI commands. Applies when reviewing PRs that affect CLI output, testing slash commands (/about, /context, /auth, /export), generating visual documentation, or when 'terminal screenshot', 'CLI test', 'visual test', or 'terminal-capture' is mentioned.

QwenLM/qwen-code · 66 tokens

agent-reproduce-align

Use after a Codex or Claude Code feature has been implemented in Qwen Code to run the selected reference agent and Qwen Code under the same scenario, capture HTTP and terminal traces, compare request bodies, tool/function schemas, outputs, and iterate until the reproduced behavior is close enough.

QwenLM/qwen-code · 62 tokens

qa-testing

Verify your work by actually operating the app or website you changed, instead of assuming it works. Strongly recommended whenever you build, modify, or debug a web app, website, or desktop GUI app. Drive real browsers with the agent-browser CLI and native desktop apps with the cua-driver CLI. These are installed on…

openinterpreter/openinterpreter · 77 tokens

cw-gates

Use before claiming any Codewhale change is done, green, or ready to land: the focused-to-broad verification ladder, the budget checks CI enforces, and the rules for what counts as a passing test.

Hmbown/Codewhale · 48 tokens

codew-release-qa-sweep

Use before claiming Codewhale release work is done: run the full gate sweep and list the manual QA targets.

Hmbown/CodeWhale · 31 tokens