shipd-olympus

shipd-olympus is a skill for Claude Code, Codex from mashhoorahdal/shipd-olympus-skill. It costs 79 tokens per session (2,803 once invoked), scanned A, original, MIT.

A process for preparing difficult coding challenges for shipd.ai Olympus, a system that evaluates coding agents using GitHub projects and hidden tests.

In plain words
What is it for?
Use it to choose an eligible repository, design a challenging task, write hidden tests and a reference solution, and prepare the required Dockerfile and test script.
Why use it?
It helps make submissions meet the platform's requirements and tests whether agents can solve substantial, realistic changes.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it to choose an eligible repository, design a challenging task, write hidden tests and a reference solution, and prepare the required Dockerfile and test script.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/mashhoorahdal/shipd-olympus-skill/skill
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add mashhoorahdal/shipd-olympus-skill --skill skill
Clone the repo
git clone --depth 1 https://github.com/mashhoorahdal/shipd-olympus-skill

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for shipd-olympus

README.md
[![agentmods](https://agentmods.dev/badge/skills/mashhoorahdal/shipd-olympus-skill/skill/github.svg)](https://agentmods.dev/skills/mashhoorahdal/shipd-olympus-skill/skill)
Your own site
<a href="https://agentmods.dev/skills/mashhoorahdal/shipd-olympus-skill/skill"><img src="https://agentmods.dev/badge/skills/mashhoorahdal/shipd-olympus-skill/skill/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for shipd-olympus

Your own site · 80×15
<a href="https://agentmods.dev/skills/mashhoorahdal/shipd-olympus-skill/skill"><img src="https://agentmods.dev/badge/skills/mashhoorahdal/shipd-olympus-skill/skill.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 79 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,803 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00079 $0.02803
Opus 5 $0.00039 $0.01401
Sonnet 5 $0.00016 $0.00561
Haiku 4.5 $0.00008 $0.00280

Measured 9d ago against content hash 9a8c027cdd6c, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-09, from the pricing page.

Security

Grade A, and why

shipd-olympus scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skill/SKILL.md · 146 lines

How it starts

The opening of the file, as written. The whole thing — 146 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Shipd Olympus Submissions

Overview

An Olympus submission = repo@commit + problem description + hidden tests + golden solution + Dockerfile. Tasks must be HARD enough that state-of-the-art agents fail at least half their runs — a one-file fix is an instant rejection. The approved shape: a new "family" of related functionality mirroring something the repo already has, 200+ effective solution LOC, 40+ deterministic tests.

1. Repo eligibility (check ALL before investing)

gh repo view OWNER/REPO --json stargazerCount,licenseInfo,pushedAt,primaryLanguage
  • License: permissive only (MIT/Apache/BSD). GitHub API "other" ≠ fail — read the LICENSE file (some repos show "other" but are Apache-2.0; others show "other" but are GPL → disqualified).
  • Stars: 500+. Activity: commit within 12 months (verify pushedAt arithmetic — "3 months ago" passes, don't confuse with a 3-month rule).
  • Language: TS/JS/Python/Go/Rust/C++/Java. Pin commit = head of default branch.
  • In the platform form, paste the exact https://github.com/owner/repo URL — its search surfaces forks (0 stars) and some repos are blocked outright.

2. Task design — aim below the 50% bar

The platform rejects tasks agents pass more than half the time. Design for failure up front; don't hope the batch comes back hard.

Hard is designed, not found. Searching issue trackers for "hard problems" mostly surfaces chores (docs, typings, build config). Instead: pick a complex subsystem in an eligible repo (parser, type dispatcher, scheduler, query planner) and design a feature family that must integrate with it correctly.

Difficulty archetypes, ranked by difficulty gained per spec word spent:

  1. Convention traps — the spec picks ONE of several plausible conventions and agents implement a neighboring one. Quantile interpolation has ~9 textbook variants; rounding modes, date arithmetic, and string collation are similar minefields. One sentence of spec, an entire wrong-implementation class of failures.
  2. Exact-boundary rules — one sentence with several failure seams (e.g. weighted median: exact-half cumulative weight averages with the next larger distinct value; duplicates merge; fractional weights break expand-and-recount tricks).
  3. Non-inferable semantic substitution — the new function differs from its obvious sibling in one deliberate way (divisor uses total weight, not element count). Agents copy the sibling and fail.
  4. Cross-cutting invariants — one rule enforced at N call sites; agents patch two of four.
  5. Long wiring chains — the feature must register in 5+ places (factory list, type definitions, docs registry, parser exposure); missing one fails a test non-obviously. Also lifts the LOC and file-count medians the platform requires.
  6. Parser/compiler surface — grammar, precedence, round-trip printing. Hardest per run, but the spec cost is high; use when the repo's parser is the complex subsystem.

Read the full file on GitHub · 146 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 9d ago First seen · 146 lines · 79 tokens per session scan A 9a8c027cdd6c

Subscribe to this mod's changes

shipd-olympus is a skill published in the GitHub repository mashhoorahdal/shipd-olympus-skill (6 stars, last pushed 1mo ago), licensed MIT. It adds 79 tokens to every session and 2,803 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

test-driven-development

Drives development with tests using the red-green-refactor loop. Use when implementing any logic, fixing any bug, or changing any behavior. Use when you need to prove that code works, when a bug report arrives, or when you're about to modify existing functionality.

addyosmani/agent-skills · 57 tokens

workflow-patterns

Use this skill when implementing tasks according to Conductor's TDD workflow, handling phase checkpoints, managing git commits for tasks, or understanding the verification protocol.

wshobson/agents · 35 tokens

skillshare-implement-feature

Implement a feature from a spec file or description using TDD workflow. Use this skill whenever the user asks to: add a new CLI command, implement a feature from a spec, build new functionality, add a flag, create a new internal package, or write Go code for skillshare. This skill enforces test-first development…

runkids/skillshare · 114 tokens

go-testing

Trigger: Go tests, go test coverage, Bubbletea teatest, golden files. Apply focused Go testing patterns.

Gentleman-Programming/gentle-ai · 26 tokens

designing-tests

Designs and implements testing strategies for any codebase. Use when adding tests, improving coverage, setting up testing infrastructure, debugging test failures, or when asked about unit tests, integration tests, or E2E testing.

CloudAI-X/claude-workflow-v2 · 48 tokens

Changelog Test Mapper

Map changelog entries and release notes to affected test cases, ensuring every user-facing change has corresponding test coverage verification.

PramodDutta/qaskills · 28 tokens