portfolio-certification

portfolio-certification is a skill for Claude Code, Codex from austin-starks/Public-Portfolio-Challenge. It costs 127 tokens per session (1,474 once invoked), scanned A, original, MIT.

A process for deciding whether a NexusTrade trading strategy or live portfolio holds up on data it was not trained on. Out-of-sample testing checks whether results generalize beyond the data used to design the strategy.

In plain words
What is it for?
Use it to run walk-forward tests, verify strategy fields, select a configuration that remains robust across periods, and issue a pass-or-fail certification.
Why use it?
It reduces the risk of deploying a strategy that only looks good because it was tuned to historical data.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it to run walk-forward tests, verify strategy fields, select a configuration that remains robust across periods, and issue a pass-or-fail certification.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/austin-starks/public-portfolio-challenge/portfolio-certification
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add austin-starks/Public-Portfolio-Challenge --skill portfolio-certification
Clone the repo
git clone --depth 1 https://github.com/austin-starks/Public-Portfolio-Challenge

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for portfolio-certification

README.md
[![agentmods](https://agentmods.dev/badge/skills/austin-starks/public-portfolio-challenge/portfolio-certification/github.svg)](https://agentmods.dev/skills/austin-starks/public-portfolio-challenge/portfolio-certification)
Your own site
<a href="https://agentmods.dev/skills/austin-starks/public-portfolio-challenge/portfolio-certification"><img src="https://agentmods.dev/badge/skills/austin-starks/public-portfolio-challenge/portfolio-certification/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for portfolio-certification

Your own site · 80×15
<a href="https://agentmods.dev/skills/austin-starks/public-portfolio-challenge/portfolio-certification"><img src="https://agentmods.dev/badge/skills/austin-starks/public-portfolio-challenge/portfolio-certification.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 127 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,474 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector pass 7 Sept 2026
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00127 $0.01474
Opus 5 $0.00063 $0.00737
Sonnet 5 $0.00025 $0.00295
Haiku 4.5 $0.00013 $0.00147

Measured 12d ago against content hash edba467a4d27, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-11, from the pricing page.

Security

Grade A, and why

portfolio-certification scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 12d ago.

The scan reads SKILL.md. This mod also ships 1 executable file (install.sh), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/portfolio-certification/SKILL.md · 92 lines

How it starts

The opening of the file, as written. The whole thing — 92 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Portfolio Certification

The umbrella skill for the Public Portfolio Challenge. You are the orchestrator + independent verifier: you run the deterministic NexusTrade tools directly and the numbers are your own — there is no agent whose results you are second-guessing. Certification is a holistic PASS/FAIL verdict read from out-of-sample walk-forward folds, never a single aggregate number.

First principles (binding across every run)

  1. OOS is the only headline. Never present train/validation numbers as evidence of generalization. A great full-cycle backtest with a train→OOS collapse is a FAIL.
  2. The value lives in the DESIGN, not the optimizer. The sweep is a modest knob-setter that confirms a design's neighborhood. Spend effort on the strategy design; ask the sweep for little.
  3. Deploy the cross-fold-robust config, never the per-fold argmax. Validation score is a noisy proxy; the per-fold winner is high-variance. Use maximin OOS Sortino / robust selection.
  4. Verify at the FIELD level, never by display name. Use conditionFieldAudit; copy indicator IDs exactly from the catalog. Confirm the SUBJECT by field/posture, never by its name.
  5. Verify, don't assert. Every claim about engine behavior gets checked against events, fields, or a reproduction before it appears in a deliverable. "Probably an engine quirk" → run the bug-protocol, don't hand-wave.
  6. A null result honestly reported is a valid outcome. Don't torture variants until one "wins" — that is the per-fold-argmax trap in a costume. Ties or noise-level deltas → keep the incumbent.
  7. No deploy, no orders until the human explicitly says "deploy + clean up" (the deploy-gate).

Standard run structure

Every certification campaign follows the same staged shape. Adapt the middle; the bookends are fixed.

  • Stage A — Baseline + inventory. Confirm the SUBJECT by field (get_portfolio), re-verify the incumbent bar, spot-check one fresh backtest_portfolio + audit_backtest_posture, and — if the book is live — check pending-order state and automaticOrderApproval. Deliver a one-paragraph before state. When live behavior is the problem, reproduce it with hard numbers first (query_portfolio_events), then fix.
  • Stage B/C — Build + certify. Run the certification proper. See walk-forward-oos for the study mechanics and the mandatory per-fold checks, breadth-audit for fixed-$25k participation, options-structure-rules for the hard spread-shape gate, and sweep-reoptimization if any structural change forces a re-sweep.
  • Stage D — Present, then stop. Deliver a decision-ready package: verdict up top, one line; per-fold OOS table + aggregate; side-by-side vs the incumbent with the trade made explicit; finalist's plain-English rules + conditionFieldAudit + build id; provenance labels on every parameter (swept-on-this-book / inherited-from <study-id> / hand-set — inherited is amber); honest caveats (hindsight in the frozen universe, options fill realism, leverage/fragility, worst drawdown was the April-2025 selloff, baseline caveats). Include the bug ledger. No deploy.
  • Stage E — Deploy (GATED). Only after explicit "deploy + clean up". See deploy-gate.

Read the full file on GitHub · 92 lines

Files

What ships with it

3 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 12d ago First seen · 92 lines · 127 tokens per session scan A edba467a4d27

Subscribe to this mod's changes

portfolio-certification is a skill published in the GitHub repository austin-starks/Public-Portfolio-Challenge (44 stars, last pushed 4d ago), licensed MIT. It adds 127 tokens to every session and 1,474 once invoked, about $0.0006 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

strategy-generate

Create, modify, and optimize quantitative trading strategies, then backtest and evaluate them.

HKUDS/Vibe-Trading · 21 tokens

backtesting-sim

Backtesting and simulation: vectorized backtesting, paper trading simulation, strategy A/B testing, automated strategy building, natural language to strategy, and trading plan generation. USE FOR: backtest, backtesting, paper trading, simulation, strategy builder, A/B test strategies, natural language strategy…

mahmoud20138/Tradecraft · 118 tokens

tushare

A Python interface for Tushare, a financial data service that provides market and company information for stocks, funds, futures, and digital assets. It returns queried data as pandas tables.

HKUDS/Vibe-Trading · 79 tokens

correlation-analysis

Correlation and cointegration analysis — co-movement discovery, deep return-correlation analysis, sector clustering, realized correlation, Engle-Granger / Johansen cointegration, half-life, Kalman dynamic hedge ratio, cross-market linkage analysis, and pair-trading signal generation.

HKUDS/Vibe-Trading · 57 tokens

social-media-intelligence

Social media intelligence: financial signal extraction from Twitter/X, Telegram, Discord, and Reddit for sentiment-driven trading strategies.

HKUDS/Vibe-Trading · 28 tokens

ashare-pre-st-filter

An A-share China stock risk checker that forecasts whether a company may receive an ST or *ST warning in the next financial year. ST labels are Chinese exchange warnings for companies facing specified financial or regulatory problems.

HKUDS/Vibe-Trading · 89 tokens