agent-orchestrator-template: Skill for Codex

.agents/skills/evaluation-first-decision/SKILL.md

evaluation-first-decision is a skill for Codex from shintaro-sprech/agent-orchestrator-template. It costs 173 tokens per session (2,762 once invoked), scanned A, original, MIT.

A decision-review method for important choices such as releases, migrations, purchases, automation, architecture, or business policies. It separates known facts from assumptions and unknowns, compares options including doing nothing, and defines safety limits.

In plain words
What is it for?
Use it to assess whether to proceed with a high-impact change and return a GO, PILOT, HOLD, or STOP decision.
Why use it?
It helps expose uncertainty and possible harm before an important decision is made. It can also define a small test, stopping conditions, and a way to undo the change.

Skill for Codex

Written for Codex: agents/openai.yaml present. Also seen: mentions Claude Code; installed under .agents/ (shared by several agents); mentions Codex.

This is shintaro-sprech/agent-orchestrator-template's own configuration. It tells Codex how to work on agent-orchestrator-template itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything agent-orchestrator-template configures →

Reuse

Borrowing it

Nothing to install: this file belongs to shintaro-sprech/agent-orchestrator-template. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/shintaro-sprech/agent-orchestrator-template/main/.agents/skills/evaluation-first-decision/SKILL.md
Clone the repo
git clone --depth 1 https://github.com/shintaro-sprech/agent-orchestrator-template

Made for: Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for evaluation-first-decision

README.md
[![agentmods](https://agentmods.dev/badge/skills/shintaro-sprech/agent-orchestrator-template/evaluation-first-decision/github.svg)](https://agentmods.dev/skills/shintaro-sprech/agent-orchestrator-template/evaluation-first-decision)
Your own site
<a href="https://agentmods.dev/skills/shintaro-sprech/agent-orchestrator-template/evaluation-first-decision"><img src="https://agentmods.dev/badge/skills/shintaro-sprech/agent-orchestrator-template/evaluation-first-decision/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for evaluation-first-decision

Your own site · 80×15
<a href="https://agentmods.dev/skills/shintaro-sprech/agent-orchestrator-template/evaluation-first-decision"><img src="https://agentmods.dev/badge/skills/shintaro-sprech/agent-orchestrator-template/evaluation-first-decision.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 173 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,762 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector pass 7 Sept 2026
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00173 $0.02762
Opus 5 $0.00086 $0.01381
Sonnet 5 $0.00035 $0.00552
Haiku 4.5 $0.00017 $0.00276

Measured 11d ago against content hash 32eece41edaa, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-10, from the pricing page.

Security

Grade A, and why

evaluation-first-decision scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 11d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.agents/skills/evaluation-first-decision/SKILL.md · 281 lines

How it starts

The opening of the file, as written. The whole thing — 281 lines — stays where its author put it; the contents beside it link to each section on GitHub.

評価ファースト意思決定

もっともらしい推薦ではなく、後から検証できる意思決定を作る。 説得力より証拠を、平均的な改善より重大な悪化の防止を優先する。

適用範囲

次のいずれかを含む判断に使用する。

  • 本番公開、リリース、デプロイ、移行、廃止
  • AI・自動化・新技術・SaaS・アーキテクチャの導入
  • 購入、価格、優先順位、採用、外注、事業方針
  • 顧客、利用者、売上、品質、セキュリティ、法務、信用に影響する変更
  • 「進めてよいか」「GO/HOLDを判定して」「どちらを選ぶべきか」という依頼

次には通常使用しない。

  • 単純な事実確認や用語説明
  • 文章の添削、翻訳、要約
  • 制約のないアイデア出し
  • 影響が小さく、容易に取り消せる日常的な変更

このSkillは原則として判断を設計・評価する。外部送信、購入、削除、本番反映などの実行承認を代替しない。

基本原則

  1. 評価基準を推薦より先に固定する。
  2. 事実、仮定、未確認事項、制約を混ぜない。
  3. 現状維持と「何もしない」を必ず比較する。
  4. 主目的だけでなく、悪化させてはいけないガードレールを置く。
  5. 不確実性が残る場合は、全面導入ではなく最小の安全な実験を選ぶ。
  6. 停止条件とロールバックを実行前に定義する。
  7. 結果を見た後で成功条件を書き換えない。
  8. 高リスクかつ不可逆な判断をAIだけで最終承認しない。

ワークフロー

1. 判断を一文で固定する

次を明確にする。

  • 何を決めるのか
  • 誰が決定者か
  • 対象範囲
  • 判断期限
  • 現在の状態
  • 何もしなかった場合
  • 取り消し可能性

情報が不足していても、妥当な仮定を明記して分析を進める。 結論を左右する必須情報だけを Unknowns に残す。

2. 重要度を分類する

LOW / MEDIUM / HIGH / CRITICAL のいずれかに分類する。

判断材料:

  • 取り消し可能性と復旧時間
  • 影響人数と対象範囲
  • 金銭、顧客、品質、信用への影響
  • セキュリティ、プライバシー、法務、契約への影響
  • 障害を検知できるか
  • 証拠の量と不確実性

低リスク判断を過剰に官僚化しない。 HIGH または CRITICAL では、人間の決定者、停止条件、ロールバックを必須とする。

3. 証拠台帳を作る

重要情報を次の4区分に分ける。

  • Confirmed facts: 直接確認できた事実
  • Assumptions: 判断のために置いた仮定
  • Unknowns: 未確認で結論を変え得る事項
  • Constraints: 予算、期限、人員、技術、契約、運用能力など

出典がある場合は事実の近くに示す。 証拠のない数値、利用者の反応、原因、確率を作らない。

4. 推薦前にスコアカードを宣言する

最低限、次を定義する。

  • Primary outcome: 最も改善したい結果
  • Baseline: 現状または既存方式の実績
  • Success condition: 成功と判断する条件
  • Guardrails: 悪化させてはいけない品質、リスク、負担
  • Stop condition: 中止またはロールバックする条件
  • Evidence source: ログ、テスト、データ、観察、ヒアリング
  • Evaluation window: 期間、件数、対象数、判定日

数値化できない項目は、観察可能な条件で表す。 根拠のない閾値や精密な確率は使わない。

5. 選択肢を比較する

最低限、次を含める。

  • 提案された案
  • 最も有力な代替案
  • より小さな変更で済ませる案
  • 現状維持または何もしない案

各案を次で比較する。

  • 期待便益
  • 主な欠点と最悪時の損失
  • 実行・保守・運用コスト
  • 可逆性
  • 観測可能性
  • 必要な証拠
  • 実行しない場合の機会損失

6. 推薦案を反証する

推薦案に不利な証拠を意図的に探す。

  • 失敗するとしたら最もあり得る原因は何か
  • 誰が不利益を受けるか
  • 指標だけ改善し、本来の目的を悪化させないか
  • 成功に見える別の説明はないか
  • 過去データは今回と比較可能か
  • サンプル不足、選択バイアス、計測漏れはないか
  • 実行しない方が合理的になる条件は何か

最大の反証を省略・矮小化しない。

7. 最小の安全な実験を設計する

証拠が不足する場合は、限定的・観測可能・停止可能・可逆的な実験を設計する。

必須項目:

Read the full file on GitHub · 281 lines

Files

What ships with it

4 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 11d ago First seen · 281 lines · 173 tokens per session scan A 32eece41edaa

Subscribe to this mod's changes

evaluation-first-decision is a skill published in the GitHub repository shintaro-sprech/agent-orchestrator-template (124 stars, last pushed 11d ago), licensed MIT. It adds 173 tokens to every session and 2,762 once invoked, about $0.0009 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

systematic-debugging

Use when encountering any bug, test failure, or unexpected behavior, before proposing fixes.

obra/superpowers · 21 tokens

local-ai-agents

Build local-first AI agents that run entirely on a developer workstation with Microsoft Foundry Local and Qwen function-calling models. Covers Small Language Models (SLMs), the OpenAI-compatible local endpoint, sandboxed local tools, local RAG with Chroma, local MCP servers, hybrid cloud/local routing, and the…

microsoft/ai-agents-for-beginners · 200 tokens

next-cache-components-adoption

Turn on Cache Components in a Next.js app and resolve the blocking routes it surfaces. Use when the user wants to enable, adopt, or migrate to Cache Components, flip the cacheComponents flag, work through a flood of blocking-prerender / instant validation errors, run the cache-components-instant-false codemod, or…

vercel/next.js · 95 tokens

insight-error-page

Write or audit an insight-kind error page for the Next.js dev overlay. Use when creating a new errors/ .mdx page, auditing an existing one, or checking that a page matches the framework fix cards. Covers page structure, title alignment, FixCard cards with Copy prompt button, code snippets, terminology verification…

vercel/next.js · 83 tokens

next-cache-components-optimizer

Drive a Next.js route to instant navigation by setting up an agentic loop, under Cache Components / PPR, on initial load (hard navigation) and client-side navigation (soft navigation). Encode the goal as a failing @next/playwright instant() e2e and work it to green, one verified route at a time; the shipped test then…

vercel/next.js · 170 tokens

next-partial-prefetching-adoption

Turn on Partial Prefetching in a Next.js app and work through the insights it surfaces. Use when the user wants to enable or adopt Partial Prefetching, flip the partialPrefetching flag, opt routes in with export const prefetch = 'partial', audit Link prefetch={true} behavior, preserve existing prefetched UI with…

vercel/next.js · 103 tokens