experiment-design-architect

experiment-design-architect is a skill for Claude Code, Codex from Nero1688/claude-academic-skills. It costs 476 tokens per session (1,882 once invoked), scanned A, original, MIT.

A guide for designing controlled experiments that test whether one factor causes a change in an outcome. It covers how to assign people to conditions, write realistic scenarios, check whether the intended change was noticed, and plan sample sizes.

In plain words
What is it for?
Use it to choose between between-person, within-person, and mixed designs, create workplace scenario experiments, plan pilot tests, and prepare manipulation checks and power analyses.
Why use it?
It helps prevent unfair comparisons, order effects, weak scenarios, and experiments that cannot support their conclusions. It also makes key design choices explicit before data collection.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it to choose between between-person, within-person, and mixed designs, create workplace scenario experiments, plan pilot tests, and prepare manipulation checks and power analyses.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/nero1688/claude-academic-skills/experiment-design-architect
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add Nero1688/claude-academic-skills --skill experiment-design-architect
Clone the repo
git clone --depth 1 https://github.com/Nero1688/claude-academic-skills

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for experiment-design-architect

README.md
[![agentmods](https://agentmods.dev/badge/skills/nero1688/claude-academic-skills/experiment-design-architect/github.svg)](https://agentmods.dev/skills/nero1688/claude-academic-skills/experiment-design-architect)
Your own site
<a href="https://agentmods.dev/skills/nero1688/claude-academic-skills/experiment-design-architect"><img src="https://agentmods.dev/badge/skills/nero1688/claude-academic-skills/experiment-design-architect/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for experiment-design-architect

Your own site · 80×15
<a href="https://agentmods.dev/skills/nero1688/claude-academic-skills/experiment-design-architect"><img src="https://agentmods.dev/badge/skills/nero1688/claude-academic-skills/experiment-design-architect.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 476 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,882 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00476 $0.01882
Opus 5 $0.00238 $0.00941
Sonnet 5 $0.00095 $0.00376
Haiku 4.5 $0.00048 $0.00188

Measured 12d ago against content hash b2071d0bb790, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-11, from the pricing page.

Security

Grade A, and why

experiment-design-architect scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 12d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/experiment-design-architect/SKILL.md · 73 lines

What it actually says

實驗設計架構師(Experiment Design Architect)

Step 1|因果假說的可操弄性檢查

  • X 必須可操弄:「家族企業 vs 非家族」不可隨機分派——那是準實驗或檔案研究的事, 誠實轉回 research-method-selector。可操弄的是知覺與情境:資訊揭露方式、 領導語氣、誘因框架。
  • 倫理可行性:操弄不得造成實質傷害或重大欺瞞;需要欺瞞時必須有 debriefing 計畫。

Step 2|設計選型(核心決策樹)

決策 選項與判準
受試者間(between) 每人只見一種處理:無沾染、需較大 N;操弄易被識破時的預設
受試者內(within) 每人歷經多處理:N 效率高、統計力強;但有順序/練習/沾染效應,必須對抗平衡
混合(mixed) 一因子間+一因子內;調節假說常用

對抗平衡(counterbalancing)技術(受試者內設計的生命線):

  • 2 條件:AB/BA 兩序隨機半分。
  • 3+ 條件:拉丁方陣(k 條件 k 序列,每條件在每位置恰一次);條件更多或 怕殘留效應用平衡拉丁方陣(每條件緊跟其他條件恰一次)。
  • 順序當因子丟進分析驗證無順序主效果,結果報告要交代。

因子設計:2×2 起跳講交互作用;cell 數 × 每 cell 最低 30–50 人估算總 N; 超過 2×3 要自問每個 cell 的理論必要性(cell 越多,樣本與解釋負擔平方成長)。

Step 3|情境實驗(vignette,商管主流)

遵循 Aguinis & Bradley (2014) 準則:

  1. 情境撰寫:操弄變數間只改關鍵句,其餘逐字相同;長度 150–300 字; 用受試者熟悉的產業語境(擬真度 realism)。
  2. 擬真度檢核:前測問「此情境在真實職場發生的可能性」(7 點量表,均值 ≥5)。
  3. 紙上人物風險:提醒外推限制,討論節要寫;可用「決策後果真實化」 (抽獎金額隨決策變動)提升 consequentiality。
  4. 每情境版本 → 隨機分派 → 操弄檢核 → 依變數測量 → 人口統計(順序固定)。

Step 4|前測、操弄檢核、檢定力

  • 前測(pilot):小樣本(每 cell 15–20)先驗:操弄檢核通過率、情境擬真度、 完成時間。前測失敗就改材料,不硬上。
  • 操弄檢核:直接測受試者對操弄變數的知覺(操弄「高低揭露透明度」就測 知覺透明度),正式分析報 t/F 值;檢核不過的受試者處置規則先訂 (剔除 vs 保留敏感度分析並陳)。
  • 先驗檢定力:效果量引前研究或 meta(管理實驗 d≈0.3–0.5 常見), α=.05、power=.80;G*Power 參數寫進設計書,審稿人要看。
  • 預先註冊:假說、設計、N、淘汰規則、分析計畫上 AsPredicted/OSF (接 phd-researcher 的 preregistration 模板)——頂刊實驗研究的新常態。

Step 5|執行與交棒

  • 隨機化用真隨機(平台內建或亂數表),記錄種子;分派後檢查各組人口變數平衡。
  • 資料品質:沿用 survey-research-architect 的注意力檢查與時間防線。
  • 交棒:設計矩陣+資料 → r-spss-syntax-architect(ANOVA/混合模型+簡單效果) → management-figure(交互作用圖)→ 投稿前雙檢。

紅線

  1. 不可操弄的變數不硬做實驗;隨機分派是實驗的靈魂,沒有隨機就別自稱實驗。
  2. 淘汰規則、分析計畫先於資料(最好預先註冊);操弄檢核不過不能無聲無息。
  3. 欺瞞須 debriefing;受試者報酬與自願參與寫進倫理節;需 IRB 提醒送審。
  4. 學生樣本做組織決策實驗要誠實討論外推性,不遮掩。
Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 12d ago First seen · 73 lines · 476 tokens per session scan A b2071d0bb790

Subscribe to this mod's changes

experiment-design-architect is a skill published in the GitHub repository Nero1688/claude-academic-skills (6 stars, last pushed 9d ago), licensed MIT. It adds 476 tokens to every session and 1,882 once invoked, about $0.0024 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

alterlab-deep-research

Runs a 13-agent deep research pipeline for rigorous academic work on any topic across 7 modes (full research, quick brief, paper review, lit-review, fact-check, Socratic guided research dialogue, and systematic review with optional meta-analysis), covering research-question formulation, Socratic mentoring, methodology…

AlterLab-IEU/AlterLab-Academic-Skills · 239 tokens

alterlab-imaging-data-commons

Query and download public cancer imaging data from the NCI Imaging Data Commons (IDC) using the idc-index Python package, filtering by metadata, visualizing in-browser, and checking licenses, with no authentication required. Use when obtaining large-scale radiology (CT, MR, PET) or digital pathology DICOM datasets for…

AlterLab-IEU/AlterLab-Academic-Skills · 90 tokens

alterlab-pyhealth

Develops, tests, and deploys clinical machine learning models with the PyHealth healthcare AI toolkit. Use when working with electronic health records (EHR), clinical prediction tasks (mortality, readmission, drug recommendation), medical coding systems (ICD, NDC, ATC), physiological signals (EEG, ECG), healthcare…

AlterLab-IEU/AlterLab-Academic-Skills · 117 tokens

alterlab-cobrapy

Build and analyze genome-scale constraint-based metabolic models with COBRApy — flux balance analysis (FBA), flux variability analysis (FVA), gene and reaction knockouts, flux sampling, and SBML model I/O. Use when simulating metabolic networks, predicting growth or knockout phenotypes, or running systems-biology and…

AlterLab-IEU/AlterLab-Academic-Skills · 91 tokens

alterlab-deeptools

Process and visualize deep-sequencing coverage with the deepTools CLI — convert BAM to bigWig (bamCoverage), build log2 ratio tracks (bamCompare), run QC (multiBamSummary correlation, PCA, plotFingerprint), apply the ATAC-seq Tn5 shift (alignmentSieve --ATACshift), and make TSS/peak heatmaps and profiles…

AlterLab-IEU/AlterLab-Academic-Skills · 173 tokens

alterlab-phylogenetics

Build phylogenetic trees end-to-end from raw sequences — MAFFT multiple sequence alignment, optional TrimAl trimming, IQ-TREE 2 maximum-likelihood inference with model selection and bootstraps, FastTree for large datasets, then visualize with ETE3 or FigTree. Use when reconstructing trees from sequences (FASTA) for…

AlterLab-IEU/AlterLab-Academic-Skills · 152 tokens