Ad Creative Testing

Ad Creative Testing is a skill for Claude Code, Codex from SkillMedev/skills. It costs 36 tokens per session (1,209 once invoked), scanned A, original, MIT.

A method for testing advertising ideas by changing one element at a time, such as the opening hook, visual format, offer, or call to action. It uses predefined hypotheses, sample sizes, and meaningful performance differences before choosing a winner.

In plain words
What is it for?
Planning ad experiments, testing video openings or headlines, labelling creatives by the variable they test, setting sample sizes, and deciding when results are reliable enough to act on.
Why use it?
It prevents tests from producing results that cannot be explained because several things changed together or too little data was collected. It helps separate real improvements from random variation.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/skillmedev/skills/ad-creative-testing
Any agent
npx skills add SkillMedev/skills --skill ad-creative-testing
Clone the repo
git clone --depth 1 https://github.com/SkillMedev/skills

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for Ad Creative Testing

README.md
[![agentmods](https://agentmods.dev/badge/skills/skillmedev/skills/ad-creative-testing.svg)](https://agentmods.dev/skills/skillmedev/skills/ad-creative-testing)
Your own site
<a href="https://agentmods.dev/skills/skillmedev/skills/ad-creative-testing"><img src="https://agentmods.dev/badge/skills/skillmedev/skills/ad-creative-testing.svg" alt="Measured on agentmods" height="20"></a>
Per session 36 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,209 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00036 $0.01209
Opus 5 $0.00018 $0.00605
Sonnet 5 $0.00007 $0.00242
Haiku 4.5 $0.00004 $0.00121

Measured 4d ago against content hash a30bb93385c2, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

Ad Creative Testing scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 4d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/ad-creative-testing/SKILL.md · 57 lines

How it starts

The opening of the file, as written. The whole thing — 57 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Ad Creative Testing

Most ad creative testing produces noise, not learning. Discipline means changing one variable at a time, running tests long enough, and acting only on statistically meaningful results.

Structure Tests Around a Single Variable

Each test must isolate exactly one variable: hook (first 3 seconds of video or headline), visual format (static vs. video vs. carousel), offer framing (discount vs. free trial vs. guarantee), or call to action. Testing multiple variables at once makes the result uninterpretable. Label every creative with the variable it is testing and the hypothesis it is checking before launch.

Prioritize Hook Testing First

The hook is the highest-leverage variable in most paid channels. For video, the 3-second view rate and thumb-stop ratio reveal hook strength before the full watch occurs. For static and search, the headline carries the same weight. Run hook tests before any other variable - a great offer with a weak hook will never be seen. A hook passes if 3-second view rate exceeds 30% on Meta or thumb-stop exceeds 25%; a headline passes if CTR exceeds channel benchmark.

Set Sample Sizes Before Running

Do not evaluate results until reaching the pre-set sample size. For conversion-rate tests, aim for at least 100 conversions per variant - fewer than that and the result is noise. For CTR or view-rate tests, 2,000 impressions per variant is the minimum. Use a significance calculator before declaring a winner; 95% confidence is the threshold. If budget prevents reaching significance in under 21 days, the test is not worth running as a controlled experiment - use directional data only and label it clearly.

Maintain a Creative Log

Keep a running log of every test: hypothesis, variable tested, variants, launch date, sample size at close, result, and the decision made. The log is the asset. Pattern recognition across 20+ tests reveals which creative elements consistently move the needle for a specific audience. Without a log, teams repeat failed experiments and lose institutional knowledge.

Read the full file on GitHub · 57 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 4d ago First seen · 57 lines · 36 tokens per session scan A a30bb93385c2

Subscribe to this mod's changes

Ad Creative Testing is a skill published in the GitHub repository SkillMedev/skills (11 stars, last pushed 2mo ago), licensed MIT. It adds 36 tokens to every session and 1,209 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

webinar-funnel-builder

Designs a complete webinar funnel - registration page promise, reminder email sequence timed against typical 35-45 percent show-up rates, webinar structure with a 70 percent teach / 30 percent offer split and the pivot script, replay window and urgency rules, and the post-webinar email sequence - with a funnel-metrics…

SkillMedev/creator-studio · 180 tokens

Creator Content Calendar

Designs a sustainable publishing system for a solo creator - 3-4 content pillars, a cadence set at the creator's consistent floor, a fixed pillar rotation, a 30-day idea bank, and a monthly audit loop - delivered as a weekly calendar skeleton. Use when someone says "help me plan my content", "I keep falling off my…

SkillMedev/creator-studio · 167 tokens

Show Notes Writer

Produces complete podcast show notes from a transcript or episode outline - a standalone summary block, timestamped chapters that name what happens, screenshot-worthy key takeaways, guest bio, curated links, and keyword placement for search. Use when someone says "write show notes for this episode", "turn this…

SkillMedev/creator-studio · 146 tokens

YouTube Script Writer

Writes retention-engineered long-form YouTube scripts on a hook/body/payoff architecture - a first-30-seconds hook that survives the retention cliff, a beat-sheet body with mini-hooks and bridges, timed pattern interrupts, and a payoff that over-delivers - with B-roll and editing cues marked inline. Use when someone…

SkillMedev/creator-studio · 180 tokens

Systematic Review

Runs a PRISMA-compliant systematic review from PICO question and pre-registered protocol through search strings, two-stage screening, risk-of-bias appraisal, and GRADE-rated synthesis. Use when someone asks "run a systematic review", "build my search strategy and inclusion criteria", "screen these studies against a…

SkillMedev/academic-researcher · 123 tokens

Policy Brief

Writes a concise, evidence-based policy brief - problem, options compared on consistent criteria, and a recommendation - that a decision-maker can act on in minutes. Use when someone asks "write a policy brief", "summarize the evidence and options for this decision", "brief the minister/board/council on X", or needs a…

SkillMedev/academic-researcher · 121 tokens