ultraqa

ultraqa is a skill for Claude Code, Codex from mrzhangguoguo/oh-my-workbuddy. It costs 35 tokens per session (3,454 once invoked), scanned A, original, MIT.

A hostile end-to-end quality-checking workflow that tests an application through realistic user scenarios, including deliberately difficult or unexpected cases. End-to-end testing checks the complete behavior of a running system rather than isolated code parts.

In plain words
What is it for?
Use it to generate adversarial scenarios, run tests, investigate failures, apply fixes, retest, and report evidence about whether the requested behavior works.
Why use it?
It can reveal failures that basic tests, linting, or type checks may miss by exercising the actual behavior and repeating fixes and checks.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one. Also seen: mentions Codex.

Good fit Use it to generate adversarial scenarios, run tests, investigate failures, apply fixes, retest, and report evidence about whether the requested behavior works.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/mrzhangguoguo/oh-my-workbuddy/ultraqa
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add mrzhangguoguo/oh-my-workbuddy --skill ultraqa
Clone the repo
git clone --depth 1 https://github.com/mrzhangguoguo/oh-my-workbuddy

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for ultraqa

README.md
[![agentmods](https://agentmods.dev/badge/skills/mrzhangguoguo/oh-my-workbuddy/ultraqa/github.svg)](https://agentmods.dev/skills/mrzhangguoguo/oh-my-workbuddy/ultraqa)
Your own site
<a href="https://agentmods.dev/skills/mrzhangguoguo/oh-my-workbuddy/ultraqa"><img src="https://agentmods.dev/badge/skills/mrzhangguoguo/oh-my-workbuddy/ultraqa/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for ultraqa

Your own site · 80×15
<a href="https://agentmods.dev/skills/mrzhangguoguo/oh-my-workbuddy/ultraqa"><img src="https://agentmods.dev/badge/skills/mrzhangguoguo/oh-my-workbuddy/ultraqa.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 35 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 3,454 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00035 $0.03454
Opus 5 $0.00017 $0.01727
Sonnet 5 $0.00007 $0.00691
Haiku 4.5 $0.00003 $0.00345

Measured 11d ago against content hash 057457db3602, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-11, from the pricing page.

Security

Grade A, and why

ultraqa scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 11d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/ultraqa/SKILL.md · 239 lines

How it starts

The opening of the file, as written. The whole thing — 239 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Ported from oh-my-codex ultraqa. OMX runtime conventions ($macro invocation, omx CLI, .omx/ state directory) are replaced with WorkBuddy idioms (Skill tool, Agent tool, task list, .workbuddy/memory).

UltraQA Skill

Operating Contract

  • Outcome-first framing with concise, evidence-dense progress and completion reporting.
  • Treat newer user updates as local overrides for the active workflow branch while preserving earlier non-conflicting constraints.
  • If the user says continue, advance the current verified next step instead of restarting discovery.
  • UltraQA is not satisfied by a shallow build/lint/typecheck/test checklist. It must exercise the requested behavior through adversarial dynamic e2e scenarios whenever the target can be run, simulated, or harnessed safely.

[ULTRAQA ACTIVATED - ADVERSARIAL DYNAMIC E2E QA CYCLING]

Overview

UltraQA finds real behavior failures by combining normal verification commands with generated end-to-end scenarios, hostile user modeling, temporary harnesses when useful, and a structured evidence report. The workflow repeats test → diagnose → fix → retest until the goal is met, a bounded stop condition is reached, or a safety boundary blocks further execution.

Goal Parsing

Parse the goal from arguments. Supported formats:

Invocation Goal Type What to Check
/ultraqa --tests tests Existing tests plus adversarial dynamic e2e scenarios for the changed behavior
/ultraqa --build build Build succeeds and generated smoke/e2e probes still run against the built artifact when applicable
/ultraqa --lint lint Lint passes and no generated harness/test artifact violates project hygiene
/ultraqa --typecheck typecheck Typecheck passes and generated typed harnesses compile when applicable
/ultraqa --custom "pattern" custom Custom success pattern is verified against behavior, not trusted as misleading success output
/ultraqa --interactive interactive CLI/service behavior is tested with generated hostile and edge-case interactions

Read the full file on GitHub · 239 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 11d ago First seen · 239 lines · 35 tokens per session scan A 057457db3602

Subscribe to this mod's changes

ultraqa is a skill published in the GitHub repository mrzhangguoguo/oh-my-workbuddy (2 stars, last pushed 2mo ago), licensed MIT. It adds 35 tokens to every session and 3,454 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

browser-testing-with-devtools

Tests in real browsers via Chrome DevTools MCP. Use when building or debugging anything that runs in a browser. Use when you need to inspect the DOM, capture console errors, analyze network requests, profile performance, or verify visual output with real runtime data. Requires the chrome-devtools MCP server to be…

addyosmani/agent-skills · 68 tokens

testing-setup

Analyze and create a testing strategy for native Android apps - install testing libraries, set up test infrastructure, create harnesses for unit tests, UI tests, screenshot tests, and end-to-end tests.

android/skills · 43 tokens

actionbook-web-test

Run browser-based web tests against websites using Actionbook CLI. Activate when the user wants to test a website workflow, run smoke tests, verify a user flow, check if a web application works, run regression tests, or validate browser-based interactions. Supports test definition, execution, assertion, reporting, and…

actionbook/actionbook · 71 tokens

cherry-pr-test

Test Cherry Studio PRs by resolving and checking out a PR, statically inspecting its changes, running interactive UI tests against a safely tracked Electron instance through CDP, producing a structured report, cleaning up only the owned test instance, and restoring the original branch.

CherryHQ/cherry-studio · 57 tokens

winui-ui-testing

Automated UI testing for Windows desktop apps — generate a batch test script with the winapp ui UI Automation harness, run all tests in one pass, read results. Covers element assertions, interactions, value checking (TextBox, ComboBox, ToggleSwitch), keyboard shortcuts and typing (send-keys), hover, drag-and-drop…

microsoft/win-dev-skills · 122 tokens

web-test

A browser-automation tool for testing the 1C:Enterprise web client. It uses Playwright to navigate sections, fill forms, read tables and reports, and perform user actions in a browser.

Nikolay-Shirokov/cc-1c-skills · 44 tokens