Fetch Test Runs

Fetch Test Runs is a skill for Claude Code, Codex from wangke19/gemini-ai-helpers. It costs 18 tokens per session (4,036 once invoked), scanned A, a copy of fetch-test-runs, Apache-2.0.

A tool for retrieving test runs from the Sippy testing service, including the recorded JUnit output (a standard test-results format).

In plain words
What is it for?
Fetch runs for a test across jobs, filter them by job-name text, and retrieve raw failure output for debugging or similarity analysis.
Why use it?
It gathers failures and successful runs in one place, so you can inspect errors and compare whether different failures have the same underlying cause.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Fetch runs for a test across jobs, filter them by job-name text, and retrieve raw failure output for debugging or similarity analysis.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/wangke19/gemini-ai-helpers/fetch-test-runs
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add wangke19/gemini-ai-helpers --skill fetch-test-runs
Clone the repo
git clone --depth 1 https://github.com/wangke19/gemini-ai-helpers

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for Fetch Test Runs

README.md
[![agentmods](https://agentmods.dev/badge/skills/wangke19/gemini-ai-helpers/fetch-test-runs/github.svg)](https://agentmods.dev/skills/wangke19/gemini-ai-helpers/fetch-test-runs)
Your own site
<a href="https://agentmods.dev/skills/wangke19/gemini-ai-helpers/fetch-test-runs"><img src="https://agentmods.dev/badge/skills/wangke19/gemini-ai-helpers/fetch-test-runs/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for Fetch Test Runs

Your own site · 80×15
<a href="https://agentmods.dev/skills/wangke19/gemini-ai-helpers/fetch-test-runs"><img src="https://agentmods.dev/badge/skills/wangke19/gemini-ai-helpers/fetch-test-runs.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 18 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 4,036 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. A grade says what 26 rules found in the file — not that it is safe.
Origin 92% copy Near-identical to another mod in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00018 $0.04036
Opus 5 $0.00009 $0.02018
Sonnet 5 $0.00004 $0.00807
Haiku 4.5 $0.00002 $0.00404

Measured 10d ago against content hash 7ea136e6c4a4, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-10, from the pricing page.

Security

Grade A, and why

Fetch Test Runs scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 10d ago.

The scan reads SKILL.md. This mod also ships 1 executable file (fetch_test_runs.py), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

- Check: `curl -s https://sippy.dptools.openshift.org/api/tests/v2/runs?test_id=test`
Origin

This is a copy

92% identical to fetch-test-runs — 18 lines differ, which has more behind it and is treated as the original. This page carries a canonical link to it rather than competing with it.

extensions/ci/skills/fetch-test-runs/SKILL.md · 438 lines

How it starts

The opening of the file, as written. The whole thing — 438 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Fetch Test Runs

This skill fetches test runs from the Sippy API. It can return both failed and successful test runs, including JUnit output for AI-based analysis.

When to Use This Skill

Use this skill when you need to:

  • Fetch test run data for a specific test across all jobs
  • Get raw test failure outputs for AI-based similarity analysis
  • Compare error messages across runs to determine if they share the same root cause
  • Include successful runs in addition to failures (optional)
  • Filter runs by job name substrings (e.g., only GCP techpreview jobs)
  • Access JUnit test output for debugging and investigation

Prerequisites

  1. Network Access: Must be able to reach the Sippy test runs API

    • No authentication required
    • Check: curl -s https://sippy.dptools.openshift.org/api/tests/v2/runs?test_id=test
  2. Python 3: Python 3.6 or later

    • Check: python3 --version
    • Uses only standard library (no external dependencies)
  3. Input Data: Requires test_id (job_run_ids are optional)

    • Get from fetch-regression-details skill output
    • test_id: Found in regression data (e.g., "openshift-tests:71c053c318c11cfc47717b9cf711c326")
    • job_run_ids: Optional - extracted from sample_failed_jobs[].failed_runs[].job_run_id

Implementation Steps

Step 1: Run the Python Script

# Path to the Python script
script_path="extensions/ci/skills/fetch-test-runs/fetch_test_runs.py"

# Fetch all test runs (failures only, by default)
python3 "$script_path" "$test_id" --format json

# Include successful runs as well
python3 "$script_path" "$test_id" --include-success --format json

# Filter to a specific Prow job (exact name works as substring of itself)
python3 "$script_path" "$test_id" --job-contains "periodic-ci-openshift-release-..." --format json

# Filter by multiple substrings (AND logic, case-insensitive, server-side)
python3 "$script_path" "$test_id" --job-contains gcp --job-contains techpreview --format json

# Filter to specific job run IDs (backward compatible with analyze-regression)
python3 "$script_path" "$test_id" "$job_run_ids" --format json

# Get human-readable summary
python3 "$script_path" "$test_id" --format summary

Read the full file on GitHub · 438 lines

Files

What ships with it

2 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 10d ago First seen · 438 lines · 18 tokens per session scan A 7ea136e6c4a4

Subscribe to this mod's changes

Fetch Test Runs is a skill published in the GitHub repository wangke19/gemini-ai-helpers (2 stars, last pushed 5mo ago), licensed Apache-2.0. It adds 18 tokens to every session and 4,036 once invoked, about $0.0001 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). It is 92% identical to fetch-test-runs, differing in 18 lines, and is treated as a copy.

Related

Other skills, from other repositories

skillgrade-setup

Sets up and runs skillgrade evaluation pipelines for Agent Skills. Use when initializing eval configurations, running trials, reviewing results, or integrating with CI. Don't use for writing grader scripts, general test authoring, or non-agentic documentation.

mgechev/skillgrade · 52 tokens

onboard-repo

Index an unfamiliar codebase into the knowledge graph, then produce a first orientation map -- entry points, most-depended-upon modules, hotspots, test topology.

n24q02m/better-code-review-graph · 38 tokens

intuitive-tests

Use this skill whenever the user asks about unit test best practices, test organization, flat test suites, redundant tests, test refactors, pytest/JUnit/Jest/xUnit layout, test taxonomy, flaky tests, coverage quality, fixtures, mocks, parametrization, pruning existing UTs, or "which tests are worth keeping." It…

MiaoDX/intuitive-flow · 154 tokens

lov-fix-until-no-error

A verification-focused debugging workflow that repeatedly runs specified checks, fixes the highest-priority failure, and stops when the checks pass or a genuine external blockage remains.

lovstudio/skills · 48 tokens

exploit-xss

Cross-site scripting (XSS) vulnerability detection and exploitation. Supports reflected XSS, stored XSS, DOM-based XSS, and blind XSS testing. Use this skill when user mentions XSS, cross-site scripting, script injection, or needs to test JavaScript injection in parameters, forms, headers, or DOM sources.

crazyMarky/pentest-skills · 71 tokens

platform-pre-review

Platform Developer: Stage 4a pre-review task. Run lint, type-check, SCA, license check, security trigger, and hygiene checks. Produce pipeline/gates/stage-04a.json.

telus-labs/stagecraft · 45 tokens