test-reporting

test-reporting is a cursor rule for Cursor from katalon-labs/true-skills. It costs 177 tokens per session (5,862 once invoked), scanned A, original, MIT.

A set of instructions for reporting Katalon True Platform/TestOps testing results to people outside the quality-assurance team.

In plain words
What is it for?
Use it to report coverage, test execution health, defects, risk, stability, and configuration coverage with clear details about what each number measures.
Why use it?
It turns testing data into evidence-based answers instead of an unexplained list of metrics, and shows trends across releases, sprints, or other work periods.

Cursor rule for Cursor

Written for Cursor: installed under .cursor/.

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add rules/katalon-labs/true-skills/test-reporting
Clone the repo
git clone --depth 1 https://github.com/katalon-labs/true-skills

Made for: Cursor.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for test-reporting

README.md
[![agentmods](https://agentmods.dev/badge/rules/katalon-labs/true-skills/test-reporting.svg)](https://agentmods.dev/rules/katalon-labs/true-skills/test-reporting)
Your own site
<a href="https://agentmods.dev/rules/katalon-labs/true-skills/test-reporting"><img src="https://agentmods.dev/badge/rules/katalon-labs/true-skills/test-reporting.svg" alt="Measured on agentmods" height="20"></a>
Per session 177 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 5,862 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00177 $0.05862
Opus 5 $0.00088 $0.02931
Sonnet 5 $0.00035 $0.01172
Haiku 4.5 $0.00018 $0.00586

Measured 6d ago against content hash 430baa0a07db, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-06, from the pricing page.

Security

Grade A, and why

test-reporting scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 6d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.cursor/rules/test-reporting.mdc · 342 lines

How it starts

The opening of the file, as written. The whole thing — 342 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Katalon Test Reporting

Use this skill when someone outside QA asks a question about quality and the answer has to survive being asked where it came from. It reads the analyze stage and feeds the plan stage. The output is an answer with the named specifics behind it, never a metric dump. release-analyze judges one release; this skill reports the direction across several and writes what a manager says out loud.

Availability Boundary

State the boundary before promising a report, because most of what "reporting" normally means is not an MCP call.

  • Available via MCP. The metric surface: fetch_requirement_data (coverage status), fetch_test_case_data (case quality signals), fetch_test_stability_data (flakiness), fetch_test_configuration_data (configuration coverage), fetch_defect_data (defect status and context), find_test_results / read_execution / read_execution_test_results (execution history, and the only data that carries its own dates), find_iterations (the period spine), and list_projects / list_repositories / find_test_suites / read_test_suite / find_test_cases to establish what each number is counted over.
  • Not directly available, and no tool exists to add.
    • No trend or aggregation tool. Nothing in the MCP returns a series, an average, or a delta. Every trend here is assembled by looping periods yourself.
    • No point-in-time read. Every fetch_*_data tool returns current state. You cannot ask what requirement coverage was at release 3.0. Only execution records carry dates.
    • No dashboard, chart, or report entity. Dashboards are a TestOps UI surface. This skill writes text and a snapshot file, nothing else.
    • No publishing surface. The MCP cannot post to Slack, Confluence, email, or a deck. Hand the written brief back to the user and let them place it.
    • No Release or Build entity. Bind periods to iterations via find_iterations, or to explicit date ranges. Never to a release object.
    • No escaped-defect flag. fetch_defect_data returns status and context, not whether a defect reached production. Ask the user which ALM field classifies it. If there is none, report "defects opened after the release run" and label it as a proxy.
    • No effort, cost, headcount, or cycle-time data. That is the test-estimation gap. Say so and stop. Never estimate effort from test counts.
    • No custom fields or tags. Any team dimension (component, squad, product line) has to come from folder or suite structure, or from the user.
  • The workaround that makes trending real. A snapshot file written on every run, plus the execution-dated series that needs no snapshot. See references/snapshot-and-trend.md. The first run establishes a baseline and says so instead of inferring a direction.

Read the full file on GitHub · 342 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 6d ago First seen · 342 lines · 177 tokens per session scan A 430baa0a07db

Subscribe to this mod's changes

test-reporting is a cursor rule published in the GitHub repository katalon-labs/true-skills (7 stars, last pushed 11d ago), licensed MIT. It adds 177 tokens to every session and 5,862 once invoked, about $0.0009 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.