qa-e2e-operations

A live-cluster test guide for checking whether MCP Runtime operations work in a real Kind Kubernetes cluster. It focuses on the operator, command-line tools, setup, deployments, registry pulls, networking, and monitoring.

In plain words
What is it for?
Use it to verify operator reconciliation, custom resource updates, CLI flows, test-mode setup, image pulls, rollout health, ingress wiring, observability, and cluster health.
Why use it?
It finds operational failures that code-level tests may miss, such as resources not becoming ready, broken rollouts, failed ingress, or an unhealthy cluster.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/agent-hellboy/mcp-runtime/qa-e2e-operations
Any agent
npx skills add Agent-Hellboy/mcp-runtime --skill qa-e2e-operations
Clone the repo
git clone --depth 1 https://github.com/Agent-Hellboy/mcp-runtime

Made for: Claude Code, Codex.

Per session 106 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 3,168 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00106 $0.03168
Opus 5 $0.00053 $0.01584
Sonnet 5 $0.00021 $0.00634
Haiku 4.5 $0.00011 $0.00317

Measured 2d ago against content hash 41a641b79d21, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

qa-e2e-operations scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl -fsS -o /dev/null -w "%{http_code}\n" http://localhost:18080/ # 200
.codex/skills/qa-e2e-operations/SKILL.md · 297 lines

How it starts

The opening of the file, as written. The whole thing — 297 lines — stays where its author put it; the contents beside it link to each section on GitHub.

QA — E2E Operations (live cluster)

Overview

This skill validates operations: does the operator reconcile, does the CLI behave, does setup --test-mode produce a working stack, do rollouts land, do CRD updates converge, does cluster doctor stay green under change? It runs against the real Kind cluster brought up by qa-cluster-bringup, not envtest. For code-level unit/golden/envtest checks the contributor should run go test directly per CLAUDE.md — this skill exists to catch the regressions those tests miss.

Regression evidence contract: every successful report must include live cluster doctor, rollout/pod status, and the cached Kind smoke-auth,governance traffic gate unless the diff is explicitly docs-only. If the live cluster or traffic gate cannot run, mark the operations result blocked, not passed.

Step 1 — Confirm precondition

kubectl config current-context | grep -qx kind-mcp-runtime \
  || { echo "Run qa-cluster-bringup first"; exit 1; }
./bin/mcp-runtime cluster doctor

If cluster doctor is not green, hand back to qa-cluster-bringup rather than firing checks at a broken cluster.

Step 2 — Choose mode

  • head-only. Run the full operational matrix below.
  • git-range (BASE=<merge-base>, default origin/main). Reduce the matrix to the surfaces the diff touches.

Mode dispatch by changed paths:

Diff touches Required sub-suites
internal/operator/**, api/v1alpha1/**, config/crd/** Operator, CRD reconciliation, ingress, generated-file drift
cmd/operator/**, cmd/mcp-runtime/**, internal/cli/** CLI smoke, generated-file drift
internal/cli/setup/**, pkg/k8sclient/**, pkg/manifest/**, pkg/metadata/** Setup re-run, registry pulls, ingress, rollout
services/platform-api/**, services/runtime-api/**, services/analytics-api/**, services/ui/**, services/ingest/**, services/processor/**, services/mcp-gateway/** Service rollout matrix, gateway sidecar refresh
k8s/**, config/** Manifest re-apply + rollout
docs/** only Skip — not an operations regression surface

Read the full file on GitHub · 297 lines

Files

What ships with it

3 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago First seen · 297 lines · 106 tokens per session scan A 41a641b79d21

Subscribe to this mod's changes

qa-e2e-operations is a skill published in the GitHub repository Agent-Hellboy/mcp-runtime (5 stars, last pushed 8d ago), licensed Apache-2.0. It adds 106 tokens to every session and 3,168 once invoked, about $0.0005 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

local-frontend-check

Smoke-test or verify UI behaviour on the local Jarvis Registry frontend running at http://localhost/gateway. Use for manual regression checks, bug-fix verification, and end-to-end confirmation of specific flows without running the automated test suite.

ascending-llc/jarvis-registry · 52 tokens

playwright-e2e-testing

Playwright modern end-to-end testing framework with cross-browser automation, auto-wait, and built-in test runner.

activepieces/activepieces · 29 tokens

webmcp-e2e

WebMCP reverse connection gateway(pairing + static/remote モード)の E2E 結合確認を実行する。Manifold 起動 → デモページ → 拡張入り Chromium → ペアリング → tools/call 検証 → タブクローズ時エラー確認までを通し、スクリーンショット証跡を残す。remote モードでは自前 JWKS + JWT で identityKey ルーティングの分離も検証する。「webmcp の E2E」「reverse gateway の動作確認」「拡張の結合テスト」で使用。.

nonchan7720/manifold · 140 tokens

qa-use

E2E testing and browser automation with qa-use CLI. Use when the user needs to run tests, verify features, automate browser interactions, or debug test failures.

desplega-ai/qa-use · 36 tokens

use-agent-browser-for-airi

Test AIRI display-model imports with agent-browser across stage-tamagotchi Electron, stage-web, and stage-pocket mobile web layouts. Use when uploading and verifying contributor-supplied Live2D ZIP, VRM, or MMD ZIP/PMX/PMD files through AIRI's model selector, including onboarding bypass, format-specific import…

moeru-ai/airi · 87 tokens

test-conversion

Workflow for converting unit tests to browser tests for Project Bedrock. Invoke this when the user wants to remove complex Browser dependencies from tests.

chromium/chromium · 31 tokens