Borrowing it
Nothing to install: this file belongs to mindroom-ai/mindroom. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.
curl -O https://raw.githubusercontent.com/mindroom-ai/mindroom/main/.claude/skills/live-test/SKILL.mdgit clone --depth 1 https://github.com/mindroom-ai/mindroomWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/mindroom-ai/mindroom/live-test)<a href="https://agentmods.dev/skills/mindroom-ai/mindroom/live-test"><img src="https://agentmods.dev/badge/skills/mindroom-ai/mindroom/live-test.svg" alt="Measured on agentmods" height="20"></a>- NVIDIA SkillSpector warn
SkillSpector: 1 finding, up to high
These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →
- high Rogue Agent · line 54 Skill modifies its own code, configuration, or behavior at runtime. Self-modification enables an agent to escalate privileges, disable safety constraints, or install persistent backdoors.Fix: Prevent the skill from modifying its own code, SKILL.md, or configuration files. Treat skill files as read-only at runtime.
What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00085 | $0.00679 |
| Opus 5 | $0.00043 | $0.00340 |
| Sonnet 5 | $0.00017 | $0.00136 |
| Haiku 4.5 | $0.00009 | $0.00068 |
Grade A, and why
live-test scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
How it starts
The opening of the file, as written. The whole thing — 56 lines — stays where its author put it; the contents beside it link to each section on GitHub.
Live Test
Run the real product and collect runtime evidence.
⚠️ NixOS Environment
On NixOS hosts, run commands inside the repo Node.js 24 dev shell so libstdc++.so.6 is available.
Without it, numpy fails to import and you get AttributeError: module 'mindroom' has no attribute 'bot'.
nix-shell shell.nix
# then run normally inside the shell:
uv run pytest ...
uv run mindroom run
If nix-shell shell.nix cannot resolve <nixpkgs>, use:
nix-shell -I nixpkgs=/nix/var/nix/profiles/per-user/root/channels/nixos shell.nix
See references/core-mindroom.md for details.
The root shell includes Linux Chromium only on Linux so the backend and Node.js tools also work on macOS.
Workflow
- Choose the surface you need to test.
- For the core MindRoom runtime, local Matrix, Matty, and bundled dashboard, read references/core-mindroom.md.
- For the core frontend screenshot flow, frontend-only dev server, SaaS sandbox, and platform frontend screenshots, read references/frontend-and-platform.md.
- Prefer isolated local runs when the worktree or machine is already busy.
- Existing local instances often collide on ports, Matrix usernames, room aliases, and dashboard API ports.
- If you see conflicts, create a temporary config, set a unique
MINDROOM_NAMESPACE, use a uniquemindroom_user.username, isolateMINDROOM_STORAGE_PATH, and choose a non-default--api-port. - If the isolated run writes a temporary
.env, inspect it before hitting authenticated/api/*routes because it may contain the instance-specificMINDROOM_API_KEY.
- Verify behavior, not just startup.
- For chat flows, send a real message and inspect the actual reply thread.
- For backend changes, hit the live endpoint on the same instance you started.
- For frontend changes, capture screenshots and inspect the generated PNGs.
- Preserve evidence.
- Record the exact command, port, room name, room ID, thread ID, and returned payload or screenshot path.
- Prefer Matty
--format jsonwhen you need stable confirmation. - If room aliases or thread listings are flaky, fall back to the concrete room ID from backend logs and direct
matty threadreads.
What ships with it
3 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 8d ago First seen · 56 lines · 85 tokens per session scan A d744eed8419d
live-test is a skill published in the GitHub repository mindroom-ai/mindroom (263 stars, last pushed today), licensed Apache-2.0. It adds 85 tokens to every session and 679 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.
Other skills, from other repositories
dogfood
Systematically explore and test a mobile app on iOS/Android with agent-device to find bugs, UX issues, and other problems. Use when asked to dogfood, QA, exploratory test, find issues, bug hunt, or test this app on mobile.
test-warp-ui
Guides testing Warp UI features and changes using the computer use tool. Use this skill only when computer-use testing was requested (explicit request or accepted offer) and the computeruse tool is available to the agent. Covers launching Warp and verifying UI behavior.
test-electron-app
Drive the real running PostHog Electron app (live tRPC, workspace-server, real data) over CDP with agent-browser. Connect to the running app on port 9222, test desktop changes against a local Django stack, snapshot the accessibility tree, inspect network requests, and screenshot only when explicitly asked. Use when…
pyats-dynamic-test
Generate and execute deterministic pyATS aetest validation scripts - interface state, OSPF neighbors, BGP paths, ping matrices, and custom compliance tests. Use when writing a network test, validating post-change state, running pass/fail checks, or building automated regression tests.
trailblaze
Use when working with Trailblaze — natural-language device control for coding agents across iOS, Android, and web, with replayable .trail.yaml files as the artifact. Trigger on mentions of Trailblaze, the trailblaze CLI, .trail.yaml files, trailmaps, waypoints, or requests to drive / author / debug / run UI tests on…
Detox Mobile Testing
Gray-box end-to-end testing for React Native apps with Detox. Covers .detoxrc.js configuration, build and test commands, matchers, device.launchApp control, automatic synchronization, and macOS CI pipelines.