A testing task focused first on unit and command tests with pytest, Python’s testing tool, and then on integration tests that check connected parts of an application. It includes rules for rerunning flaky integration failures and inspecting screenshots for visual failures.

Use it to run the project’s tests, investigate failures, update tests first when appropriate, and check development pages or test screenshots for visual issues.

It provides a focused process for finding and fixing test failures while avoiding unrelated service or browser problems.

fix-tests — Skill for Claude Code and Codex by iloveitaly

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent

npx skills add iloveitaly/llm-ide-rules --skill fix-tests

Clone the repo

git clone --depth 1 https://github.com/iloveitaly/llm-ide-rules

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

README.md

[![agentmods](https://agentmods.dev/badge/skills/iloveitaly/llm-ide-rules/fix-tests/github.svg)](https://agentmods.dev/skills/iloveitaly/llm-ide-rules/fix-tests)

Your own site

<a href="https://agentmods.dev/skills/iloveitaly/llm-ide-rules/fix-tests"><img src="https://agentmods.dev/badge/skills/iloveitaly/llm-ide-rules/fix-tests/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

Your own site · 80×15

<a href="https://agentmods.dev/skills/iloveitaly/llm-ide-rules/fix-tests"><img src="https://agentmods.dev/badge/skills/iloveitaly/llm-ide-rules/fix-tests.svg" alt="Reviewed on agentmods" width="80" height="20"></a>

Per session 5 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.

When invoked 286 The whole file, excluding the scripts and references it only reads on demand.

Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.

Origin original No closer match found in the catalogue.

Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

Model	Per session	Once invoked
Fable 5.1	$0.00005	$0.00286
Opus 5	$0.00003	$0.00143
Sonnet 5	$0.00001	$0.00057
Haiku 4.5	$0.00001	$0.00029

Measured 9d ago against content hash d19a3c55944f, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-09, from the pricing page.

Security

Grade A, and why

fix-tests scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.agents/skills/fix-tests/SKILL.md · 25 lines

What it actually says

Fix Tests

Focus on all unit + command tests (pytest --exclude tests/integration). Make sure they pass and fix errors. If you run into anything very odd: stop, and let me know. Mutate test code first and let me know if you think you should update application code.

Then, focus on integration tests in tests/integration. If an integration test fails, run it again just to be sure it wasn't a flakey test (integration tests are not deterministic). If it fails because of a visual error, check the 'tmp/test-results/playwright/' directory for a screenshot relating to the failing test that you can inspect.

For additional debugging help, view the development version of the site at $PYTHON_TEST_SERVER_HOST using a browser.

Do not attempt to perform this task in a sandbox. Service connections require access to host networking.

If you get stuck or seem to be in a loop, give me a short summary of exactly where you are running into trouble, let me know, and stop working.

Do not attempt to solve these issues:

just, direnv, and js_build should always run or exist.
Chromium/Chrome/playwright not working properly.
Postgres, Redis, or other service connection errors.

If you run into errors, stop immediately and let me know with a summary of the problem.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

9d ago First seen · 25 lines · 5 tokens per session scan A d19a3c55944f

Subscribe to this mod's changes

fix-tests is a skill published in the GitHub repository iloveitaly/llm-ide-rules (13 stars, last pushed yesterday), licensed MIT. It adds 5 tokens to every session and 286 once invoked, about $0.0000 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

LLM Prompting Testing automation copilot cursor instructions

create-skill-test

Scaffolds eval.yaml test files for agent skills in the dotnet/skills repository. Use when creating skill tests, writing evaluation scenarios, defining assertions and rubrics, or setting up test fixture files. Handles eval.yaml generation, fixture organization, and overfitting avoidance. Do not use for running or…

aboalrejal-ai/skills · 75 tokens

code-testing-agent

Generates and writes new unit tests for any programming language using a Research-Plan-Implement pipeline. Use when asked to generate tests, write unit tests, add tests, improve test coverage, create test project, achieve high coverage, comprehensive tests, or asked to scaffold a new test project for an app, service…

aboalrejal-ai/skills · 190 tokens

agent-platform-prompt-management

Manages and orchestrates prompts in Agent Platform. Use when you need to create, list, retrieve, version, or delete managed prompts in Agent Platform. Don't use for model training, model deployment to endpoints, or managing non-Agent Platform prompts.

aboalrejal-ai/skills · 55 tokens

llm-application-dev-prompt-optimize

You are an expert prompt engineer specializing in crafting effective prompts for LLMs through advanced techniques including constitutional AI, chain-of-thought reasoning, and model-specific optimizati.

aboalrejal-ai/skills · 44 tokens

arize-prompt-optimization

Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations. Extracts prompts from spans, gathers performance signal, and runs a data-driven optimization loop using the ax CLI. Use when the user mentions optimize prompt, improve prompt, make AI respond better, improve output…

aboalrejal-ai/skills · 81 tokens

gemini-interactions-api

Use this skill when writing code that calls the Gemini API for text generation, multi-turn chat, multimodal understanding, image generation, streaming responses, background research tasks, function calling, structured output, or migrating from the old generateContent API. This skill covers the Interactions API, the…

aboalrejal-ai/skills · 77 tokens