DeepSeek Harness is an open-source framework for building and running AI agents, organized so that its functionality is provided through plugins. Developers use it to launch agent workflows through a local web interface or from source, while the catalogue add-ons extend the harness as plugins.
Borrowing it
Nothing to install: this file belongs to deepseek-ai/deepseek-harness. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.
curl -O https://raw.githubusercontent.com/deepseek-ai/deepseek-harness/master/.agents/skills/dsh-ci-test-reliability/SKILL.mdgit clone --depth 1 https://github.com/deepseek-ai/deepseek-harnessWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/deepseek-ai/deepseek-harness/dsh-ci-test-reliability)<a href="https://agentmods.dev/skills/deepseek-ai/deepseek-harness/dsh-ci-test-reliability"><img src="https://agentmods.dev/badge/skills/deepseek-ai/deepseek-harness/dsh-ci-test-reliability/github.svg" alt="Measured on agentmods" height="20"></a>Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.
<a href="https://agentmods.dev/skills/deepseek-ai/deepseek-harness/dsh-ci-test-reliability"><img src="https://agentmods.dev/badge/skills/deepseek-ai/deepseek-harness/dsh-ci-test-reliability.svg" alt="Reviewed on agentmods" width="80" height="20"></a>- Snyk pass
- NVIDIA SkillSpector pass
What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00083 | $0.01855 |
| Opus 5.5 | $0.00033 | $0.00742 |
| Sonnet 5.5 | $0.00017 | $0.00371 |
| Haiku 4.5 | $0.00008 | $0.00186 |
Grade A, and why
dsh-ci-test-reliability scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 13d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
Copies of this mod
4 near-identical copies found in the catalogue:
- dsh-ci-test-reliability — 100% identical, 2 lines differ
- dsh-ci-test-reliability — 100% identical, 2 lines differ
- alego-ci-test-reliability — 94% identical, 10 lines differ
- yq-stable-tests — 91% identical, 15 lines differ
How it starts
The opening of the file, as written. The whole thing — 132 lines — stays where its author put it; the contents beside it link to each section on GitHub.
Reliable DSH CI tests
Build tests that remain correct under the repository's real CI topology, not only when run alone on a quiet workstation. This skill owns isolation and reliability decisions; it does not replace the repository's test-tier policy or select every command for a push.
Read the owning rules
- Use the testing policy to select unit, coverage, expected-output, snapshot, browser, or real-API evidence.
- Use the defensive patterns for lifecycle, subprocess, cancellation, and teardown behavior.
- Read the active Vitest config and GitHub workflow when their worker or job topology affects the test.
- For recorded-session scenarios, also follow the snapshot instructions.
- Use dsh-pre-push-checks after the test design is sound to select outgoing validation.
Model the execution topology
Assume these layers can overlap unless the active configuration proves otherwise:
- Tests in one Vitest file.
- Separate Vitest files or worker processes.
- Independent Vitest or repository-gate processes in one job.
- Different Actions jobs whose runners share one host.
Process isolation does not isolate host ports, predictable filesystem paths, external services, databases, sockets, or inherited child processes. For every acquired resource, identify its owner, atomic allocation mechanism, observable readiness signal, registered cleanup, and quiescent completion signal.
Do not serialize an entire suite merely because one fixture lacks isolation. Narrow the exclusive scope or change the resource allocation first. A sequential Vitest block cannot protect a host resource from another file, process, job, or runner.
Allocate resources atomically
Use the resource owner's allocator instead of checking availability and claiming it later.
- Network fixtures bind loopback with
listen(0)and read the assigned address only after the server reports that it is listening. Never scan for a free port and bind it later. - Create private per-test temporary roots with
mkdtemp; do not acquire predictable shared paths. - Give shared databases, sockets, sessions, and output locations unique per-test namespaces.
- Use exclusive creation where a path must not already exist.
- Keep stable recorded identifiers separate from ephemeral transport addresses. Translate inside the fixture instead of forcing the live resource to use the recorded value.
What ships with it
1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 13d ago Changed 6ed044071327
- 1mo ago First seen · 132 lines · 83 tokens per session scan A 58e5de5c9cf7
dsh-ci-test-reliability is a skill published in the GitHub repository deepseek-ai/deepseek-harness (263,696 stars, last pushed 4d ago), licensed MIT. It adds 83 tokens to every session and 1,855 once invoked, about $0.0003 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.
Other skills, from other repositories
e2e-testing
Playwright E2E testing patterns, Page Object Model, configuration, CI/CD integration, artifact management, and flaky test strategies. Use when writing Playwright tests, structuring page objects, or fixing flaky E2E runs in CI.
browser-qa
Use this skill to automate visual testing and UI interaction verification using browser automation after deploying features.
tdd
Test-driven development. Use when the user wants to build features or fix bugs test-first, mentions "red-green-refactor", or wants integration tests.
manage-taskboard
Manage work in the native DeepSeek Harness Taskboard with exact task ids and optimistic versions. Use when an Agent must inspect project work, claim an eligible todo, record progress or blockers, verify an implementation, submit it for human review, or release its own claim; also use when a human asks how to accept…
company-research-method
A documented process for researching a company using supplied files and selected public sources. It produces a company overview with business details, sourced financial figures, and stated risks.
industry-research-method
A Chinese-language method for researching an industry by mapping its supply chain, tracking policies and news, and writing sourced reports. It separates the chain into upstream inputs, midstream production, and downstream distribution or use.