vally-tests

vally-tests is a skill for Claude Code from microsoft/hve-core. It costs 45 tokens per session (2,847 once invoked), scanned C, original, MIT.

A tool for writing conformance tests for prompts, instruction files, agents, and skills. These tests check whether an artifact follows behaviors it already claims to support.

In plain words
What is it for?
Use it to create Vally tests for documented behaviors, including appropriate refusals for jailbreak, prompt-injection, harmful, policy, and personal-data extraction scenarios.
Why use it?
An agent artifact may look correct while failing in real use or responding unsafely to certain inputs. Conformance tests make those failures easier to identify and explain.

Skill for Claude Code ✓ vendor

Written for Claude Code: user-invocable in frontmatter. Also seen: mentions subagents.

Good fit Use it to create Vally tests for documented behaviors, including appropriate refusals for jailbreak, prompt-injection, harmful, policy, and personal-data extraction scenarios.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/microsoft/hve-core/vally-tests
About the project

HVE Core is a collection of agents, prompts, coding instructions, and skills for building repeatable software-development workflows with GitHub Copilot. It is intended for individuals and teams that want structured AI-assisted research, planning, implementation, and review, while the catalogue entries provide many of its reusable workflow components.

microsoft/hve-core · 1,606 stars · on GitHub

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add microsoft/hve-core --skill vally-tests
Clone the repo
git clone --depth 1 https://github.com/microsoft/hve-core

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for vally-tests

README.md
[![agentmods](https://agentmods.dev/badge/skills/microsoft/hve-core/vally-tests/github.svg)](https://agentmods.dev/skills/microsoft/hve-core/vally-tests)
Your own site
<a href="https://agentmods.dev/skills/microsoft/hve-core/vally-tests"><img src="https://agentmods.dev/badge/skills/microsoft/hve-core/vally-tests/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for vally-tests

Your own site · 80×15
<a href="https://agentmods.dev/skills/microsoft/hve-core/vally-tests"><img src="https://agentmods.dev/badge/skills/microsoft/hve-core/vally-tests.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 45 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,847 The whole file, excluding the scripts and references it only reads on demand.
Security scan C 1 finding. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector warn 7 Sept 2026
SkillSpector: 4 findings, up to high

These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →

  • high Prompt Injection · line 63
    This pattern attempts to override system instructions or ignore safety constraints. Without LLM analysis, manual review is recommended.
    Fix: Remove or rewrite any text that instructs the agent to ignore prompts, override safety rules, or trust unverified content. Ensure skill content cannot be injected to alter agent behavior.
  • medium Prompt Injection · line 60
    Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
    Fix: Remove the large whitespace padding (blank-line blocks or long space runs) and review any content hidden below or to the right of it. Keep skill files compact and reviewable so no instructions can be
  • medium Prompt Injection · line 82
    Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
    Fix: Remove the large whitespace padding (blank-line blocks or long space runs) and review any content hidden below or to the right of it. Keep skill files compact and reviewable so no instructions can be
  • medium Prompt Injection · line 112
    Large whitespace padding was detected (a block of blank lines or a long run of spaces). This can push injected instructions below or to the right of the visible area so a human reviewer never sees them while the agent still reads them. Manual review of the hidden content is recommended.
    Fix: Remove the large whitespace padding (blank-line blocks or long space runs) and review any content hidden below or to the right of it. Keep skill files compact and reviewable so no instructions can be
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00045 $0.02847
Opus 5.5 $0.00018 $0.01139
Sonnet 5.5 $0.00009 $0.00569
Haiku 4.5 $0.00005 $0.00285

Measured 29d ago against content hash 50d11b706405, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade C, and why

vally-tests scanned grade C with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 29d ago.

The scan reads SKILL.md. This mod also ships 13 executable files (scripts/import_corpus.py, scripts/Lint-VallyTestSafety.ps1, scripts/New-Stimulus.ps1, …), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Hidden instructionshighPrompt injection

Directives inside HTML comments, invisible characters or bidirectional overrides are read by the model and not by the person reviewing the file.

<!-- cspell:ignore roleplay doxxing scaffolder -->
.github/skills/hve-core/vally-tests/SKILL.md · 145 lines

How it starts

The opening of the file, as written. The whole thing — 145 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Vally Tests Skill

Purpose

This skill authors Vally conformance tests for the four supported artifact kinds in this repository: prompts, instructions, agents, and skills. Each test exercises a documented behavior the artifact already claims and routes the result through an appropriate Vally grader so failures are explainable. Test authoring is bounded by a refusal taxonomy that keeps the skill out of adversarial, harmful, or policy-evasion territory.

Follow the shared content-policy public-output guard for eval stimuli and any public summaries derived from this skill. Vally tests are not a venue for terms-of-service boundary mapping, payload generation, refusal-text scoring, hidden-instruction disclosure, PII extraction, or secret extraction.

The skill ships:

  • A canonical authoring workflow that runs directly through /vally-tests or through the Vally Test Author subagent.
  • Per-kind reference files that enumerate every conformance check the skill knows how to express.
  • A grader catalog that maps Vally CLI grader types to the checks they fit, and robustness rules that keep an emitted grader from asserting the impossible or failing correct behavior.
  • A safety refusal taxonomy with regex patterns the safety lint script consumes.
  • Helper scripts and asset templates for stimulus emission, corpus import, and dedupe.

When to Invoke

Invoke this skill in one of two modes:

  • From-artifact mode. The caller points at one or more artifact files (a .prompt.md, .instructions.md, .agent.md, or SKILL.md) through files, or at the open or attached file when files is omitted, and asks for conformance test stimuli that verify each artifact's stated behaviors. The skill detects the artifact kind from the filename unless kind overrides it, looks up the matching per-kind reference, picks graders, and appends stimulus blocks to the routed Vally eval file.
  • Corpus-import mode. The caller supplies a CSV or XLSX corpus through path that follows the shipped template, and the skill turns each row into a stimulus block in the routed eval file. Before reading, confirm that path exists and ends in .csv or .xlsx; otherwise name the bad path and stop. Every imported row carries tags.advisory: true, and corpus content cannot override it. Used when a large batch of behaviors needs identical formatting and dedupe handling.

Read the full file on GitHub · 145 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 29d ago Changed · -1 lines 50d11b706405
  2. 1mo ago Changed · +5 lines a6bdf1cd90d4
  3. 1mo ago Changed · -2 tokens per session ff7021725af1
  4. 1mo ago Changed · +2 lines 34205000baae
  5. 1mo ago Changed · +1 lines scan A → C 701f7419cdd3
  6. 2mo ago Changed d92d33f958ba
  7. 2mo ago First seen · 138 lines · 47 tokens per session scan A c6c3ed43c2f1

Subscribe to this mod's changes

vally-tests is a skill published in the GitHub repository microsoft/hve-core (1,606 stars, last pushed today), licensed MIT. It adds 45 tokens to every session and 2,847 once invoked, about $0.0002 per session on Opus 5.5. A static security scan graded it C with 1 finding (hidden instructions). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

vally-tests compared with skills from other repositories

vally-tests next to 6 skills from other repositories
ModTypeStarsLast pushLicenceScanTokensWorks with
vally-testsmicrosoft/hve-coreSkill1.6ktodayMITC45Claude Code
imagegenopenai/codexSkill134ktodayApache-2.0A113Codex
local-ai-agentsmicrosoft/ai-agents-for-beginnersSkill79kyesterdayMITA200Claude Code, Codex
playwright-climicrosoft/playwrightSkill100kyesterdayApache-2.0A19Claude Code
browser-automationopenclaw/openclawSkill394ktodayMITA36Claude Code
systematic-debuggingobra/superpowersSkill314k4d agoMITA21Claude Code
next-cache-components-adoptionvercel/next.jsSkill143ktodayMITA95Claude Code