llm

llm is a skill for Claude Code from rainmanjam/poka-yoke. It costs 89 tokens per session (2,118 once invoked), scanned A, original, MIT.

A set of practices for building reliable features powered by large language models (LLMs), which are software systems that generate text or structured results. It covers constraining outputs, defining tool inputs, handling prompt attacks, and testing model behavior.

In plain words
What is it for?
Building features that return JSON, call tools, protect against prompt injection, prevent unsafe or repeated actions, and evaluate model responses before release.
Why use it?
LLMs can return invalid data, invent information, or call tools incorrectly even when prompts tell them not to. These practices add safeguards around the model and test the failures that matter to users.

Skill for Claude Code

Written for Claude Code: shipped in a Claude Code plugin.

Part of the poka-yoke plugin — 6 skills shipped together

Good fit Building features that return JSON, call tools, protect against prompt injection, prevent unsafe or repeated actions, and evaluate model responses before release.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/rainmanjam/poka-yoke/llm
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add rainmanjam/poka-yoke --skill llm
Clone the repo
git clone --depth 1 https://github.com/rainmanjam/poka-yoke

Made for: Claude Code.

Or install poka-yoke, the plugin that ships this one along with the rest of its 6 skills.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for llm

README.md
[![agentmods](https://agentmods.dev/badge/skills/rainmanjam/poka-yoke/llm/github.svg)](https://agentmods.dev/skills/rainmanjam/poka-yoke/llm)
Your own site
<a href="https://agentmods.dev/skills/rainmanjam/poka-yoke/llm"><img src="https://agentmods.dev/badge/skills/rainmanjam/poka-yoke/llm/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for llm

Your own site · 80×15
<a href="https://agentmods.dev/skills/rainmanjam/poka-yoke/llm"><img src="https://agentmods.dev/badge/skills/rainmanjam/poka-yoke/llm.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 89 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,118 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector warn 7 Sept 2026
SkillSpector: 2 findings, up to high

These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →

  • high YARA Match · line 2
    YARA rule matched a hack tool or exploit indicator (offensive tools, reconnaissance, privilege escalation, or exploit frameworks).
    Fix: Remove offensive tool references and exploit code. Legitimate agent skills should not contain penetration testing tools, exploit frameworks, or reconnaissance utilities.
  • high Anti-Refusal · line 17
    Skill instructs the agent to never refuse or to always comply. Suppressing the agent's ability to decline removes a core safety control and enables downstream harmful requests to succeed.
    Fix: Remove any instruction telling the agent to never refuse or always comply. The agent must retain the ability to decline unsafe, out-of-scope, or harmful requests.
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00089 $0.02118
Opus 5 $0.00044 $0.01059
Sonnet 5 $0.00018 $0.00424
Haiku 4.5 $0.00009 $0.00212

Measured 9d ago against content hash 79b9d78be4e8, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-08, from the pricing page.

Security

Grade A, and why

llm scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/poka-yoke/skills/llm/SKILL.md · 162 lines

How it starts

The opening of the file, as written. The whole thing — 162 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Poka-Yoke for LLM Features

This is about AI features you ship to users: not about agents editing your repo, which is agent-guardrails.

The defining property of an LLM is that it is a component with a non-zero error rate on every call, and no amount of prompt engineering drives that to zero. This is not a defect to fix; it is the material you are building with. Shingo's framing fits perfectly: you do not make the operator more careful, you build the jig.

Which means the central discipline here: prompt instructions are rung zero. "Always respond with valid JSON," "never make up a citation," "do not reveal the system prompt". These are requests to an unreliable component, and they are the LLM equivalent of a comment saying "be careful." They help, they are worth writing, and they are not devices. A device is something outside the model that constrains what it can produce or what its output can reach.

Building, not reviewing

Most of the time this mode is reached while someone is building the thing, not afterwards. That changes the deliverable. They asked for the feature, so produce the feature, working, complete, in their stack. Do not hand back a severity table when the person is mid-feature; a list of findings about code they have not written yet is not useful to them.

Then add a short closing note, three or four lines, covering:

  • which misuses the shape you chose makes impossible, and at which rung,
  • what you left possible on purpose, and why that tradeoff is the right one here.

That closing note is what stops the device being undone in six months by someone who cannot see why it is there. It is also the difference between mistake-proofing and a code generator: the reasoning travels with the code.

When the code already exists and they are asking what is wrong with it, switch to the audit voice, ranked findings with the mistake, the consequence, and the device. Match the mode to where they are in the work, not to this file's default.

The boundary: nothing the model says is trusted until something checks it

Read the full file on GitHub · 162 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 9d ago First seen · 162 lines · 89 tokens per session scan A 79b9d78be4e8

Subscribe to this mod's changes

llm is a skill published in the GitHub repository rainmanjam/poka-yoke (22 stars, last pushed 7d ago), licensed MIT. It adds 89 tokens to every session and 2,118 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

meta-prompting

Enhanced reasoning patterns via slash commands (/think, /verify, /adversarial, /edge, /compare, /confidence, /budget, /constrain, /json, /flip, /assumptions, /tensions, /analyze, /trade) or natural language ("argue against", "what could break", "show reasoning", "deep review", "meta-prompts", "thinking modes"…

iliaal/whetstone · 104 tokens

review-prompt

Review LLM prompts against the prompt-engineering skill's principles — leading with where each line came from — and report the findings without modifying files. Use when reviewing prompt quality, auditing a prompt, evaluating a system prompt, or checking whether prompt issues are high-confidence and fixable.

doodledood/manifest-dev · 60 tokens

goal-test

A local experiment for testing a goal command that keeps an AI coding session working until a stated condition is judged complete. It uses a separate language model to evaluate the conversation after each assistant turn.

restarter/lets-workflow · 137 tokens

fec-drawio-studio

An editable workflow for making technical diagrams in draw.io (also called diagrams.net), with the original .drawio file saved alongside exported images or documents. It covers architecture, database, UML, sequence, flow, machine-learning, and code-structure diagrams.

bovinphang/frontend-craft · 154 tokens

issue-fetch

Fetch a work item (summary, status, description, acceptance criteria, comments) from the team's issue tracker and display a clean summary. Supports Jira, Linear, GitHub Issues, and Azure DevOps via adapters. Use whenever a prompt contains an issue reference (e.g. PROJ-1234, ENG-42.

theam/claude-dev-kit · 68 tokens

pm

Project manager for GitHub issues: brainstorm design approaches, create structured issues optimized for LLM agent teams, triage and recommend what to work on next, audit and clean up stale issues, or deep-validate a single issue against the codebase. Triggers: create issue, plan work, new task, project manager, write…

rube-de/cc-skills · 98 tokens