release-serving-image

release-serving-image is a skill for Claude Code, Codex from cloudrift-ai/emmy. It costs 94 tokens per session (4,801 once invoked), scanned C, original, Apache-2.0.

A release process for building and publishing a prebuilt model-serving image, which is a packaged environment for running one machine-learning model on a chosen GPU.

In plain words
What is it for?
Use it to release one model image for a specific GPU, serving setup, engine version, and model configuration.
Why use it?
It checks that the image fits the target hardware, matches the expected model behavior, and passes warm-up and offline checks before publication.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/cloudrift-ai/emmy/release-serving-image
Any agent
npx skills add cloudrift-ai/emmy --skill release-serving-image
Clone the repo
git clone --depth 1 https://github.com/cloudrift-ai/emmy

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for release-serving-image

README.md
[![agentmods](https://agentmods.dev/badge/skills/cloudrift-ai/emmy/release-serving-image.svg)](https://agentmods.dev/skills/cloudrift-ai/emmy/release-serving-image)
Your own site
<a href="https://agentmods.dev/skills/cloudrift-ai/emmy/release-serving-image"><img src="https://agentmods.dev/badge/skills/cloudrift-ai/emmy/release-serving-image.svg" alt="Measured on agentmods" height="20"></a>
Per session 94 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 4,801 The whole file, excluding the scripts and references it only reads on demand.
Security scan C 1 finding. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00094 $0.04801
Opus 5 $0.00047 $0.02400
Sonnet 5 $0.00019 $0.00960
Haiku 4.5 $0.00009 $0.00480

Measured today against content hash a3b9bf5dcda6, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade C, and why

release-serving-image scanned grade C with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured today.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Recursive force deletehighDestructive command

rm -rf with a variable or a broad path is one typo away from removing the wrong tree.

`rm -rf venv` before the bake — nothing after the warm needs it.
.agents/skills/release-serving-image/SKILL.md · 283 lines

How it starts

The opening of the file, as written. The whole thing — 283 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Release a prebuilt serving image for one model

The steps, their rationale, and the cache-key parity contract live in docker/vllm-emmy-serve/ARCHITECTURE.md — read it first; this skill does not restate it. What the skill adds is orchestration: model and mode selection, detached execution that survives SSH drops, hard PASS/FAIL gates that abort-and-teardown instead of rationalizing past a bad signal, the headroom-sweep policy that finalizes the model config, secret hygiene for the push, and the release side-effects.

The recipe is the publication input. Resolve exactly one model.huggingface, one concrete engine image, one hardware target, and one serving shape before provisioning; reject experiment grids or multiple image variants. Use the resolved HF id as MODEL for the build and qualification commands:

make serve-config MODEL=google/gemma-4-12B-it   # model / slug / config path / image tag / target GPU
make serve-models                               # which models already have a pinned config

The recipe image must use the canonical immutable reference that emmy publish validates:

cloudriftai/<runtime-family>-<model-slug>:<runtime-version>-<source-sha>

Supported runtime families are vllm-emmy and 1cat-vllm. The model slug comes only from model.huggingface through Emmy's slug implementation. GPU architecture, zero-recompile status, cache manifests, checkpoint revision, and serving shape are image labels and qualification evidence, never tag suffixes. Refuse latest, jitfree, GPU names, or mutable aliases in the primary recipe reference.

The exact local image must label ai.emmy.publish.family, ai.emmy.model.id, ai.emmy.model.revision, ai.emmy.target.gpu, org.opencontainers.image.version, and org.opencontainers.image.revision; cache-bearing images also carry their cache-manifest digests. Compare the model, checkpoint revision, target GPU, sealed serving shape, and cache manifests against the recipe, model config, and qualification evidence before publication. A label does not substitute for the fresh-container zero-recompile gate.

Budget: ~2–3 h wall on a rental for a 12B-class model (image build ~20 min, headroom sweep ~30–60 min, validate ~30 min, warm ~30 min, bake/verify/publication ~30 min). Hard cap: 4 h — if the session exceeds it, capture logs, tear down, and report. A larger checkpoint scales this up; re-estimate before starting rather than inheriting these numbers.

Read the full file on GitHub · 283 lines

Files

What ships with it

1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. today Changed · +4 lines a3b9bf5dcda6
  2. 5d ago First seen · 279 lines · 94 tokens per session scan C 5e520e40fd90

Subscribe to this mod's changes

release-serving-image is a skill published in the GitHub repository cloudrift-ai/emmy (80 stars, last pushed today), licensed Apache-2.0. It adds 94 tokens to every session and 4,801 once invoked, about $0.0005 per session on Opus 5. A static security scan graded it C with 1 finding (recursive force delete). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

inference-aiops

Use this skill whenever the user needs to operate a GPU inference cluster — vLLM (OpenAI API + Prometheus /metrics) and Ray Serve / Ray Jobs (Ray dashboard), plus the single-process serving engines SGLang and TGI (Text Generation Inference): a one-shot cluster overview (deployments + total replicas + queue…

AIops-tools/Inference-AIops · 417 tokens

huawei-cloud-ascend-models-deploy

Huawei Cloud Ascend model deployment and testing skill for large language models on Ascend DevServer (910B series). Supports single-machine and dual-machine deployment for LLM, VL (vision-language), Embedding, and Rerank models. Provides model inference testing, deployment log viewing, and status monitoring with…

huaweicloud/huaweicloud-skills · 205 tokens

astrea

Use for hipfire quant calibration, imatrix-driven experiments, KLD/PPL quality evaluation, k-map/format selection, MQ/HFQ/HFP/MFP tradeoff work, ParoQuant-style weight transform planning, and KV policy planning. Use when deciding whether a calibrated model candidate should be promoted, rejected, packaged, or sent…

warpfront/hipfire · 80 tokens

lambda-labs-gpu-cloud

Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.

davila7/claude-code-templates · 47 tokens

lambda-labs-gpu-cloud

Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.

OpenLAIR/dr-claw · 47 tokens

lambda-labs-gpu-cloud

Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.

Orchestra-Research/AI-Research-SKILLs · 47 tokens