llmops

llmops is an agent for Claude Code from ivegamsft/basecoat. It costs 39 tokens per session (393 once invoked), scanned A, original, MIT.

A specialist for running applications that use large language models, including managing prompts, model routing, monitoring, and costs. Large language models are AI systems that generate or analyze text and other content.

In plain words
What is it for?
Use it to plan prompt deployments across development, staging, and production; manage model gateways; check model endpoints; monitor inference; and find evidence-based cost improvements.
Why use it?
It helps teams release prompt changes safely, trace which version and route produced a result, detect endpoint problems, and measure errors, speed, quality, and spending.

Agent for Claude Code

Written for Claude Code: allowed-tools in frontmatter. Also seen: model in frontmatter; mentions Codex.

Good fit Use it to plan prompt deployments across development, staging, and production; manage model gateways; check model endpoints; monitor inference; and find evidence-based cost improvements.

Compare 6 agents from other repositories ↓
Install with agentmods
npx agentmods add agents/ivegamsft/basecoat/basecoat-10-core-llmops
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Clone the repo
git clone --depth 1 https://github.com/ivegamsft/basecoat

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for llmops

README.md
[![agentmods](https://agentmods.dev/badge/agents/ivegamsft/basecoat/basecoat-10-core-llmops.svg)](https://agentmods.dev/agents/ivegamsft/basecoat/basecoat-10-core-llmops)
Your own site
<a href="https://agentmods.dev/agents/ivegamsft/basecoat/basecoat-10-core-llmops"><img src="https://agentmods.dev/badge/agents/ivegamsft/basecoat/basecoat-10-core-llmops.svg" alt="Measured on agentmods" height="20"></a>
Per session 39 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 393 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00039 $0.00393
Opus 5 $0.00019 $0.00197
Sonnet 5 $0.00008 $0.00079
Haiku 4.5 $0.00004 $0.00039

Measured 7d ago against content hash 6d5af3430988, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-07, from the pricing page.

Security

Grade A, and why

llmops scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 7d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

agents/basecoat-10-core-llmops.agent.md · 68 lines

What it actually says

LLMOps Agent

Purpose: run production LLM systems with controlled prompt releases, safe routing, and measurable cost.

Inputs

Prompt versions, promotion rules, gateway config, endpoints, and inference telemetry.

Workflow

Inventory versions and routes; enforce dev -> staging -> prod; require traceable prompt versions and rollback; validate endpoint health; monitor latency, errors, fallback, and cost; optimize only with evidence.

Prompt Deployment Pipeline

Use staged promotion with approvals and smoke checks.

Prompt Versioning and Rollback

Every prompt must be traceable and reversible.

Model Gateway Management

Keep routing explicit, deterministic, and conservatively retried.

Inference Monitoring Standards

Require version- and route-level attribution for quality, latency, errors, and cost.

Model Endpoint Health Checks

Check connectivity, auth, quota, latency, and a semantic smoke response.

Cost Optimization Principles

Optimize cost per successful task.

Integration Boundaries

Coordinate registry, telemetry, gateway control plane, and adjacent ops workflows.

GitHub Issue Filing

File issues for unversioned prompts, weak gates, unsafe fallback, weak health checks, or missing telemetry.

Model

Recommended: claude-sonnet-4.6 Rationale: Strong operational reasoning for prompt release management, gateway policy design, and multi-signal inference monitoring Minimum: gpt-5.3-codex

Output Format

Return version, route, decision, supporting metrics, and next actions.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 7d ago First seen · 68 lines · 39 tokens per session scan A 6d5af3430988

Subscribe to this mod's changes

llmops is an agent published in the GitHub repository ivegamsft/basecoat (4 stars, last pushed 2d ago), licensed MIT. It adds 39 tokens to every session and 393 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other agents, from other repositories

Prompt Builder

Expert prompt engineering and validation system for creating high-quality prompts - Brought to you by microsoft/edge-ai.

github/awesome-copilot · 24 tokens

prompt-engineer

Expert in prompt engineering for Claude, GPT, Gemini, and Llama models. Specializes in chain-of-thought prompting, structured outputs, few-shot learning, system prompt architecture, and prompt optimization. Use for designing effective prompts, imp...

SteveGJones/ai-first-sdlc-practices · 52 tokens

hyv-veo-prompt-smith

The generative-prompt writer for HearYourVOICE (Phase 4). Looks at the shots still MISSING a source in the shotlist (after CC scouting) and writes copy/paste generation prompts to fill exactly those gaps — no more. Builds each prompt from the measured durations and the veo-prompt guide, applying subject-lock and…

killernay/HearYourVOICE · 124 tokens

ai-ml-engineer

AI/ML engineer for LLM API integration, prompt engineering, ML pipelines, inference optimization, and recommendation systems. Do NOT use for general CRUD work, UI design, or non-AI infrastructure.

ArieGoldkin/claude-forge · 45 tokens

llm-integration-agent

LLM entegrasyon görevlerini üstlenir. Model API çağrıları, prompt tasarımı, tool-use şemaları, token/maliyet yönetimi, LLM çıktı doğrulama.

boranesn/agentic-base · 47 tokens

ai-product-designer

The AI Product Designer designs LLM-, agent-, and ML-powered features inside the app: prompt UX, guardrails, latency UX (streaming, skeletons, cancellation), error recovery, and evaluation framing. Use this agent when an app feature uses an LLM or agent under the hood — chat, generation, summarization, semantic…

cenconq25/claude-code-app-studio · 92 tokens