Borrowing it
Nothing to install: this file belongs to Aviator-Coding/home-ops. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.
curl -O https://raw.githubusercontent.com/Aviator-Coding/home-ops/main/.agents/skills/litellm-proxy/SKILL.mdgit clone --depth 1 https://github.com/Aviator-Coding/home-opsWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/aviator-coding/home-ops/litellm-proxy)<a href="https://agentmods.dev/skills/aviator-coding/home-ops/litellm-proxy"><img src="https://agentmods.dev/badge/skills/aviator-coding/home-ops/litellm-proxy/github.svg" alt="Measured on agentmods" height="20"></a>Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.
<a href="https://agentmods.dev/skills/aviator-coding/home-ops/litellm-proxy"><img src="https://agentmods.dev/badge/skills/aviator-coding/home-ops/litellm-proxy.svg" alt="Reviewed on agentmods" width="80" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00110 | $0.02127 |
| Opus 5.5 | $0.00044 | $0.00851 |
| Sonnet 5.5 | $0.00022 | $0.00425 |
| Haiku 4.5 | $0.00011 | $0.00213 |
Grade A, and why
litellm-proxy scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 23d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
How it starts
The opening of the file, as written. The whole thing — 114 lines — stays where its author put it; the contents beside it link to each section on GitHub.
LiteLLM proxy, operator CRs, keys and models
LiteLLM is a narrow governance layer beside agentgateway: per-consumer virtual
keys with allow-lists and budgets, fallback chains, an auto-router, and a
Claude Code subscription pass-through. Delivered as
litellm.home-operations.com/v1alpha1 CRs reconciled by the home-operations
litellm-operator. Internal route only; never the public listener.
Tripwires
Money and security first. Each has a CI gate; never weaken one to land a change.
- A config-declared fallback bypasses the calling key's allow-list. A
cloud fallback may only sit on an alias every holder is already
cloud-entitled to (today
chat-haandauto, both toclaude-sonnet-5-metered). Never add one tochat-local,qwen3.6-35b-a3b, the classifier,pr-review-local,embedding-localor a pass-through model. fallbacks.md - A
LiteLLMModelwith noapiKeyis not credential-less. It falls back to the pod's meteredANTHROPIC_API_KEY. The four subscription pass-through CRs carry thesk-ant-oat-PLACEHOLDER-...key and$0on all seven price fields (input, output, five cache fields); dropping any one bills the household or restarts phantom spend. claude-code-subscription.md - Metered cloud models carry no
info.extraprices (the cost map is the invoice), exceptqwen/qwen3-embedding-8b, whose real price is declared because the cost map lacks it. Local models carry none (sunk hardware); only theqwen3.6-35b-a3bdemo fixture has synthetic prices (demoonly). model-catalog.md - Registration is not entitlement. A new CR is reachable only once a key
allow-lists it; allow-list changes are captain decisions.
models: []means all models. - Removing
rpmLimit/tpmLimit/maxBudgetfrom a key never clears it on the live key (omitempty); going unlimited needs a one-time admin/key/updatewith explicitnulls. governance-keys.md - Key aliases are global and there is no adopt-by-alias. An existing
alias leaves the CR
GenerateFailedforever;/key/deletefirst, which is a real rotation. Per-keyaliasesgrant nothing. - Never
spec.metadataonjev-decisions: it silently deletes the hand-applied pass-through grant. passthrough-lockdown.md - Pass-through routes are admin-only by config, and entry order is
load-bearing: each exact
/openrouteror/anthropicentry sits above its dead-loopback catch-all; never setforward_headers. - Never name a hand-written HTTPRoute
litellm, never setspec.route: the operator deletes the route on a later reconcile. platform.md - Thinking models return empty
content. The classifier andpr-review-localneedenable_thinking: falsedeclared on the model; without it the router fails open on 100% of traffic while looking healthy. Image floor v1.93.0. auto-router.md - Auto-router fail-open reads
complexity_router_default_model, not the innerdefault_model; keep both onchat-local, and cloud tiers on the-meteredCRs. os.environ/<VAR>is resolved at startup: removing a provider key fromexternalsecret.yamlwhile a model names it downs the whole proxy.litellm-dragonflyis required: without it limits and budgets are per worker and overshoot, even withreplicas: 1.- The AI PR reviewer is advisory only (never a required check, never
auto), and rotating its key has a second, silent GitHub-secret step. pr-reviewer.md - Never call
GET /spend/logswithout a filter (it OOM-killed the proxy), and never zero historical spend to make a number look clean. spend-logs.md - Vector store: one model, one width (
qwen/qwen3-embedding-8bat 2000 dims), registry underextraConfig, and never exportPG_VECTOR_API_KEY. vector-store.md
What ships with it
11 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.
- references/auto-router.md 9.8 KB
- references/claude-code-subscription.md 12 KB
- references/failover-drill.md 4.7 KB
- references/fallbacks.md 6.3 KB
- references/governance-keys.md 11 KB
- references/model-catalog.md 12 KB
- references/passthrough-lockdown.md 6.3 KB
- references/platform.md 9.7 KB
- references/pr-reviewer.md 5.8 KB
- references/spend-logs.md 8.6 KB
- references/vector-store.md 7.9 KB
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 23d ago Changed 269ba8b9fcc0
- 25d ago Changed · +64 lines · +8 tokens per session 638048d6a09c
- 26d ago Changed · +10 lines 3fe32495e09e
- 28d ago Changed a2029967075d
- 1mo ago First seen · 40 lines · 102 tokens per session scan A a3b6cc0fb07e
litellm-proxy is a skill published in the GitHub repository Aviator-Coding/home-ops (3 stars, last pushed today), licensed MIT. It adds 110 tokens to every session and 2,127 once invoked, about $0.0004 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-04.
Other skills, from other repositories
tensorrt-llm
High-throughput LLM inference on NVIDIA GPUs.
agent-platform-tuning
Agent Platform Model Tuning. Use when you need to fine-tune open models or Gemini models using Agent Platform infrastructure. Don't use for model training outside Agent Platform, model deployment to endpoints (use agent-platform-deploy), or managing serving endpoints (use agent-platform-endpoint-management).
google-cloud-solution-guided-gke-ai-migration
Guides the migration of existing AI workloads (Cloud Run, Gemini API, Gemini Enterprise Agent Platform) to self-hosted GKE inference using gcloud and kubectl. Use when the user has an existing AI inference workload (on Cloud Run, the Gemini API, Gemini Enterprise Agent Platform, or a custom VM) and wants to move it to…
apigee-agent-gateway-governance
Stands up an Apigee API proxy that a Google Cloud Agent Gateway calls as an ext-proc (Service Extension) callout on an agent's LLM traffic, to meter token usage per model, extract caller identity, and apply Model Armor prompt screening or a semantic cache. Use when wiring Apigee in as an AI gateway behind an Agent…
gke-inference
Deploys and optimizes AI/ML inference workloads on GKE, using GPUs, TPUs, and model servers. Use when deploying GKE inference servers, configuring GKE GPU resources for inference, or deploying LLMs on GKE. Don't use for migrating existing AI workloads to GKE (use google-cloud-solution-guided-gke-ai-migration), GKE RAG…
modal
Modal is a serverless cloud platform for running Python on demand, including on-demand GPUs. Use when deploying or serving AI/ML models, running GPU-accelerated workloads (training, fine-tuning, inference), serving web endpoints, scheduling batch jobs, or scaling Python code to cloud containers with the Modal SDK.