inference-gateway-operator

inference-gateway-operator is an agent for Claude Code from aws-samples/sample-oh-my-aidlcops. It costs 85 tokens per session (1,380 once invoked), scanned A, original, MIT-0.

An agent for operating an inference gateway, which routes requests to AI models. It covers the gateway operator’s role, capabilities, decision process, common commands, and kgateway installation.

In plain words
What is it for?
Use it to plan gateway setup, follow the operator’s decision tree, run common commands, and install kgateway.
Why use it?
It gives operators guidance for choosing and installing the gateway components needed to send model requests through a shared entry point.

Agent for Claude Code

Written for Claude Code: shipped in a Claude Code plugin. Also seen: model in frontmatter.

Part of the ai-infra plugin — 6 skills, 2 commands, 4 agents shipped together

About the project

sample-oh-my-aidlcops is a plugin marketplace for Claude Code and Kiro that packages practices for managing the AWS AI-Driven Development Lifecycle, including design correctness and agent safety. It is for teams using agents to develop and operate AWS systems with approval checkpoints. Its catalogue contains the marketplace's plugins, skills, agents, and commands.

aws-samples/sample-oh-my-aidlcops · 19 stars · on GitHub · aws-samples.github.io

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add agents/aws-samples/sample-oh-my-aidlcops/inference-gateway-operator
Clone the repo
git clone --depth 1 https://github.com/aws-samples/sample-oh-my-aidlcops

Made for: Claude Code.

Or install ai-infra, the plugin that ships this one along with the rest of its 6 skills, 2 commands, 4 agents.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for inference-gateway-operator

README.md
[![agentmods](https://agentmods.dev/badge/agents/aws-samples/sample-oh-my-aidlcops/inference-gateway-operator.svg)](https://agentmods.dev/agents/aws-samples/sample-oh-my-aidlcops/inference-gateway-operator)
Your own site
<a href="https://agentmods.dev/agents/aws-samples/sample-oh-my-aidlcops/inference-gateway-operator"><img src="https://agentmods.dev/badge/agents/aws-samples/sample-oh-my-aidlcops/inference-gateway-operator.svg" alt="Measured on agentmods" height="20"></a>
Per session 85 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 1,380 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. Scan, not verified.
Origin unknown No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00085 $0.01380
Opus 5 $0.00043 $0.00690
Sonnet 5 $0.00017 $0.00276
Haiku 4.5 $0.00009 $0.00138

Measured 6d ago against content hash 8846bdb356f6, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-05, from the pricing page.

Security

Grade A, and why

inference-gateway-operator scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 6d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl -H "Host: llm.example.com" http://<gateway-ip>/v1/models
plugins/ai-infra/agents/inference-gateway-operator.md · 117 lines

The source is not reproduced here

Licensed MIT-0

The repository is licensed MIT-0, which this catalogue does not treat as permission to reproduce the file. Read it at the source.

Read it on GitHub

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 6d ago First seen · 117 lines · 85 tokens per session scan A 8846bdb356f6

Subscribe to this mod's changes

inference-gateway-operator is an agent published in the GitHub repository aws-samples/sample-oh-my-aidlcops (19 stars, last pushed yesterday), licensed MIT-0. It adds 85 tokens to every session and 1,380 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other agents, from other repositories

data-engineer

Build scalable data pipelines, modern data warehouses, and real-time streaming architectures. Implements Apache Spark, dbt, Airflow, and cloud-native data platforms. Use PROACTIVELY for data pipeline design, analytics infrastructure, or modern data stack implementation.

wshobson/agents · 54 tokens

claude-aws-architect-implementation-agent

USE FOR Translating an accepted design.md into IaC, IAM policies, cost ROM, observability, and acceptance criteria. Authoring per-component contract sections covering IaC, Cost, Security, Acceptance, Observability. Drafting tasks.md from the merged design under the bundled implementation specialist contract. DO NOT…

odere-pro/claude-aws-architect · 144 tokens

claude-aws-architect-solution-architect-agent

USE FOR Picking AWS services and patterns from a requirements.md draft. Authoring design.md, per-component contracts/ .md, and the diagrams.d2 C4 L1/L2 layers for a feature. Producing the per-pillar review block in design.md against all six Well-Architected pillars. DO NOT USE FOR Drafting requirements from a fresh…

odere-pro/claude-aws-architect · 153 tokens

claude-aws-architect-discovery-agent

USE FOR Bootstrapping a new feature: extracting requirements from a vague AWS prompt. Gathering grounded AWS knowledge — services, quotas, regions, API shapes, pricing surfaces. Drafting requirements.md and seeding the per-feature grounding ledger. DO NOT USE FOR Architectural decisions or component design; route to…

odere-pro/claude-aws-architect · 139 tokens

claude-aws-architect-kb-navigator-agent

USE FOR Read-only AWS knowledge lookups: "what is X", service overviews, quotas, ARN shapes, region availability. AWS CLI reference and recipe-style SOPs from kb:retrieveagentsop. Side-by-side service or feature comparisons on a stated dimension. Onboarding pointers for a service or learning track around a topic.…

odere-pro/claude-aws-architect · 203 tokens

claude-aws-architect-orchestrator-agent

USE FOR AWS architecture, design, IaC, threat-model, cost-estimate, runbook prompts. Discovery, design, plan, validate phases for a feature. Routing prompts that need parallel L3 specialist fan-out and merge. DO NOT USE FOR Non-AWS prose; route to the user's general assistant. Single-file edits without architectural…

odere-pro/claude-aws-architect · 111 tokens