aks-gpu-inference

aks-gpu-inference is a skill for Claude Code from microsoft/azure-skills. It costs 114 tokens per session (688 once invoked), scanned A, a copy of aks-gpu-inference, MIT.

A read-only investigation guide for GPU and model-serving problems on Azure Kubernetes Service. GPU inference means running a machine-learning model using graphics processors instead of only regular processors.

In plain words
What is it for?
Use it to investigate unavailable GPUs, pending GPU workloads, model-load out-of-memory errors, GPU metrics, KAITO workspace readiness, and GPU autoscaling.
Why use it?
It helps distinguish scheduling, memory, device, readiness, and scaling problems from one another without changing the cluster. It requires evidence from the target environment or supplied reports.

Skill for Claude Code ✓ vendor

Written for Claude Code: shipped in a Claude Code plugin.

Part of the aks-skills plugin — 5 skills shipped together

Good fit Use it to investigate unavailable GPUs, pending GPU workloads, model-load out-of-memory errors, GPU metrics, KAITO workspace readiness, and GPU autoscaling.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/microsoft/azure-skills/aks-gpu-inference
About the project

Azure Skills Plugin is an agent plugin that packages Azure-specific guidance with MCP server configurations for carrying out Azure work. Coding agents use it to plan, deploy, troubleshoot, monitor, govern, and optimize Azure applications and services. The catalogue entries are the plugin's skills, instructions, and execution integrations.

microsoft/azure-skills · 1,572 stars · on GitHub

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add microsoft/azure-skills --skill aks-gpu-inference
Clone the repo
git clone --depth 1 https://github.com/microsoft/azure-skills

Made for: Claude Code.

Or install aks-skills, the plugin that ships this one along with the rest of its 5 skills.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for aks-gpu-inference

README.md
[![agentmods](https://agentmods.dev/badge/skills/microsoft/azure-skills/aks-gpu-inference/github.svg)](https://agentmods.dev/skills/microsoft/azure-skills/aks-gpu-inference)
Your own site
<a href="https://agentmods.dev/skills/microsoft/azure-skills/aks-gpu-inference"><img src="https://agentmods.dev/badge/skills/microsoft/azure-skills/aks-gpu-inference/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for aks-gpu-inference

Your own site · 80×15
<a href="https://agentmods.dev/skills/microsoft/azure-skills/aks-gpu-inference"><img src="https://agentmods.dev/badge/skills/microsoft/azure-skills/aks-gpu-inference.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 114 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 688 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin 100% copy Near-identical to another mod in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00114 $0.00688
Opus 5.5 $0.00046 $0.00275
Sonnet 5.5 $0.00023 $0.00138
Haiku 4.5 $0.00011 $0.00069

Measured 6d ago against content hash 0968850f574d, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

aks-gpu-inference scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 6d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

Origin

This is a copy

100% identical to aks-gpu-inference — 0 lines differ, which has more behind it and is treated as the original. This page carries a canonical link to it rather than competing with it.

.github/plugins/aks-skills/skills/aks-gpu-inference/SKILL.md · 69 lines

How it starts

The opening of the file, as written. The whole thing — 69 lines — stays where its author put it; the contents beside it link to each section on GitHub.

AKS GPU Inference Day-2

Quick Reference

Property Value
Best for AKS GPU/KAITO failures
Evidence Bound target, events/status, gpuProfile, DCGM

When to Use This Skill

Use for scheduling, VRAM/OOM, KAITO readiness, and workload scaling. Route exclusions as described above.

MCP Tools

Use a fitting host-advertised Azure read or the references' read-only queries.

Host Capability Gate

Before executing any referenced pipeline, verify that the host authorizes the required shell and kubectl/az commands against the bound target. File-backed collection also requires approved artifact storage and access to any bundled files it uses. A governed Azure CLI tool alone does not establish these capabilities. Equivalent host reads may replace commands only where their advertised schemas provide the required evidence.

If execution is unavailable or prohibited, say so and analyze supplied or redacted events, status, logs, and metrics, or give the operator a scoped collection plan. State which reads did not run and leave conclusions requiring missing evidence unconfirmed. Never route kubectl through Azure MCP or bypass host policy. The authorization requirements below still apply.

Workflow

  1. Bind subscription, cluster, kube context, pool, and affected resource.
  2. Capture exact events/status and observed gpuProfile; state which reads ran.
  3. Route to scheduling, observability, KAITO, or scaling.
  4. Separate container/host OOM from device-allocation failures. For OOMKilled, correlate container memory limits/usage and node conditions. For Managed+Install device-memory evidence, use the exporter on port 19400 and incident-window FB_USED/FB_FREE; sizing tables do not establish a cause.
  5. For KAITO not-ready, warn that Workspace deletion leaves its GPU pools; cleanup is separate and needs explicit authorization.
  6. Report evidence, confidence, missing evidence, and owner handoff.

Read the full file on GitHub · 69 lines

Files

What ships with it

4 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 6d ago First seen · 69 lines · 114 tokens per session scan A 0968850f574d

Subscribe to this mod's changes

aks-gpu-inference is a skill published in the GitHub repository microsoft/azure-skills (1,572 stars, last pushed yesterday), licensed MIT. It adds 114 tokens to every session and 688 once invoked, about $0.0005 per session on Opus 5.5. A static security scan graded it A with 0 findings. It is 100% identical to aks-gpu-inference, differing in 0 lines, and is treated as a copy.

Related

Other skills, from other repositories

gke-workload-troubleshooting

Diagnoses GKE workload failures (CrashLoopBackOff, OOMKilled, ImagePullBackOff, Pending, etc.) via logs and events. Use when pods fail to start or crash repeatedly. Don't use for GKE cluster infrastructure provisioning, node pool creation, or non-Kubernetes Google Cloud services.

google/skills · 69 tokens

gke-workload-scaling-troubleshooting

Diagnoses GKE HorizontalPodAutoscaler (HPA) failures — metrics showing as , FailedGetResourceMetric / FailedGetScale / FailedComputeMetricsReplicas events, missing Pod resource requests, custom/external metrics-pipeline breakage (FailedGetExternalMetric / FailedGetCustomMetric, unavailable metrics adapter…

google/skills · 170 tokens

gke-ai-troubleshooting-tpu-mxla-hang

Diagnose GKE Cloud TPU multi-slice training hangs (Megascale HANGDETECTED logs and hang monitored events) using the ML Diagnostics Megascale XLA (MXLA) Hang Analyzer (gcloud alpha mldiagnostics monitored-events) and 1-minute Cloud Monitoring multi-slice latency metrics (kubernetes.io/container/multislice/).…

google/skills · 192 tokens

gke-ai-troubleshooting-jobset-interruption

Diagnoses GKE JobSet interruptions, restarts, and preemptions for AI/ML training workloads autonomously. Use when troubleshooting JobSet restart loops, spot VM preemptions, node readiness failures, host VM issues, or coordinator worker crashes. Don't use for general GKE cluster creation, basic workload deployment, or…

google/skills · 83 tokens

gke-node-notready

Diagnoses GKE nodes reporting NotReady or Unknown status by inspecting node conditions, events, kubelet/containerd logs, and node metrics, then proposing safe remediations. Use when nodes show NotReady, when the kubelet stops posting node status, or when workloads are evicted or stuck Pending due to node health. Don't…

google/skills · 112 tokens

gke-ai-troubleshooting-node-unresponsive-timeout

Diagnose and mitigate GKE TPU or GPU nodes stuck in NotReady / NodeStatusUnknown ("Kubelet stopped posting node status") due to host kernel panics, hardware lockups, or disabled node auto-repair. Use when nodes stop heartbeating beyond the node auto-repair threshold and pods remain stuck in Terminating. Don't use for…

google/skills · 96 tokens