AIops-tools/Inference-AIops

Governed GPU inference ops (vLLM + Ray Serve): latency RCA, scaling, drain, 30 MCP tools (preview)

0Stars on the repository
3Mods indexed here, across every type
6d agoLast push, which is what freshness is scored on
MITLicence, which decides whether bodies are shown

inference-aiops

01

AIops-tools/Inference-AIops

Skill Claude CodeCodex

Use this skill whenever the user needs to operate a GPU inference cluster — vLLM (OpenAI API + Prometheus /metrics) and Ray Serve / Ray Jobs (Ray dashboard), plus the single-process serving engines SGLang and TGI (Text Generation Inference): a one-shot cluster overview (deployments + total replicas + queue…

0 6d ago A 417 tokens original MIT