An open, programmable decision layer for models and compute.
vLLM Semantic Router is a programmable routing layer that chooses or combines language models for each request in a system using multiple models and types of computing infrastructure. It helps teams route inference by signals such as user preferences, application policies, quality, cost, latency, privacy, and safety requirements. The catalogue skills and instructions support configuring and operating this model-routing system.
This repository also configures its own agents. See what semantic-router tells them →
Skill Claude CodeCodex
Use when calibrating or validating a maintained routing recipe against live model backends, including probe manifests and evidence reports.
Skill Claude CodeCodex
Use for vLLM Semantic Router issue intake, PR decisions, releases, and reviewed GitHub mutations performed on behalf of maintainers.
Skill Claude CodeCodex
Use when changing a request-visible router contract across configuration, signals, decisions, algorithms, or recipe-scoped plugins in vLLM Semantic Router.
Skill Codex
Install, configure, and verify vLLM Semantic Router on a Docker host (CPU, AMD, or NVIDIA GPU) or a Kubernetes cluster, then operate it through its CLI and Router API. Use for a first install, an upgrade, routing verification, configuration changes, recipe tuning, and single-model/MoM evaluation.
Skill Claude CodeCodex
Install, configure, and verify vLLM Semantic Router on a Docker host (CPU, AMD, or NVIDIA GPU) or a Kubernetes cluster, then operate it through its CLI and Router API. Use for a first install, an upgrade, routing verification, configuration changes, recipe tuning, and single-model/MoM evaluation.
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: