vllm-project

vllm-project/semantic-router

Instructions file GitHub Copilot

Instructions for vllm-project/semantic-router, covering github copilot instructions, start here and review priorities.

vllm-project/semantic-router

Instructions file CodexOpenCode

Instructions for vllm-project/semantic-router, covering vllm semantic router agent entry, read first, task routing, repository map and supported environments.

vllm-project/semantic-router

Skill Claude CodeCodex

Install vLLM Semantic Router in agent-safe mode, import supported OpenClaw model providers into canonical VSR config, and rewrite OpenClaw to target VSR.

vllm-project/semantic-router

Skill Claude CodeCodex

Synchronizes config representations across router config, Python CLI schema, and dashboard config UI. Use when adding or changing a config concept that spans those surfaces or addressing config representation debt before Kubernetes-facing translation.

vllm-project/semantic-router

Skill Claude CodeCodex

Modifies the repository's agent contract including AGENTS.md, docs index, manifests, validation scripts, and contributor-facing harness wrappers. Use when updating agent documentation, changing repo manifests, editing validation scripts, modifying CI/workflow classification, or updating contributor-facing guides like…

vllm-project/semantic-router

Skill Claude CodeCodex

Manages GitHub issue and pull-request lifecycle including creation, updates, triage labelling, and closeout metadata using canonical templates and repository taxonomy. Use when a maintainer asks to create, update, close, or triage GitHub issues or PRs, or when issue creation requires codebase analysis for scope…

vllm-project/semantic-router

Skill Claude CodeCodex

Maintainer release and milestone operating workflow. Use when a maintainer wants to plan a release, assess milestone health, coordinate release blockers, or generate a release-focused review brief.

vllm-project/semantic-router

Skill Claude CodeCodex

Calibrates routing changes against a live router endpoint with executable probes, local DSL validation, versioned deploys, and structured failure review. Use when tuning signals, projections, decisions, or maintained route examples against a real apiserver.

vllm-project/semantic-router

Skill Claude CodeCodex

Implements end-to-end plugin changes spanning router config, post-decision processing, optional CLI/UI exposure, and E2E test coverage. Use when adding a new plugin type, changing plugin config schema or execution semantics, updating plugin chain behavior, or modifying plugin-exposed metadata across surfaces.

vllm-project/semantic-router

Skill Claude CodeCodex

Handles a focused repository change when no specialized primary skill applies. Use when changed-file routing selects this fallback for a feature, fix, refactor, documentation update, or subsystem-local task.

vllm-project/semantic-router

Skill Claude CodeCodex

Modifies routing policy after signal extraction, including matched-decision logic, candidate-model selection, and downstream looper behavior. Use when changing decision predicates, thresholds, priorities, model ranking, cost or latency routing, or other post-signal routing policy.

vllm-project/semantic-router

Skill Claude CodeCodex

Implements end-to-end signal changes spanning router config, signal extraction, CLI schema, optional bindings, router-owned metadata headers, and E2E test coverage. Use when adding a new signal type, changing signal configuration or extraction logic, updating CLI schema for signal parameters, or modifying router-owned…

vllm-project/semantic-router

Skill Claude CodeCodex

Modifies the local startup chain including image build, container serve/bootstrap logic, and canonical smoke test behavior. Use when changing vllm-sr serve behavior, image selection or pull policy, container startup sequences, local Docker/Make bootstrap, or canonical smoke config.

vllm-project/vllm-skills

Plugin Claude Code

Plugin marketplace listing 1 plugin: vllm-skills.

vllm-project/vllm-skills

Plugin Claude Code

Deploy and benchmark vLLM with Claude Code.

vllm-project/vllm-skills

Skill Claude CodeCodex

Run vLLM performance benchmark using synthetic random data to measure throughput, TTFT (Time to First Token), TPOT (Time per Output Token), and other key performance metrics. Use when the user wants to quickly test vLLM serving performance without downloading external datasets.

vllm-project/vllm-skills

Skill Claude CodeCodex

Benchmark vLLM or OpenAI-compatible serving endpoints using vllm bench serve. Supports multiple datasets (random, sharegpt, sonnet, HF), backends (openai, openai-chat, vllm-pooling, embeddings), throughput/latency testing with request-rate control, and result saving. Use when benchmarking LLM serving performance…

vllm-project/vllm-skills

Skill Claude CodeCodex

Deploy vLLM using Docker (pre-built images or build-from-source) with NVIDIA GPU support and run the OpenAI-compatible server.

vllm-project/vllm-skills

Skill Claude CodeCodex

Deploy vLLM to Kubernetes (K8s) with GPU support, health probes, and OpenAI-compatible API endpoint. Use this skill whenever the user wants to deploy, run, or serve vLLM on a Kubernetes cluster, including creating deployments, services, checking existing deployments, or managing vLLM on K8s.

vllm-project/vllm-skills

Skill Claude CodeCodex

Quick install and deploy vLLM, start serving with a simple LLM, and test OpenAI API.

vllm-project/vllm-skills

Skill Claude CodeCodex

This is a skill for benchmarking the efficiency of automatic prefix caching in vLLM using fixed prompts, real-world datasets, or synthetic prefix/suffix patterns. Use when the user asks to benchmark prefix caching hit rate, caching efficiency, or repeated-prompt performance in vLLM.