mudler/vllm.cpp

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)

Latest release v0.0.2 · 11 Aug 2026

These files are mudler/vllm.cpp's own configuration. They tell Claude Code, Codex and OpenCode how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.

389Stars on the repository
4Files it configures its agents with
8,819Tokens loaded in every session
3Agents configured

Instructions

Skills