a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)
Latest release v0.0.2 · 11 Aug 2026
These files are mudler/vllm.cpp's own configuration. They tell Claude Code, Codex and OpenCode how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.
AGENTS.md A 8,816 tok CLAUDE.md A 3 tok .claude/skills/writing-commits-and-prs/SKILL.md A 29 tok .claude/skills/writing-technical-english/SKILL.md A 20 tok