mudler/vllm.cpp

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)

367Stars on the repository
4Mods indexed here, across every type
2d agoLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

mudler/vllm.cpp

Skill Claude CodeCodex

Apply the repository writing rules to commits, pull requests, branches, changelogs, and release notes.

367 2d ago A 29 tokens original Apache-2.0

mudler/vllm.cpp

Skill Claude CodeCodex

Apply the repository technical-English rules to repository documents and all session prose.

367 2d ago A 20 tokens original Apache-2.0