continous batching instructions

mudler/vllm.cpp

Instructions file CodexOpenCode

Instructions for mudler/vllm.cpp, covering agents.md: the rules, start here, history is git, every change starts from an issue and spec before code.

mudler/vllm.cpp

Instructions file

Instructions for mudler/vllm.cpp, a project described as: a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...).