intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

1.7kStars on the repository
3Mods indexed here, across every type
1mo agoLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

paddler CLAUDE.md

01

intentee/paddler

Instructions file

Instructions for intentee/paddler: When working with this codebase, prioritize readability over cleverness. Ask clarifying questions before making architectural changes.

1.7k 1mo ago A 103 tokens original Apache-2.0