The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Latest release v1.100.0 · 6 Sept 2026
These files are BerriAI/litellm's own configuration. They tell Codex, OpenCode, Claude Code and Gemini CLI how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.
▶ Run Claude Code with Local LLMs: Ollama + LiteLLM + OpenTelemetry Nerding I/O with Jd Fiscus · about BerriAI/litellm · on YouTube → AGENTS.md A 10 tok CLAUDE.md C 3,520 tok GEMINI.md A 10 tok