BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

This repository also configures its own agents. See what litellm tells them →

61kStars on the repository

7Mods indexed here, across every type

todayLast push, which is what freshness is scored on

customA LICENSE file GitHub cannot name, so bodies are not copied

▶ Run Claude Code with Local LLMs: Ollama + LiteLLM + OpenTelemetry Nerding I/O with Jd Fiscus · about BerriAI/litellm · on YouTube →

Sort Relevance Recently updated Fewest tokens Security grade Repo stars Stars this week Top rated 3 mods

rust-tracing

BerriAI/litellm

Skill Claude CodeCodex

Add or change Rust diagnostic tracing in litellm-rust, including route spans, subscriber layers, and Python logger delivery.

not rated 61k +478 today A 28 tokens

rust-string-enums

BerriAI/litellm

Skill Claude CodeCodex

Define or refactor Rust string-valued enums and their Serde adapters in litellm-rust, using Strum and serdewith while preserving parsing, wire values, and schemas.

not rated 61k +478 changed 9d ago A 41 tokens

url-state

BerriAI/litellm

Skill Claude CodeCodex

Read or write dashboard URL query state (tabs, filters, pagination, deep links, demo flags) with nuqs instead of raw history or URLSearchParams.

not rated 61k +478 today A 34 tokens