BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Updated daily · last refreshed 2026-07-28
Primary language: Python · License: NOASSERTION
Language breakdown
Velona AI insight
This repository, Litellm, has strong momentum with over 54k stars and 10k forks, indicating a large community of users and contributors. However, it also has a significant number of open issues (4,407), which may impact its stability and reliability.
You get 10 free AI enhancements/day on this tool. Create a free account for higher limits, run history on your last 50 runs, and a ₹10 wallet that unlocks 300+ AI models.