BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Updated daily · last refreshed 2026-08-31
57,691
+21 this period –
11,044
4,909
228
Primary language: Python · License: NOASSERTION
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenai
Language breakdown
Python 83.8% TypeScript 13.2% HTML 1.1% Rust 0.7% Go 0.6% HCL 0.2%
Want more AI power?
Create a free account for run history on your last 50 runs, and a ₹10 wallet that unlocks 300+ AI models.