bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Updated daily · last refreshed 2026-07-28
12,423
+1 this period –
827
18
82
Primary language: Python · License: Apache-2.0
bentomlfine-tuningllamallama2llama3-1llama3-2llama3-2-visionllmllm-inferencellm-opsllm-servingllmops
Language breakdown
Python 95.9% Shell 4.1%
Velona AI insight
The OpenLLM repository has a strong presence with 12,423 stars and 827 forks, indicating a significant community interest. However, it has 18 open issues, which may require attention from contributors. The recent increase in stars suggests ongoing momentum.
Want more AI power?
You get 10 free AI enhancements/day on this tool. Create a free account for higher limits, run history on your last 50 runs, and a ₹10 wallet that unlocks 300+ AI models.