bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Updated daily · last refreshed 2026-08-31
12,523
+1 this period –
838
17
83
Primary language: Python · License: Apache-2.0
bentomlfine-tuningllamallama2llama3-1llama3-2llama3-2-visionllmllm-inferencellm-opsllm-servingllmops
Language breakdown
Python 95.9% Shell 4.1%
Want more AI power?
Create a free account for run history on your last 50 runs, and a ₹10 wallet that unlocks 300+ AI models.