OpenLLM and ome

OpenLLM
74
Verified
ome
53
Established
Maintenance 13/25
Adoption 18/25
Maturity 25/25
Community 18/25
Maintenance 13/25
Adoption 10/25
Maturity 9/25
Community 21/25
Stars: 12,161
Forks: 803
Downloads: 4,730
Commits (30d): 0
Language: Python
License: Apache-2.0
Stars: 393
Forks: 64
Downloads: —
Commits (30d): 0
Language: Go
License: Apache-2.0
No risk flags
No Package No Dependents

About OpenLLM

bentoml/OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

About ome

sgl-project/ome

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Related comparisons

OpenLLM and ludwig OpenLLM and llama-swap OpenLLM and free-llm-api-resources

Scores updated daily from GitHub, PyPI, and npm data. How scores work