Lightning-AI/LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3,812 stars and 43,484 monthly downloads. Used by 1 other package. Actively maintained with 2 commits in the last 30 days. Available on PyPI.
Stars
3,812
Forks
271
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 02, 2026
Monthly downloads
43,484
Commits (30d)
2
Dependencies
3
Reverse dependents
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/Lightning-AI/LitServe"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related frameworks
modelscope/modelscope
ModelScope: bring the notion of Model-as-a-Service to life.
basetenlabs/truss
The simplest way to serve AI/ML models in production
labmlai/labml
🔎 Monitor deep learning model training and hardware usage from your mobile phone 📱
deepjavalibrary/djl-serving
A universal scalable machine learning model deployment solution
OrderLab/TrainCheck
An Observability Framework for AI Training