gasparian/ml-serving-template
Serving large ml models independently and asynchronously via message queue and kv-storage for communication with other services [EXPERIMENT]
No commits in the last 6 months.
Stars
16
Forks
1
Language
Python
License
MIT
Category
Last pushed
Jul 20, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/mlops/gasparian/ml-serving-template"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
feast-dev/feast
The Open Source Feature Store for AI/ML
clearml/clearml-serving
ClearML - Model-Serving Orchestration and Repository Solution
lakehq/sail
LakeSail's computation framework with a mission to unify batch processing, stream processing,...
SeldonIO/MLServer
An inference server for your machine learning models, including support for multiple frameworks,...
PaddlePaddle/Serving
A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）