Llm Inference Serving ML Frameworks
There are 1 llm inference serving frameworks tracked. The highest-rated is ray-project/ray-educational-materials at 41/100 with 456 stars.
Get all 1 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=ml-frameworks&subcategory=llm-inference-serving&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Framework | Score | Tier |
|---|---|---|---|
| 1 |
ray-project/ray-educational-materials
This is suite of the hands-on training materials that shows how to scale CV,... |
|
Emerging |