Ml Inference Benchmarking Transformer Models
There are 3 ml inference benchmarking models tracked. 1 score above 50 (established tier). The highest-rated is OpenNMT/CTranslate2 at 56/100 with 4,354 stars.
Get all 3 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=ml-inference-benchmarking&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Model | Score | Tier |
|---|---|---|---|
| 1 |
OpenNMT/CTranslate2
Fast inference engine for Transformer models |
|
Established |
| 2 |
mechramc/Orion
Local AI runtime for training & running small LLMs directly on Apple Neural... |
|
Emerging |
| 3 |
GusLovesMath/Llama3_MacSilicon
Repository for running LLMs efficiently on Mac silicon (M1, M2, M3).... |
|
Experimental |