Apple Silicon Llm Inference MLOps Tools

There are 2 apple silicon llm inference tools tracked. 1 score above 70 (verified tier). The highest-rated is mosecorg/mosec at 71/100 with 893 stars and 3,733 monthly downloads. 1 of the top 10 are actively maintained.

Get all 2 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mlops&subcategory=apple-silicon-llm-inference&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 mosecorg/mosec

A high-performance ML model serving framework, offers dynamic batching and...

71
Verified
2 jeremyarancio/VLM-Batch-Deployment

Batch Deployment for Document Parsing with AWS Batch & Qwen-2.5-VL

30
Emerging