SharpAI/SwiftLM

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, + iOS iPhone app.

40
/ 100
Emerging

205 stars.

No Package No Dependents
Maintenance 13 / 25
Adoption 10 / 25
Maturity 9 / 25
Community 8 / 25

How are scores calculated?

Stars

205

Forks

7

Language

C++

License

MIT

Last pushed

Apr 06, 2026

Commits (30d)

0

GitHub

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/SharpAI/SwiftLM"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

campfirein/byterover-cli

ByteRover CLI (brv) - The portable memory layer for autonomous coding agents (formerly Cipher)

88

mistralai/client-python

Python client library for Mistral AI platform

88

openai/openai-python

The official Python library for the OpenAI API

86

pydantic/pydantic

Data validation using Python type hints

83

milla-jovovich/mempalace

The highest-scoring AI memory system ever benchmarked. And it's free.

82

Explore LLM Tools

All categories Trending LLM Tool directory Insights