helgklaizar/turboquant_mlx

Extreme KV Cache Compression (1-3 bit) for LLMs natively on Apple Silicon (MLX). Features TurboQuant, asymmetric PolarQuant caching, and OpenAI server compatibility.

25
/ 100
Experimental
No License No Package No Dependents
Maintenance 13 / 25
Adoption 6 / 25
Maturity 1 / 25
Community 5 / 25

How are scores calculated?

Stars

15

Forks

1

Language

Python

License

—

Category

kv-cache-optimization

Last pushed

Mar 25, 2026

Commits (30d)

0

GitHub
KV Cache Optimization · 31 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/helgklaizar/turboquant_mlx"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

ModelEngine-Group/unified-cache-management

Persist and reuse KV Cache to speedup your LLM.

61

reloadware/reloadium

Hot Reloading and Profiling for Python

56

alibaba/tair-kvcache

Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global...

50

October2001/Awesome-KV-Cache-Compression

📰 Must-read papers on KV Cache Compression (constantly updating 🤗).

47

xcena-dev/maru

High-Performance KV Cache Storage Engine on CXL Shared Memory for LLM Inference

41

Explore LLM Tools

All categories Trending LLM Tool directory Insights