Solar-cmd/neural-arithmetic-compression
LLM-driven arithmetic coder that uses next-token probability distributions from DistilGPT2 to encode text near its entropy lower bound. Cascaded with zstd. Beats zlib on natural language (Around 20% when compressing the first 38k chars of Pride and Prejudice)
Stars
1
Forks
—
Language
Python
License
—
Category
Last pushed
Mar 20, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/Solar-cmd/neural-arithmetic-compression"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
InterDigitalInc/CompressAI
A PyTorch library and evaluation platform for end-to-end compression research
quic/aimet
AIMET is a library that provides advanced quantization and compression techniques for trained...
tensorflow/compression
Data compression in TensorFlow
baler-collaboration/baler
Repository of Baler, a machine learning based data compression tool
zhanghang1989/PyTorch-Encoding
A CV toolkit for my papers.