intel/neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

90
/ 100
Verified

2,597 stars and 27,671 monthly downloads. Used by 1 other package. Actively maintained with 24 commits in the last 30 days. Available on PyPI.

Maintenance 23 / 25
Adoption 21 / 25
Maturity 25 / 25
Community 21 / 25

How are scores calculated?

Stars

2,597

Forks

298

Language

Python

License

Apache-2.0

Category

llm-quantization-techniques

Last pushed

Mar 13, 2026

Monthly downloads

27,671

Commits (30d)

24

Dependencies

14

Reverse dependents

1

GitHub PyPI
Llm Quantization Techniques · 13 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/intel/neural-compressor"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Related models

bitsandbytes-foundation/bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

90

dropbox/hqq

Official implementation of Half-Quadratic Quantization (HQQ)

47

OpenGVLab/OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

42

VITA-Group/Q-GaLore

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.

33

Hsu1023/DuQuant

[NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger...

33

Explore Transformer Models

All categories Trending Transformer directory Insights