thu-ml/SageAttention
[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.
3,213 stars.
Stars
3,213
Forks
366
Language
Cuda
License
Apache-2.0
Category
Last pushed
Jan 17, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/thu-ml/SageAttention"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related models
fla-org/flash-linear-attention
🚀 Efficient implementations of state-of-the-art linear attention models
thu-ml/SpargeAttn
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
foundation-model-stack/fms-fsdp
🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for...
fla-org/flame
🔥 A minimal training framework for scaling FLA models
skylight-org/sparse-attention-hub
Advancing the frontier of efficient AI