Speculative Decoding Algorithms Transformer Models
There are 12 speculative decoding algorithms models tracked. 1 score above 70 (verified tier). The highest-rated is sgl-project/SpecForge at 76/100 with 729 stars. 1 of the top 10 are actively maintained.
Get all 12 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=speculative-decoding-algorithms&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Model | Score | Tier |
|---|---|---|---|
| 1 |
sgl-project/SpecForge
Train speculative decoding models effortlessly and port them smoothly to... |
|
Verified |
| 2 |
structuredllm/syncode
Efficient and general syntactical decoding for Large Language Models |
|
Established |
| 3 |
SafeAILab/EAGLE
Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and... |
|
Established |
| 4 |
romsto/Speculative-Decoding
Implementation of the paper Fast Inference from Transformers via Speculative... |
|
Emerging |
| 5 |
torchspec-project/TorchSpec
A PyTorch native library for training speculative decoding models |
|
Emerging |
| 6 |
hao-ai-lab/JacobiForcing
Jacobi Forcing: Fast and Accurate Diffusion-style Decoding |
|
Emerging |
| 7 |
kssteven418/BigLittleDecoder
[NeurIPS'23] Speculative Decoding with Big Little Decoder |
|
Emerging |
| 8 |
BaohaoLiao/RSD
[ICML 2025] Reward-guided Speculative Decoding (RSD) for efficiency and... |
|
Experimental |
| 9 |
Infini-AI-Lab/Sequoia
scalable and robust tree-based speculative decoding algorithm |
|
Experimental |
| 10 |
mscheong01/speculative_decoding.c
minimal C implementation of speculative decoding based on llama2.c |
|
Experimental |
| 11 |
Infini-AI-Lab/TriForce
[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with... |
|
Experimental |
| 12 |
ZhouYuxuanYX/Benchmarking-and-Guiding-Adaptive-Sampling-Decoding-for-LLMs
This is the official implementation of our ACL 2025 Main paper "Balancing... |
|
Experimental |