structuredllm/syncode
Efficient and general syntactical decoding for Large Language Models
328 stars and 104 monthly downloads. Available on PyPI.
Stars
328
Forks
36
Language
Python
License
MIT
Category
Last pushed
Jan 19, 2026
Monthly downloads
104
Commits (30d)
0
Dependencies
8
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/structuredllm/syncode"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related models
sgl-project/SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
SafeAILab/EAGLE
Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).
romsto/Speculative-Decoding
Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan...
torchspec-project/TorchSpec
A PyTorch native library for training speculative decoding models
hao-ai-lab/JacobiForcing
Jacobi Forcing: Fast and Accurate Diffusion-style Decoding