Adithya1209/slm-architecture-benchmarks
Comparative study of Linear, MLP, Attention, and Transformer architectures for character and word-level language modeling. Analyzing scaling laws, FLOPs-to-performance trade-offs, and generalization gaps on Tiny Shakespeare, PTB, and WikiText-2.
Stars
—
Forks
—
Language
Python
License
—
Category
Last pushed
Jan 15, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/Adithya1209/slm-architecture-benchmarks"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
openvinotoolkit/nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
huggingface/optimum
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers...
NVIDIA/Megatron-LM
Ongoing research training transformer models at scale
huggingface/optimum-intel
🤗 Optimum Intel: Accelerate inference with Intel optimization tools
eole-nlp/eole
Open language modeling toolkit based on PyTorch