musa-kal/smoll-language-model

Educational language model implementation from scratch, featuring Bigram and TinyGPT architectures built with PyTorch for character-level text generation. Learn the fundamentals of transformers and attention mechanisms through practical code.

20
/ 100
Experimental
No Package No Dependents
Maintenance 10 / 25
Adoption 1 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

1

Forks

—

Language

Python

License

MIT

Category

llm-implementation-tutorials

Last pushed

Jan 19, 2026

Commits (30d)

0

GitHub
LLM Implementation Tutorials · 102 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/musa-kal/smoll-language-model"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

78

liangyuwang/Tiny-DeepSpeed

Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library

43

microsoft/Text2Grad

🚀 Text2Grad: Converting natural language feedback into gradient signals for precise model...

42

catherinesyeh/attention-viz

Visualizing query-key interactions in language + vision transformers (VIS 2023)

42

huangjia2019/llm-gpt

From classic NLP to modern LLMs: building language models step by step. 异步图书：《 GPT图解 大模型是怎样构建的》-...

40

Explore LLM Tools

All categories Trending LLM Tool directory Insights