mcbieda/llm-from-scratch

1. A simple implementation of the LLM gpt-2 "from scratch" that allows easy modifications and experiments (based on "Build an LLM from Scratch" by Raschka). 2. Domain-adaptive pretraining (DAPT) using biomedical abstracts.

19
/ 100
Experimental
No Package No Dependents
Maintenance 10 / 25
Adoption 0 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

—

Forks

—

Language

Jupyter Notebook

License

Apache-2.0

Category

llm-implementation-tutorials

Last pushed

Feb 26, 2026

Commits (30d)

0

GitHub
LLM Implementation Tutorials · 102 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/mcbieda/llm-from-scratch"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

81

SPUTNIKAI/LeechTransformer

Leech-Lila: A Geometric Attention Transformer(Language Model) with the Leech Lattice Attention

37

liangyuwang/Tiny-DeepSpeed

Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library

36

viralcode/superGPT

Train your own LLM from scratch

35

microsoft/Text2Grad

🚀 Text2Grad: Converting natural language feedback into gradient signals for precise model...

35

Explore LLM Tools

All categories Trending LLM Tool directory Insights