AnkitaMungalpara/Building-LLM-From-Scratch

This repository provides a step-by-step guide to creating your own large language model (LLM). It walks you through each stage of the process, from initial design to pre-training on a general corpus and fine-tuning for specific tasks.

20
/ 100
Experimental
No License No Package No Dependents
Maintenance 6 / 25
Adoption 1 / 25
Maturity 1 / 25
Community 12 / 25

How are scores calculated?

Stars

1

Forks

1

Language

Jupyter Notebook

License

—

Category

llm-implementation-tutorials

Last pushed

Dec 12, 2025

Commits (30d)

0

GitHub
LLM Implementation Tutorials · 102 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/AnkitaMungalpara/Building-LLM-From-Scratch"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

78

liangyuwang/Tiny-DeepSpeed

Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library

43

catherinesyeh/attention-viz

Visualizing query-key interactions in language + vision transformers (VIS 2023)

42

microsoft/Text2Grad

🚀 Text2Grad: Converting natural language feedback into gradient signals for precise model...

42

huangjia2019/llm-gpt

From classic NLP to modern LLMs: building language models step by step. 异步图书：《 GPT图解 大模型是怎样构建的》-...

40

Explore LLM Tools

All categories Trending LLM Tool directory Insights