FareedKhan-dev/train-llm-from-scratch

A straightforward method for training your LLM, from downloading data to generating text.

/ 100

Established

531 stars. No commits in the last 6 months.

Stale 6m No Package No Dependents

Maintenance 2 / 25

Adoption 10 / 25

Maturity 16 / 25

Community 24 / 25

Stars

531

Forks

108

Language

Jupyter Notebook

License

MIT

Category

Last pushed

Aug 03, 2025

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/FareedKhan-dev/train-llm-from-scratch"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Compare

rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

facebookresearch/LayerSkip

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024

kmeng01/rome

Locating and editing factual associations in GPT (NeurIPS 2022)

datawhalechina/llms-from-scratch-cn

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6，深入理解大模型原理

geeks-of-data/knowledge-gpt

Extract knowledge from all information sources using gpt and other language models. Index and...