datawhalechina/diy-llm

🎓 系统性大语言模型构建课程｜🛠️ 覆盖预训练数据工程、Tokenizer、Transformer、MoE、GPU 编程 (CUDA/Triton)、分布式训练、Scaling Laws、推理优化及对齐 (SFT/RLHF/GRPO)｜🚀 6 个渐进式作业 + 代码驱动，建立 LLM 全栈认知体系

/ 100

Emerging

No License No Package No Dependents

Maintenance 13 / 25

Adoption 8 / 25

Maturity 5 / 25

Community 15 / 25

Stars

Forks

Language

Jupyter Notebook

License

—

Category

Last pushed

Mar 09, 2026

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/datawhalechina/diy-llm"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

PacktPublishing/Mastering-NLP-from-Foundations-to-LLMs

Mastering NLP from Foundations to LLMs, Published by Packt

HandsOnLLM/Hands-On-Large-Language-Models

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

mlabonne/llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

louisfb01/start-llms

A complete guide to start and improve your LLM skills in 2026 with little background in the...

davidpirogov/toon-llm

Token-Oriented Object Notation (TOON) is an LLM-optimized data serialization format implemented...