LLMs-from-scratch and llm-from-scratch
These are competitors—both teach LLM implementation fundamentals from first principles in PyTorch, with the established rasbt resource offering significantly more depth and community validation for learners choosing between educational approaches.
About LLMs-from-scratch
rasbt/LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Covers the complete pipeline from tokenization and attention mechanisms through pretraining on unlabeled data and finetuning for classification and instruction-following tasks. Includes practical implementations of multi-head attention, causal masking, and parameter-efficient techniques like LoRA, alongside code for loading pretrained model weights. Organized as Jupyter notebooks and standalone Python scripts that progressively build a functional GPT architecture while explaining each component's role in modern LLM training.
About llm-from-scratch
ai-art-dev99/llm-from-scratch
Build a Large Language Model From Scratch
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work