litgpt and Build-a-Large-Language-Model-from-Scratch
About litgpt
Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
This project helps machine learning engineers and researchers build custom large language models. You can select from over 20 pre-built LLMs, feed in your specific datasets for training or fine-tuning, and then deploy these models for various applications. It's designed for users who need fine-grained control and high performance for their custom AI language tasks.
About Build-a-Large-Language-Model-from-Scratch
JohnMachado11/Build-a-Large-Language-Model-from-Scratch
Building a GPT-like LLM from scratch with PyTorch.
This project helps machine learning engineers and researchers understand the core mechanics of large language models (LLMs) by guiding them through building one from the ground up. You'll input raw text data and configuration parameters, and the output will be a functional, albeit small, language model. This is for professionals who want to deeply grasp how models like ChatGPT are constructed.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work