litgpt and SmallLanguageModel
About litgpt
Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
This project helps machine learning engineers and researchers build custom large language models. You can select from over 20 pre-built LLMs, feed in your specific datasets for training or fine-tuning, and then deploy these models for various applications. It's designed for users who need fine-grained control and high performance for their custom AI language tasks.
About SmallLanguageModel
shivendrra/SmallLanguageModel
a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model
This helps machine learning engineers or researchers build their own large language models (LLMs) from the ground up. You provide raw text data, and it guides you through collecting, processing, and then training custom BERT, GPT, or Seq-2-Seq models. The output is a functional language model tailored to your specific data and needs.
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work