litgpt and SmallLanguageModel

litgpt
72
Verified
SmallLanguageModel
42
Emerging
Maintenance 17/25
Adoption 10/25
Maturity 25/25
Community 20/25
Maintenance 0/25
Adoption 10/25
Maturity 16/25
Community 16/25
Stars: 13,225
Forks: 1,409
Downloads:
Commits (30d): 11
Language: Python
License: Apache-2.0
Stars: 168
Forks: 22
Downloads:
Commits (30d): 0
Language: Jupyter Notebook
License: MIT
No risk flags
Stale 6m No Package No Dependents

About litgpt

Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

This project helps machine learning engineers and researchers build custom large language models. You can select from over 20 pre-built LLMs, feed in your specific datasets for training or fine-tuning, and then deploy these models for various applications. It's designed for users who need fine-grained control and high performance for their custom AI language tasks.

large-language-models machine-learning-engineering natural-language-processing AI-model-training model-deployment

About SmallLanguageModel

shivendrra/SmallLanguageModel

a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model

This helps machine learning engineers or researchers build their own large language models (LLMs) from the ground up. You provide raw text data, and it guides you through collecting, processing, and then training custom BERT, GPT, or Seq-2-Seq models. The output is a functional language model tailored to your specific data and needs.

natural-language-processing machine-learning-engineering language-model-development deep-learning-research

Scores updated daily from GitHub, PyPI, and npm data. How scores work