screengreen/gpt_parralel_traininig
A compact and educational implementation of GPT in PyTorch 2, designed for scalable multi-GPU training, fine-tuning on large datasets, and exploration of modern transformer training techniques.
No commits in the last 6 months.
Stars
2
Forks
—
Language
Python
License
—
Category
Last pushed
May 24, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/screengreen/gpt_parralel_traininig"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
AliHaiderAhmad001/GPT-from-Scratch-with-Tensorflow
Implementation for "Improving Language Understanding by Generative Pre-Training" paper
HomebrewML/HomebrewNLP-torch
A case study of efficient training of large language models using commodity hardware.
akshat0123/GPT-1
Pytorch implementation of GPT-1
qiqiApink/MotionGPT
The official PyTorch implementation of the paper "MotionGPT: Finetuned LLMs are General-Purpose...
nawnoes/pytorch-gpt-x
An implementation of an autoregressive language model using an improved Transformer and...