SCCSMARTCODE/gpt2-from-scratch
A fundamental implementation of the GPT-2 architecture from scratch, designed to provide a clear and thorough understanding of generative pre-trained transformers. This repository focuses on building GPT-2 step by step, explaining the key components and their interactions for text generation and language modeling tasks
No commits in the last 6 months.
Stars
1
Forks
—
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Jun 30, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/SCCSMARTCODE/gpt2-from-scratch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Nixtla/nixtla
TimeGPT-1: production ready pre-trained Time Series Foundation Model for forecasting and...
akanyaani/gpt-2-tensorflow2.0
OpenAI GPT2 pre-training and sequence prediction implementation in Tensorflow 2.0
andrewdalpino/NoPE-GPT
A GPT-style small language model (SLM) with no positional embeddings (NoPE).
VinAIResearch/PhoGPT
PhoGPT: Generative Pre-training for Vietnamese (2023)
teddykoker/image-gpt
PyTorch Implementation of OpenAI's Image GPT