Transformer Implementation Education Generative AI Tools

Educational repositories focused on building transformer and language models from scratch for learning purposes. Includes minimal implementations, tutorials, and foundational architecture experiments. Does NOT include production-ready model deployments, fine-tuned applications, or domain-specific use cases like translation services or myth generation.

There are 31 transformer implementation education tools tracked. 1 score above 70 (verified tier). The highest-rated is NVIDIA-NeMo/NeMo at 76/100 with 16,894 stars. 1 of the top 10 are actively maintained.

Get all 31 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=generative-ai&subcategory=transformer-implementation-education&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	NVIDIA-NeMo/NeMo A scalable generative AI framework built for researchers and developers...	76	Verified	16,894	Python
2	vlm-run/vlmrun-hub A hub for various industry-specific schemas to be used with VLMs.	62	Established	541	Python
3	alexiglad/EBT PyTorch Code for Energy-Based Transformers paper -- generalizable reasoning...	55	Established	613	Python
4	HyperGAI/HPT HPT - Open Multimodal LLMs from HyperGAI	39	Emerging	313	Python
5	yash9439/Falcon-Local-AI-Model Explore this GitHub repository housing 3 versions of Falcon code for text...	27	Experimental	6	Python
6	DorsaRoh/transformer-from-scratch Complete transformer from scratch, using only numpy	25	Experimental	41	Jupyter Notebook
7	bastien-muraccioli/svlr SVLR: Scalable, Training-Free Visual Language Robotics: a modular...	25	Experimental	15	Python
8	gurpejsingh13/punjabi-gpt-scratch-20m Developed and pre-trained a 20.39M-parameter Punjabi GPT-style base model...	23	Experimental	1	Jupyter Notebook
9	Konohamaru04/Tiny-LLM Tiny GPT-style LLM built from scratch in PyTorch with tokenizer training,...	22	Experimental	—	Python
10	harshit-862000/Text-to-speech-generation-with-LLM-hugging-face This project demonstrates how to generate speech from text using a...	22	Experimental	—	Jupyter Notebook
11	imreallyexited/Independent-LLM-Project PyTorch framework for building and pre-training LLM's.	22	Experimental	—	Python
12	MihneaTeodorStoica/mono-lm Character-level language model focused on training, architecture, and optimization.	22	Experimental	—	Python
13	Fabri-D/MythGenerator GPT-2 fine-tuned model for myth generation using curated mythological...	19	Experimental	—	Python
14	ralolooafanxyaiml/miara-llm-ai A custom GPT-style Transformer Language Model built entirely from scratch...	19	Experimental	—	Python
15	dhruvjverma/NanoLanguageModel A minimalist, high-performance GPT implementation in PyTorch, optimized for...	19	Experimental	—	Python
16	rajchauhan28/nano-llm Training a Language Model from Scratch on Consumer Hardware	16	Experimental	1	Python
17	gemaakhbar/paligemma-from-scratch 🌟 Build a PyTorch implementation of Google's PaliGemma model for advanced...	16	Experimental	—	Python
18	ReNothingg/Mind-4 Экспериментальная трансформерная LLM для локального обучения, инференса и...	16	Experimental	1	C
19	binarybrains-club/HugginFace-Community Se detallarán los pasos para unirse a la comunidad de Hugging Face 🤗 , así...	15	Experimental	5	Jupyter Notebook
20	and2049/mamba-slm-hybrid-optimizer Small Language Model Implementation based on Mamba (SSM) architecture. Muon...	15	Experimental	—	Python
21	ankitdhall/torchsmith Torchsmith is a minimalist library that focuses on understanding generative...	15	Experimental	—	Python
22	ariuz14/ProMoE 🚀 Enhance transformer performance with ProMoE, a framework that integrates...	14	Experimental	—	—
23	AstraBert/distilgpt2-finetuned-microbiology Small model for language modeling based on distilgpt2 and on...	12	Experimental	3	Python
24	patrickamadeus/vqa-nle-llava Novel approach that leverages LVLMs to efficiently generate high-quality...	12	Experimental	3	Python
25	KennethanCeyer/diy-generative-ai-lm Make your Generative AI LM model from the scratch (Including pretraining /...	12	Experimental	16	Python
26	RohitPawar001/Build_your_custom_LLM This repository will allow you to create your own LLM model by only using Terminal.	12	Experimental	1	Python
27	NvirAdan/Hybrid-Tiny-Transformer Hybrid Tiny Transformer trained on the dataset of all Shakespeare, built...	11	Experimental	—	Jupyter Notebook
28	nikhilr612/tralinz Experimenting with Transformers and Attention using Burn	11	Experimental	—	Rust
29	Motamensalih/HuggingFace-Task-Explorer Application for exploring different tasks and models in HuggingFace hub.	11	Experimental	—	Python
30	vsemionov/xlab Transformer Lab - experimental implementations and training of LLMs at...	11	Experimental	—	Python
31	udaykiriti/NanoTextLM A minimal GPT-style Transformer language model implemented in PyTorch with a...	11	Experimental	—	Python