Hunain0786/miniTransformer
Mini Transformer (Implemented From Scratch) A from-scratch implementation of a Transformer in Python using only NumPy. This repository is designed for educational purposes to understand the inner workings of the Transformer architecture, including positional encoding, attention mechanisms, and basic decoding — without relying on frameworks like Py
Stars
—
Forks
—
Language
Python
License
—
Category
Last pushed
Feb 07, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Hunain0786/miniTransformer"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
LowinLi/transformers-stream-generator
This is a text generation method which returns a generator, streaming out each token in...
ystemsrx/mini-nanoGPT
One-click training of your own GPT. Training a GPT has never been easier for beginners. /...
jaymody/picoGPT
An unnecessarily tiny implementation of GPT-2 in NumPy.
kamalkraj/minGPT-TF
A minimal TF2 re-implementation of the OpenAI GPT training
Eamon2009/Codeformer-A.I
A character-level GPT transformer built from scratch in PyTorch, trained on Linux kernel C...