Llama Model Implementations Transformer Models

Educational and production implementations of the Llama model architecture from scratch in various frameworks (PyTorch, JAX, NumPy). Includes simplified variants, language-specific adaptations, and training/inference code. Does NOT include fine-tuning frameworks, detection tools, or applications built on top of Llama.

There are 35 llama model implementations models tracked. The highest-rated is hkproj/pytorch-llama at 42/100 with 366 stars.

Get all 35 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=llama-model-implementations&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	hkproj/pytorch-llama LLaMA 2 implemented from scratch in PyTorch	42	Emerging	366	Python
2	harleyszhang/lite_llama A light llama-like llm inference framework based on the triton kernel.	39	Emerging	174	Python
3	4AI/LS-LLaMA A Simple but Powerful SOTA NER Model \| Official Code For Label Supervised...	37	Emerging	153	Python
4	luchangli03/export_llama_to_onnx export llama to onnx	35	Emerging	135	Python
5	ayaka14732/llama-2-jax JAX implementation of the Llama 2 model	35	Emerging	216	Python
6	liangyuwang/zo2 ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with...	34	Emerging	202	Python
7	tpoisonooo/llama.onnx LLaMa/RWKV onnx models, quantization and testcase	33	Emerging	366	Python
8	Nkluge-correa/TeenyTinyLlama A pair of tiny foundational models trained in Brazilian Portuguese.🦙🦙	31	Emerging	44	Python
9	hscspring/llama.np Inference Llama/Llama2/Llama3 Modes in NumPy	31	Emerging	21	Python
10	p-nordmann/eqx-llama LLaMA implementation with Jax and Equinox	30	Emerging	4	Jupyter Notebook
11	sh0416/llama-classification Text classification with Foundation Language Model LLaMA	29	Experimental	113	Python
12	ASSERT-KTH/repairllama RepairLLaMA: Efficient Representations and Fine-Tuned Adapters for Program...	27	Experimental	39	Jupyter Notebook
13	Nondzu/LlamaTor LlamaTor: Decentralized AI model sharing via BitTorrent for efficient,...	26	Experimental	58	Python
14	akanyaani/miniLLAMA A simplified LLAMA implementation for training and inference tasks.	26	Experimental	36	Python
15	Riccorl/llama-trainer Llama Trainer Utility	26	Experimental	9	Python
16	Esmail-ibraheem/Tinyllamas-pytorch Tinyllamas🦙 is an Extensible advanced language model framework, inspired by...	26	Experimental	6	Python
17	ES7/LLaMA-from-Scratch In this repository, I have explained the working of the LLaMA Model,...	26	Experimental	5	Python
18	ntropy-network/enrichment_models This repository benchmark Ntropy API against different Large Language Models...	24	Experimental	34	Jupyter Notebook
19	dhakalnirajan/LLaMA-BitNet LLaMA-BitNet is a repository dedicated to empowering users to train their...	23	Experimental	28	Python
20	MoFHeka/LLaMA-Megatron A LLaMA1/LLaMA12 Megatron implement.	23	Experimental	28	Python
21	frikishaan/glama-124m GLaMA is a small-scale autoregressive transformer model inspired by...	22	Experimental	4	Python
22	cbacary/MoDeGPT An implementation of the MoDeGPT LLM compression from the ICLR 2025...	22	Experimental	3	Python
23	aju22/LLaMA2 This repository contains an implementation of the LLaMA 2 (Large Language...	22	Experimental	74	Python
24	JamesVorder/python-tddpp This LLM generates code based on tests, and makes sure they pass.	20	Experimental	1	Python
25	nuochenpku/LLaMA_Analysis This is official project in our paper: Is Bigger and Deeper Always Better?...	19	Experimental	31	Python
26	longday1102/VietAI-experiment-LLaMA2 ⚡ LLaMA-2 model experiment	17	Experimental	12	Jupyter Notebook
27	gitctrlx/llama.np Llama from scratch in NumPy.	17	Experimental	2	Python
28	kimtth/pytorch-vis-llama-trial 💥Hello Pytorch! Llama	15	Experimental	1	Python
29	maris205/llama-gene A General-purpose Gene Task Large Language Model Based on Instruction Fine-tuning	13	Experimental	7	Jupyter Notebook
30	shreyanmitra/CandyLLM A simple, easy-to-use framework for HuggingFace and OpenAI text-generation...	13	Experimental	2	Python
31	jerrypan617/LightLlama Build a light-weight Llama from scratch, based on course Stanford CS336 2025.	12	Experimental	1	Python
32	dt-3t/TeGu Official implementation of "Temporal Guidance for Large Language Models". A...	12	Experimental	1	Python
33	adithyab94/Attiri Attiri: An Instruction-following LLaMa and Alpaca model for Tamil	12	Experimental	3	Python
34	rlucatoor/llama3 A Pytorch implementation of Llama 3 🦙	11	Experimental	—	Python
35	Brownwang0426/Cullama Customize Your Own Llama Attention! No peft, no lora, only customizing your...	10	Experimental	1	Jupyter Notebook

Comparisons in this category

pytorch-llama and Tinyllamas-pytorch (42 vs 26)