ajheshbasnet/LLaMA-2-from-Scratch
llama-2 from scratch — a clean, educational pytorch implementation of the llama-2 transformer architecture. features grouped query attention (gqa), rotary position embeddings (rope), kv caching, and swiglu activation. run easily on google colab and experiment with your own datasets.
No commits in the last 6 months.
Stars
1
Forks
—
Language
Python
License
—
Category
Last pushed
Oct 01, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/ajheshbasnet/LLaMA-2-from-Scratch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
hkproj/pytorch-llama
LLaMA 2 implemented from scratch in PyTorch
4AI/LS-LLaMA
A Simple but Powerful SOTA NER Model | Official Code For Label Supervised LLaMA Finetuning
luchangli03/export_llama_to_onnx
export llama to onnx
ayaka14732/llama-2-jax
JAX implementation of the Llama 2 model
harleyszhang/lite_llama
A light llama-like llm inference framework based on the triton kernel.