Llm Fine Tuning Transformer Models

There are 77 llm fine tuning models tracked. 2 score above 50 (established tier). The highest-rated is OptimalScale/LMFlow at 59/100 with 8,489 stars. 1 of the top 10 are actively maintained.

Get all 77 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=llm-fine-tuning&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	OptimalScale/LMFlow An Extensible Toolkit for Finetuning and Inference of Large Foundation...	59	Established	8,489	Python
2	adithya-s-k/AI-Engineering.academy Mastering Applied AI, One Concept at a Time	50	Established	2,140	Jupyter Notebook
3	jax-ml/jax-llm-examples Minimal yet performant LLM examples in pure JAX	46	Emerging	244	Python
4	JIA-Lab-research/LongLoRA Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)	46	Emerging	2,694	Python
5	riyanshibohra/TuneKit Upload your data → Get a fine-tuned SLM. Free.	45	Emerging	138	Python
6	young-geng/scalax A simple library for scaling up JAX programs	45	Emerging	146	Python
7	MaximeRobeyns/bayesian_lora Bayesian Low-Rank Adaptation for Large Language Models	42	Emerging	37	Python
8	georgian-io/LLM-Finetuning-Toolkit Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.	39	Emerging	870	Python
9	NVlabs/EoRA [ICLRW'26] EoRA: Fine-tuning-free Compensation for Compressed LLM with...	38	Emerging	29	Python
10	SakanaAI/text-to-lora Hypernetworks that adapt LLMs for specific benchmark tasks using only...	38	Emerging	1,214	Python
11	kyegomez/Finetuning-Suite Finetune any model on HF in less than 30 seconds	38	Emerging	56	Jupyter Notebook
12	ZinYY/TreeLoRA A pytorch implementation of the paper "TreeLoRA: Efficient Continual...	38	Emerging	347	Python
13	di37/finetuning-quantize-evaluate Fine-Tune, Quantize, Evaluate: The Complete Guide — LLMs, VLMs, and Embedding Models	38	Emerging	13	Typst
14	rohan-paul/LLM-FineTuning-Large-Language-Models LLM (Large Language Model) FineTuning	36	Emerging	566	Jupyter Notebook
15	GiovanniGatti/socratic-llm Training pipeline for fine tuning Phi-3-mini-instruct to follow the Socratic method	35	Emerging	31	Python
16	A-baoYang/alpaca-7b-chinese Finetune LLaMA-7B with Chinese instruction datasets	35	Emerging	137	Python
17	SensAI-PT/LLaMa2lang Convenience scripts to finetune (chat-)LLaMa3 and other models for any language	35	Emerging	313	Python
18	NVlabs/DoRA [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed...	34	Emerging	942	Python
19	bigscience-workshop/xmtf Crosslingual Generalization through Multitask Finetuning	34	Emerging	537	Jupyter Notebook
20	sandy1990418/Finetune-Qwen2.5-VL Fine-tuning Qwen2.5-VL for vision-language tasks \| Optimized for Vision...	34	Emerging	154	Python
21	VectorInstitute/vectorlm LLM finetuning in resource-constrained environments.	34	Emerging	55	Python
22	punica-ai/punica Serving multiple LoRA finetuned LLM as one	34	Emerging	1,145	Python
23	liuqidong07/MOELoRA-peft [SIGIR'24] The official implementation code of MOELoRA.	34	Emerging	189	Python
24	architkaila/Fine-Tuning-LLMs-for-Medical-Entity-Extraction Exploring the potential of fine-tuning Large Language Models (LLMs) like...	33	Emerging	89	Python
25	AlexandrosChrtn/llama-fine-tune-guide Fine-tune the newly released Llama-3.2 lightweight models.	33	Emerging	22	Python
26	rasbt/blog-finetuning-llama-adapters Supplementary material for "Understanding Parameter-Efficient Finetuning of...	33	Emerging	48	Jupyter Notebook
27	molbal/llm-text-completion-finetune Guide on text completion large language model fine-tuning, including example...	33	Emerging	87	Python
28	Yog-Sotho/LLM-fine-tuner Powerful no-code LLM fine-tuner: upload data → train → deploy in minutes....	33	Emerging	13	Python
29	neuralwork/instruct-finetune-mistral Fine-tune Mistral 7B to generate fashion style suggestions	32	Emerging	35	Python
30	rasbt/dora-from-scratch LoRA and DoRA from Scratch Implementations	32	Emerging	217	Jupyter Notebook
31	EricLBuehler/xlora X-LoRA: Mixture of LoRA Experts	32	Emerging	267	Python
32	anchen1011/FireAct FireAct: Toward Language Agent Fine-tuning	32	Emerging	292	Python
33	ymoslem/Adaptive-MT-LLM-Fine-tuning Fine-tuning Open-Source LLMs for Adaptive Machine Translation	31	Emerging	92	Jupyter Notebook
34	TrelisResearch/install-guides Various installation guides for Large Language Models	31	Emerging	77	Jupyter Notebook
35	promptslab/LLMtuner FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)	30	Emerging	247	Python
36	ksm26/Finetuning-Large-Language-Models Unlock the potential of finetuning Large Language Models (LLMs). Learn from...	30	Emerging	68	Jupyter Notebook
37	openmedlab/PULSE PULSE: Pretrained and Unified Language Service Engine	30	Emerging	494	Python
38	poloclub/Fine-tuning-LLMs Finetune Llama 2 on Colab for free on your own data: step-by-step tutorial	30	Emerging	74	Jupyter Notebook
39	aws-samples/fine-tuning-llm-with-domain-knowledge This repo walks you through how to use transfer learning to fine tune a LLM...	30	Emerging	42	Jupyter Notebook
40	zjohn77/lightning-mlflow-hf Use QLoRA to tune LLM in PyTorch-Lightning w/ Huggingface + MLflow	30	Emerging	65	Python
41	researchim-ai/models-at-home training models at home	29	Experimental	34	Python
42	ngoanpv/llama2_vietnamese A fine-tuned Large Language Model (LLM) for the Vietnamese language based on...	28	Experimental	17	Python
43	Pengxin-Guo/FedSA-LoRA Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]	27	Experimental	60	Python
44	rasbt/gradient-accumulation-blog Finetuning BLOOM on a single GPU using gradient-accumulation	27	Experimental	31	Python
45	eliahuhorwitz/Spectral-DeTuning Official PyTorch Implementation for the "Recovering the Pre-Fine-Tuning...	27	Experimental	85	Python
46	CristianCristanchoT/chivito Implementación de un LLM basado en Llama finetuneado en español empleando...	27	Experimental	10	Jupyter Notebook
47	MNoorFawi/curlora The code repository for the CURLoRA research paper. Stable LLM continual...	27	Experimental	53	Jupyter Notebook
48	graphcore-research/jax-scalify JAX Scalify: end-to-end scaled arithmetics	26	Experimental	18	Python
49	BFCmath/FinetuneAI_Learning How to effectively finetune CV/LLM models (without local gpu)	25	Experimental	38	Jupyter Notebook
50	samadon1/LLM-From-Scratch Medical Language Model fine-tuned using pretraining, instruction tuning, and...	25	Experimental	29	Jupyter Notebook
51	mddunlap924/PyTorch-LLM Fine-tuning an LLM using a Generic Workflow and Best Practices with PyTorch	25	Experimental	28	Jupyter Notebook
52	juzhengz/LoRI [COLM 2025] LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation	25	Experimental	171	Python
53	naity/finetune-esm Scalable Protein Language Model Finetuning with Distributed Learning and...	24	Experimental	34	Jupyter Notebook
54	j-webtek/Local-LLM_FineTune Finetune Your Local LLM	24	Experimental	18	Python
55	yangjianxin1/LongQLoRA LongQLoRA: Extent Context Length of LLMs Efficiently	24	Experimental	168	Python
56	serp-ai/LLaMA-8bit-LoRA Repository for Chat LLaMA - training a LoRA for the LLaMA (1 or 2) models on...	24	Experimental	150	Python
57	mehdihosseinimoghadam/AVA-Llama-3 Fine-Tuned Llama 3 Persian Large Language Model LLM / Persian Llama 3	22	Experimental	36	Jupyter Notebook
58	francoislanc/midistral LLM finetuned for generating symbolic music	22	Experimental	42	Python
59	YuanheZ/LoRA-One LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large ...	21	Experimental	28	Python
60	TobyYang7/Llava_Qwen2 Visual Instruction Tuning for Qwen2 Base Model	21	Experimental	41	Python
61	roy-sub/LLM-FineTuning Fine-Tuned Language Models Exploration using LoRA and Hugging Face's...	21	Experimental	11	Jupyter Notebook
62	YanSte/NLP-LLM-Fine-tuning-Llame-2-QLoRA-2024 Natural Language Processing (NLP) and Large Language Models (LLM) with...	21	Experimental	9	Jupyter Notebook
63	Abhi0323/Fine-Tuning-LLaMA-2-with-QLORA-and-PEFT This project enhances the LLaMA-2 model using Quantized Low-Rank Adaptation...	21	Experimental	13	Jupyter Notebook
64	MusfiqDehan/Llama2-Finetuned-for-Translation Fine-Tuned Llama-2 For Machine Translation	20	Experimental	10	Jupyter Notebook
65	Marker-Inc-Korea/KO-Platypus [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model	20	Experimental	73	Jupyter Notebook
66	adithya-s-k/Indic-llm A open-source framework designed to adapt pre-trained Language Models...	19	Experimental	23	Python
67	rambodazimi/KD-LoRA KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge...	19	Experimental	22	Python
68	jkanalakis/finetuning-llama-model-for-text-generation-using-unsloth Fine-tuning Llama 3.2 3B Instruct model for text generation using Unsloth AI	19	Experimental	9	Jupyter Notebook
69	aniquetahir/JORA JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)	19	Experimental	35	Python
70	Rs-py/HowToFineTuneLlama3.1 Quick tutorial showing how to fine-tune Llama3.1 with nothing but free tools...	19	Experimental	9	Jupyter Notebook
71	LimDoHyeon/EEG-LLM Fine-tuned LLM for electroencephalography(EEG) data classification	18	Experimental	14	Jupyter Notebook
72	HenryNdubuaku/super-lazy-autograd Hand-derived memory-efficient VJPs for tuning LLMs on laptops.	18	Experimental	38	Python
73	paulocoutinhox/mini-llm Simple and lightweight tool to fine-tune GPT models (like GPT-2 and GPT-Neo)...	16	Experimental	35	Python
74	YYZhang2025/Pali-Gemma Implement Multi-Modality-LLM and fine tuning the model using LoRA. Only...	16	Experimental	9	Jupyter Notebook
75	ph-ausseil/llm-training-dataset-builder Streamlines the creation of dataset to train a Large Language Model with...	14	Experimental	13	Python
76	louisc-s/QLoRA-Fine-tuning-for-Film-Character-Styled-Responses-from-LLM Code for fine-tuning Llama2 LLM with custom text dataset to produce film...	14	Experimental	9	Python
77	garyfanhku/Galore-pytorch GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection	11	Experimental	22	Python