Model Fine-Tuning Methods NLP Tools

Tools, frameworks, and implementations for fine-tuning pre-trained language models using techniques like LoRA, QLoRA, and full fine-tuning. Includes parameter-efficient adaptation methods, fine-tuning strategies, and comparative analyses. Does NOT include applications of fine-tuning to specific downstream tasks (those belong in task-specific categories) or general model training from scratch.

There are 29 model fine-tuning methods tools tracked. The highest-rated is uds-lsv/bert-stable-fine-tuning at 43/100 with 138 stars.

Get all 29 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=nlp&subcategory=model-fine-tuning-methods&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	uds-lsv/bert-stable-fine-tuning On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and...	43	Emerging	138	Python
2	VanekPetr/flan-t5-text-classifier Fine-tuning of Flan-5T LLM for text classification 🤖 focuses on adapting a...	38	Emerging	44	Python
3	MeryylleA/lunariscodex A high-performance PyTorch toolkit for pre-training modern, Llama-style...	35	Emerging	13	Python
4	kingTLE/literary-alpaca2 从词表到微调这就是你所需的一切	31	Emerging	239	Python
5	RunxinXu/ChildTuning Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model:...	29	Experimental	62	Python
6	aymen-000/predict-reconstruct-language-models "Predict and Reconstruct: Joint Objectives for Self-Supervised Language...	24	Experimental	2	Python
7	YuweiYin/HLT-MT [IJCAI-ECAI 2022] HLT-MT: High-resource Language-specific Training for...	24	Experimental	4	Python
8	oatanas/containerized-transformer-finetuning Containerized Transformer Fine-Tuning	22	Experimental	10	Jupyter Notebook
9	Surya-Hariharan/Paraphrase-Detection-using-Siamese-Network Document-level paraphrase detection using Siamese Neural Network with SBERT...	20	Experimental	1	Python
10	SlaabAI/TuneForge TuneForge is a dataset generation tool for training and fine-tuning LLMs. It...	18	Experimental	3	TypeScript
11	andrea-cavallo-98/Low-resource-Machine-Translation Multilingual finetuning of Machine Translation model on low-resource...	18	Experimental	8	Jupyter Notebook
12	msmrexe/pytorch-lora-from-scratch A from-scratch PyTorch implementation of Low-Rank Adaptation (LoRA) to...	17	Experimental	2	Python
13	dzungphieuluuky/Finetune-DeepSeekOCR Finetuning DeepSeek-OCR on a small dataset with unsloth notebook. Assignment...	16	Experimental	1	Jupyter Notebook
14	Bharathyalagi/Fine-Tuning-a-LLaMA-2-Model-on-Medical-Text-Data-Using-Hugging-Face This project demonstrates how to fine-tune a pretrained LLaMA 2 model using...	16	Experimental	1	Jupyter Notebook
15	blackccpie/GweLLM Journey towards Fine-Tuning a Breton speaking Chat Model	14	Experimental	4	Python
16	ratteripenta/transformers-seminar-workshop Notebooks for teaching transformers and fine-tuning a pre-trained BERT model	14	Experimental	7	Jupyter Notebook
17	YichenZW/llm-arch-table Living comparison table of LLM architectural choices (norm, attention, MoE,...	14	Experimental	—	—
18	chtmp223/suri Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)	14	Experimental	27	Python
19	kenilc/finetune4textgen A python script to fine-tune pre-trained models for text generation	13	Experimental	5	Python
20	SJ-Ray/Manual_Fine_Tune_Vectors Manual Fine Tune Sentence Transformer Embeddings	13	Experimental	8	Jupyter Notebook
21	niloydebbarma-code/LORA-FINETUNING-BANGLASENTI-XLMR-GOOGLE-TPU First open-source LoRA fine-tuning of BanglaSenti on XLM-RoBERTa-base for...	12	Experimental	1	Python
22	elenanereiss/Limits-of-LLMs-for-German-Text-Classification This repo is dedicated to an analysis of the LLMs performance as text...	12	Experimental	3	Python
23	oelin/mlp-language-model A 2M parameter neural language model trained on the TinyStories corpus.	12	Experimental	4	Python
24	KoreaMGLEE/Concept-based-curriculum-masking Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking	12	Experimental	13	Python
25	linhaowei1/Fine-tuning-Scaling-Law 🌹[ICML 2024] Selecting Large Language Model to Fine-tune via Rectified Scaling Law	12	Experimental	4	Python
26	viniciusds2020/tinyllama-finetuning Script de finetuning do modelo TinyLlama-1.1B usando LoRA (Low-Rank...	11	Experimental	—	Python
27	HamzahDrawsheh/fine-tuning-and-instruction-tuning-of-large-language-models This project demonstrates the use of Large Language Models (LLMs) for...	11	Experimental	—	Jupyter Notebook
28	CllsPy/fine-tuning-llms Fine-Tuning Bert and Friends	11	Experimental	—	Jupyter Notebook
29	mariovas3/bert-lora Finetuning BERT with LoRA	10	Experimental	1	Python