GPT Model Fine-Tuning LLM Tools

Tools, frameworks, and tutorials for fine-tuning GPT and GPT-2 models on custom datasets for specialized tasks like code generation, recipe creation, and domain-specific text generation. Does NOT include general LLM frameworks, inference engines, or pre-trained model usage without customization.

There are 33 gpt model fine-tuning tools tracked. The highest-rated is Tencent/PatrickStar at 41/100 with 779 stars.

Get all 33 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=llm-tools&subcategory=gpt-model-fine-tuning&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Tool	Score	Tier	Stars	Language
1	Tencent/PatrickStar PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and...	41	Emerging	779	Python
2	OpenMotionLab/MotionGPT [NeurIPS 2023] MotionGPT: Human Motion as a Foreign Language, a unified...	40	Emerging	1,890	Python
3	RobbenRibery/TuoTuo TuoTuo is a Topic Modeling library for Researchers and Engineers	38	Emerging	6	Jupyter Notebook
4	wenlu-lab/cMolGPT GPT (Generative Pre-trained Transformer) for de novo molecular design by...	34	Emerging	20	Python
5	OpenMotionLab/MotionGPT3 MotionGPT3: Human Motion as a Second Modality, a MoT-based framework for...	33	Emerging	189	Python
6	YerbaPage/DetectCodeGPT Detection of LLM-Generated Codes [ICSE2025]	31	Emerging	31	Python
7	SmerkyG/gptcore Fast modular code to create and train cutting edge LLMs	31	Emerging	68	Python
8	yongzhuo/MacroGPT-Pretrain macrogpt大模型全量预训练(1b3,32层), 多卡deepspeed/单卡adafactor	29	Experimental	15	Python
9	modernlearner/finetune-gpt3-for-code Fine tuning GPT-3 using a dataset for generating code from prompts	27	Experimental	10	JavaScript
10	arham-kk/gpt2-finetune Fine tuning a text generation model using the GPT-2 architecture and a csv dataset	25	Experimental	13	Jupyter Notebook
11	angeluriot/Language_model An autoregressive language model like ChatGPT.	23	Experimental	68	Python
12	ivfiev/vector-lens Educational app to illustrate inner workings of transformer models	23	Experimental	1	Go
13	geoai-lab/Geo-knowledge-guided-GPT-models-for-disaster-response Geo-knowledge-guided GPT models for disaster response	22	Experimental	7	Jupyter Notebook
14	DorsaRoh/gpt-finetune-kit Fine-tune GPT models ready-to-go	21	Experimental	22	TypeScript
15	mpuig/gpt2-fine-tuning Fine-tune GPT2 to generate fake job experiences	18	Experimental	11	Jupyter Notebook
16	kevihiiin/EHR-Indication-Processing Code for the paper: Transformers and large language models are efficient...	17	Experimental	4	Jupyter Notebook
17	tranquoctrinh/Finetune-GPTJ Fine-tune GPTJ for text generation task	17	Experimental	4	Python
18	mahendrarathore1742/FinancialGPT FinancialGPT is a small, domain-adapted language model fine-tuned on real...	16	Experimental	1	Jupyter Notebook
19	ebowwa/openai_finetuning_framework A comprehensive framework for fine-tuning OpenAI models with streamlined...	16	Experimental	1	Python
20	wielandb/finetune-collect A program that helps collecting, curating and exporting OpenAI fine-tune data	14	Experimental	4	GDScript
21	snoels/fingeit FinGEITje 7B is a large open Dutch financial language model with 7 billion...	13	Experimental	6	Jupyter Notebook
22	rskarp/poetry-project Experimental scripts for fuzzy-poetry: A natural language processing tool to...	12	Experimental	1	Python
23	rskarp/fuzzy-poetry A natural language processing tool to aid writing poetry	12	Experimental	1	TypeScript
24	antonioverdi/Text-Generation-GUI Graphical User Interface for 🤗 Transformers Using Flask and Python	12	Experimental	4	Python
25	LinghaoChan/HumanTOMATO Web page for "🍅HumanTOMATO: Text-aligned Whole-body Motion Generation".	12	Experimental	15	HTML
26	xingmingxu/EcoTransformer An energy-efficient Transformer architecture	11	Experimental	—	Jupyter Notebook
27	berecat/finetune-gpt3-for-code Fine tuning GPT-3 using a dataset for generating code from prompts	11	Experimental	2	JavaScript
28	Seniyax/Finance-Text-Classification-with-GPT-2 Fine-tuned GPT-2 for finance text classification	11	Experimental	—	Jupyter Notebook
29	socialx-analytics/transformerX Transformer Library Helper by SocialX	11	Experimental	2	R
30	Mahesh3394/training-of-transformer-on-dummy-data Here we try to understand how transformer works and try to replicate...	10	Experimental	1	Jupyter Notebook
31	lianghsun/hfdrugtutorial This repository shows how to use the Hugging Face Library for molecule generation.	10	Experimental	1	Jupyter Notebook
32	my-best-day/medium BERT and GPT Model Implementation with Training Procedures	10	Experimental	1	Python
33	mehrdadalmasi2020/Text_Classifier_based_Openai_Community_gpt2 A library that leverages the pre-trained openai-community/gpt2 model for...	10	Experimental	1	Python

Comparisons in this category

MotionGPT and MotionGPT3 (40 vs 33)