Multilingual LLM Adaptation Transformer Models

Tools for adapting and fine-tuning large language models for non-English languages and specific domains/dialects. Includes instruction-tuning, domain-specific pretraining, and language-specific model development. Does NOT include general LLM frameworks, English-only model implementations, or application-specific fine-tuning for tasks like sentiment analysis.

There are 91 multilingual llm adaptation models tracked. 1 score above 70 (verified tier). The highest-rated is lyogavin/airllm at 83/100 with 13,828 stars and 14,143 monthly downloads. 3 of the top 10 are actively maintained.

Get all 91 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=multilingual-llm-adaptation&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	lyogavin/airllm AirLLM 70B inference with single 4GB GPU	83	Verified	13,828	Jupyter Notebook
2	shibing624/MedicalGPT MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training...	65	Established	4,948	Python
3	CrazyBoyM/llama3-Chinese-chat Llama3、Llama3.1 中文后训练版仓库 - 微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档。	55	Established	4,154	Python
4	GradientHQ/parallax Parallax is a distributed model serving framework that lets you build your...	54	Established	1,152	Python
5	CLUEbenchmark/CLUE 中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets,...	49	Emerging	4,237	Python
6	ymcui/Chinese-LLaMA-Alpaca 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)	48	Emerging	18,970	Python
7	Facico/Chinese-Vicuna Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model ——...	48	Emerging	4,136	C
8	X-D-Lab/LangChain-ChatGLM-Webui 基于LangChain和ChatGLM-6B等系列LLM的针对本地知识库的自动问答	48	Emerging	3,307	Python
9	ymcui/Chinese-LLaMA-Alpaca-2 中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs...	47	Emerging	7,163	Python
10	IDEA-CCNL/Fengshenbang-LM Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。	46	Emerging	4,149	Python
11	SCIR-HI/Huatuo-Llama-Med-Chinese Repo for BenTsao [original name: HuaTuo (华驼)], Instruction-tuning Large...	46	Emerging	4,938	Python
12	LianjiaTech/BELLE BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）	46	Emerging	8,284	HTML
13	baichuan-inc/Baichuan-7B A large-scale 7B pretraining language model developed by BaiChuan-Inc.	45	Emerging	5,680	Python
14	PhoebusSi/Alpaca-CoT We unified the interfaces of instruction-tuning data (e.g., CoT data),...	45	Emerging	2,801	Jupyter Notebook
15	MediaBrain-SJTU/MING 明医 (MING)：中文医疗问诊大模型	42	Emerging	1,109	Python
16	time-series-foundation-models/lag-llama Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting	42	Emerging	1,556	Python
17	Beomi/KoAlpaca KoAlpaca: 한국어 명령어를 이해하는 오픈소스 언어모델 (KoAlpaca: An open-source language model...	41	Emerging	1,578	Jupyter Notebook
18	AndrewZhe/lawyer-llama 中文法律LLaMA (LLaMA for Chinese legel domain)	41	Emerging	984	Python
19	ariannamethod/nanollama Train Llama 3 models from scratch. Any scale, any personality. By Arianna Method.	40	Emerging	37	Python
20	xusenlinzy/api-for-open-llm Openai style api for open large language models, using LLMs just as chatgpt!...	40	Emerging	2,468	Python
21	jackaduma/Recurrent-LLM The open-source LLM implementation of paper: RecurrentGPT: Interactive...	40	Emerging	203	Python
22	The-FinAI/PIXIU This repository introduces PIXIU, an open-source resource featuring the...	40	Emerging	835	Jupyter Notebook
23	HqWu-HITCS/Awesome-Chinese-LLM 整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。	40	Emerging	22,371	—
24	LlamaFamily/Llama-Chinese Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用	39	Emerging	14,737	Python
25	WangRongsheng/CareGPT 🌞 CareGPT...	39	Emerging	1,009	Python
26	wenge-research/YAYI 雅意大模型：为客户打造安全可靠的专属大模型，基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM...	38	Emerging	3,051	Python
27	ymcui/Chinese-LLaMA-Alpaca-3 中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3	38	Emerging	1,968	Python
28	CMKRG/QiZhenGPT QiZhenGPT: An Open Source Chinese Medical Large Language Model｜一个开源的中文医疗大语言模型	38	Emerging	770	Python
29	jerry1993-tech/Cornucopia-LLaMA-Fin-Chinese 聚宝盆(Cornucopia):...	37	Emerging	658	Python
30	CVI-SZU/Linly Chinese-LLaMA 1&2、Chinese-Falcon 基础模型；ChatFlow中文对话模型；中文OpenLLaMA模型；NLP预训练/指令微调数据集	37	Emerging	3,056	Python
31	yangjianxin1/Firefly Firefly:...	37	Emerging	6,644	Python
32	WangRongsheng/ChatGenTitle 🌟 ChatGenTitle：使用百万arXiv论文信息在LLaMA模型上进行微调的论文题目生成模型	36	Emerging	840	Python
33	ddzipp/AutoAudit AutoAudit—— the LLM for Cyber Security 网络安全大语言模型	36	Emerging	353	HTML
34	declare-lab/flan-alpaca This repository contains code for extending the Stanford Alpaca synthetic...	35	Emerging	357	Python
35	airaria/Visual-Chinese-LLaMA-Alpaca 多模态中文LLaMA&Alpaca大语言模型（VisualCLA）	34	Emerging	461	Python
36	IAAR-Shanghai/Grimoire Grimoire is All You Need for Enhancing Large Language Models	33	Emerging	117	Python
37	ECNU-ICALK/EduChat An open-source educational chat model from ICALK, East China Normal...	33	Emerging	913	Jupyter Notebook
38	MetaGLM/FinGLM FinGLM: 致力于构建一个开放的、公益的、持久的金融大模型项目，利用开源开放来促进「AI+金融」。	33	Emerging	2,194	HTML
39	jianzhnie/awesome-instruction-datasets A collection of awesome-prompt-datasets, awesome-instruction-dataset, to...	33	Emerging	725	—
40	sanjibnarzary/awesome-llm Curated list of open source and openly accessible large language models	33	Emerging	25	—
41	shm007g/LLaMA-Cult-and-More Large Language Models for All, 🦙 Cult and More, Stay in touch !	32	Emerging	452	HTML
42	ictnlp/BayLing “百聆”是一个基于LLaMA的语言对齐增强的英语/中文大语言模型，具有优越的英语/中文能力，在多语言和通用任务等多项测试中取得ChatGPT...	31	Emerging	318	Python
43	Longyichen/Alpaca-family-library Summarize all open source Large Languages Models and low-cost replication...	31	Emerging	136	—
44	Nkluge-correa/Tucano Natively pre-trained open-source Portuguese language models.	31	Emerging	79	Jupyter Notebook
45	StarRing2022/ChatGPTX-Uni 实现一种多Lora权值集成切换+Zero-Finetune零微调增强的跨模型技术方案，LLM-Base+LLM-X+Alpaca，初期，LLM-Base为...	30	Emerging	116	Python
46	Harish25/StudyScreeningLanguageModel Core LLM for M.A.R.S. (Model Assisted Review System). Utilizes fine-tuned...	30	Emerging	1	Jupyter Notebook
47	teelinsan/camoscio Camoscio: An Italian instruction-tuned language model based on LLaMA	30	Emerging	126	Jupyter Notebook
48	pleisto/yuren-baichuan-7b 基于baichuan-7b的开源多模态大语言模型	29	Experimental	72	Python
49	robinhad/kruk Ukrainian instruction-tuned language models and datasets	29	Experimental	96	Jupyter Notebook
50	abcsys/libem Compound AI toolchain for fast and accurate entity matching, powered by LLMs.	29	Experimental	26	Python
51	ChuloAI/BrainChulo Harnessing the Memory Power of the Camelids	29	Experimental	147	Python
52	FSoft-AI4Code/CodeCapybara Open-source Self-Instruction Tuning Code LLM	29	Experimental	172	Python
53	DAMO-NLP-SG/LLM-Zoo LLM Zoo collects information of various open- and close-sourced LLMs	29	Experimental	271	—
54	wxjiao/ParroT The ParroT framework to enhance and regulate the Translation Abilities...	28	Experimental	176	Python
55	starmpcc/CAMEL Clinically Adapted Model Enhanced from LLaMA	27	Experimental	89	Python
56	BIDS-Xu-Lab/Me-LLaMA A novel medical large language model family with 13/70B parameters, which...	26	Experimental	167	Python
57	yaodongC/awesome-instruction-dataset A collection of open-source dataset to train instruction-following LLMs...	25	Experimental	1,145	—
58	yangjianxin1/Firefly-LLaMA2-Chinese Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、Intern...	25	Experimental	416	Python
59	GreenScreen410/LYMT LYMT: Let Your Model Think	24	Experimental	4	Python
60	Curated-Awesome-Lists/Awesome-Llama3 A curated, awesome list of resources, tools, and projects for the AI Large...	24	Experimental	3	—
61	yeyupiaoling/Chinese-LLM-Chat 大语言模型微调的项目，包含了使用QLora微调ChatGLM和LLama	23	Experimental	28	Python
62	imanslab/poc-uncensored-language-with-wizard-vicuna Uncensored Language Model using FastAPI and Wizard Vicuna 30B (PoC)	23	Experimental	13	Python
63	GaryYufei/AlignLLMHumanSurvey Aligning Large Language Models with Human: A Survey	23	Experimental	741	—
64	DreamerGPT/DreamerGPT 🌱 梦想家(DreamerGPT)：中文大语言模型指令精调	22	Experimental	51	Python
65	WangRongsheng/Chinese-LLaMA-Alpaca-Usage 📔 对Chinese-LLaMA-Alpaca进行使用说明和核心代码注解	22	Experimental	51	Jupyter Notebook
66	nuhmanpk/Awesome-open-LLM Awesome-Open-LLM : a curated list of open-source Large Language Models (LLMs)	22	Experimental	9	—
67	LEL-A/doc Overarching documentation and planning to build so-called...	21	Experimental	10	—
68	CanvaChen/chinese-llama-tokenizer 目标：构建一个更符合语言学的小而美的 llama 分词器，支持中英日三国语言	20	Experimental	20	Python
69	taishan1994/qlora-chinese-LLM 使用qlora对中文大语言模型进行微调，包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE	18	Experimental	89	Python
70	lucataco/cog-llama-3-vision-alpha Cog wrapper for qresearch/llama-3-vision-alpha	18	Experimental	11	Python
71	hululuzhu/llama-lora-chinese-couplet llama-lora e2e example to demo a Chinese Couplet AI in 10 mins. some...	17	Experimental	5	Jupyter Notebook
72	eason69113-source/Chat-HuanHuan 基于 Meta-Llama-3.1-8B-Instruct + 4-bit 量化 + QLoRA，训练与推理全程显存占用 < 9 GB，RTX...	17	Experimental	2	Python
73	hello-shohanur/Fine-Tuning-Llama-on-Bengali-Empathetic-Conversations A fine-tuned LLaMA 3.1-8B-Instruct to generate empathetic responses in...	16	Experimental	1	Python
74	KnowledgeForge/keymaker The most powerful and extensible way to control the output of large language models.	15	Experimental	6	Python
75	YY0649/ICE-PIXIU ICE-PIXIU：A Cross-Language Financial Megamodeling Framework	15	Experimental	18	Python
76	alta3/llm-the-alta3-way The greatest LLMs on the planet!	15	Experimental	6	Python
77	mchl-labs/stambecco The home of Stambecco 🦌: Italian Instruction-following LLaMA Model	15	Experimental	19	Jupyter Notebook
78	declare-lab/flacuna Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive...	14	Experimental	111	Python
79	svjack/Genshin-Impact-Character-Instruction Genshin Impact Character Instruction Models tuned by Lora on LLM	14	Experimental	7	Python
80	mohamedsaid-sd/3 A repository dedicated to exploring the significance of the number 3 in...	14	Experimental	—	—
81	iandennismiller/calm A peaceful user experience for Large Language Models. Calm automatically...	13	Experimental	6	Python
82	yhinsson/airllm 🚀 Optimize memory for large language models, enabling 70B models on a 4GB...	13	Experimental	2	—
83	s-JoL/Llama3-extend-vocab A demo of expanding the vocabulary of the Llama3 model, applicable to other...	13	Experimental	8	Python
84	lawwu/awesome-llamas Awesome repositories for LLaMA1 and LLaMA2	12	Experimental	18	—
85	Maryamm-2/SpeechCueLLM-Amplifying-LLMs-in-Emotion-Recognition-with-Vocal-Nuances SpeechCueLLM Implementation: Enabling Llama-3 to detect emotions from speech...	11	Experimental	—	Jupyter Notebook
86	MdAliAhnaf/Bengali-Sentiment-Analysis-ML_Fine-Tune-Llama-3.1 Trained and evaluated traditional ML models, fine-tuned Dolphin 2.9.4 based...	11	Experimental	2	Jupyter Notebook
87	FunnySaltyFish/best_llm Vote the Best LLM by yourself! 票选你最喜欢的大语言模型	11	Experimental	2	Python
88	Mrbysco/LLamaPalooza LlamaPalooza! LlamaPalooza! LlamaPalooza! Yeahh	11	Experimental	—	Java
89	lizhongyi123/llama2_chat_fine 该项目为对llama2进行微调及使用中文微调的技术细节，适合初学者观看。	11	Experimental	23	Python
90	rameshvarun/magic-lamp Magic LLM-powered Python functions that return anything you ask for. Many caveats.	10	Experimental	1	Python
91	Ljzd-PRO/llm-chat-style-fine-tuning-guide QQ群成员聊天风格大模型LLM微调指引	10	Experimental	1	Python

Comparisons in this category

airllm and Awesome-Chinese-LLM (83 vs 40) airllm and Chinese-LLaMA-Alpaca (83 vs 48) Chinese-LLaMA-Alpaca and Chinese-LLaMA-Alpaca-2 (48 vs 47) llama3-Chinese-chat and Chinese-LLaMA-Alpaca (55 vs 48) airllm and Chinese-LLaMA-Alpaca-2 (83 vs 47) airllm and Recurrent-LLM (83 vs 40)