Parameter Efficient Adapters Transformer Models

Tools and libraries for implementing adapter modules, LoRA, and other parameter-efficient transfer learning methods for transformers. Includes adapter frameworks, modular fine-tuning approaches, and techniques to reduce trainable parameters. Does NOT include full model fine-tuning, general compression/pruning methods, or domain-specific applications without adapter focus.

There are 18 parameter efficient adapters models tracked. 1 score above 70 (verified tier). The highest-rated is adapter-hub/adapters at 82/100 with 2,802 stars and 86,888 monthly downloads. 1 of the top 10 are actively maintained.

Get all 18 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=parameter-efficient-adapters&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	adapter-hub/adapters A Unified Library for Parameter-Efficient and Modular Transfer Learning	82	Verified	2,802	Python
2	gaussalgo/adaptor ACL 2022: Adaptor: a library to easily adapt a language model to your own...	42	Emerging	28	Jupyter Notebook
3	ylsung/VL_adapter PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for...	32	Emerging	210	Python
4	intersun/LightningDOT source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT	31	Emerging	72	Python
5	kyegomez/M2PT Implementation of M2PT in PyTorch from the paper: "Multimodal Pathway:...	29	Experimental	14	Python
6	calpt/awesome-adapter-resources Collection of Tools and Papers related to Adapters / Parameter-Efficient...	28	Experimental	202	Python
7	ma2za/torch-adapters Small Library of PyTorch Adaptation modules	27	Experimental	9	Python
8	adapter-hub/efficient-task-transfer Research code for "What to Pre-Train on? Efficient Intermediate Task...	26	Experimental	37	Python
9	seetrex-ai/kuraformer Reduce LLM inference compute by 4x with no accuracy loss. Oscillatory...	22	Experimental	—	Python
10	eladwf/adaptive-multirate-transformers DSP-inspired multirate wrappers for GPT with adaptive hyperparameters and...	19	Experimental	7	Python
11	IsaacRodgz/Multimodal-Adapters Adapter modules with support for multimodal fusion of information (text,...	18	Experimental	7	Jupyter Notebook
12	itsShnik/adaptively-finetuning-transformers Adaptively fine tuning transformer based models for multiple domains and...	18	Experimental	6	Python
13	kyegomez/PaLM2-VAdapter Implementation of "PaLM2-VAdapter:" from the multi-modal model paper:...	15	Experimental	17	Python
14	mobarski/aidapter Adapter / facade for language models (OpenAI, Anthropic, Cohere, local...	15	Experimental	20	Python
15	gbyuvd/ImadaremV Implicitly Adaptive Refinement Model V	15	Experimental	—	Python
16	mlsw/partial-embedding-matrix-adaptation Vocabulary-level memory efficiency for language model fine-tuning.	13	Experimental	8	Python
17	thesofakillers/CLAfICLe Official repository for the paper "CLAfICLe: Cross-Lingual Adaptation for...	12	Experimental	3	TeX
18	TaoYang225/AD-DROP Source code of NeurIPS 2022 accepted paper "AD-DROP: Attribution-Driven...	11	Experimental	23	Python

Comparisons in this category

adapters and VL_adapter (82 vs 32) adapters and awesome-adapter-resources (82 vs 28) adapters and efficient-task-transfer (82 vs 26) adapters and adaptor (82 vs 42) adapters and torch-adapters (82 vs 27)