AdapterFusion: Non-Destructive Task Composition for Transfer Learning

1 May 2020

Papers citing "AdapterFusion: Non-Destructive Task Composition for Transfer Learning"

50 / 531 papers shown

Title
LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks Hanqing Wang Bowen Ping Shuo Wang Xu Han Yun-Nung Chen Zhiyuan Liu Maosong Sun MoMe 33 19 0 18 Feb 2024
LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models Yifan Yang Jiajun Zhou Ngai Wong Zheng Zhang 29 7 0 18 Feb 2024
RENOVI: A Benchmark Towards Remediating Norm Violations in Socio-Cultural Conversations Haolan Zhan Zhuang Li Xiaoxi Kang Tao Feng Yuncheng Hua ... Linhao Luo Lay-Ki Soon Zhaleh Semnani Azad Ingrid Zukerman Gholamreza Haffari 57 8 0 17 Feb 2024
Generalizability of Mixture of Domain-Specific Adapters from the Lens of Signed Weight Directions and its Application to Effective Model Pruning Tuc Nguyen Thai Le MoMe 28 3 0 16 Feb 2024
Quantized Embedding Vectors for Controllable Diffusion Language Models Cheng Kang Xinye Chen Yong Hu Daniel Novak 31 0 0 15 Feb 2024
Model Compression and Efficient Inference for Large Language Models: A Survey Wenxiao Wang Wei Chen Yicong Luo Yongliu Long Zhengkai Lin Liye Zhang Binbin Lin Deng Cai Xiaofei He MQ 43 48 0 15 Feb 2024
Task-conditioned adaptation of visual features in multi-task policy learning Pierre Marza L. Matignon Olivier Simonin Christian Wolf 53 2 0 12 Feb 2024
MAFIA: Multi-Adapter Fused Inclusive LanguAge Models Prachi Jain Ashutosh Sathe Varun Gumma Kabir Ahuja Sunayana Sitaram 28 1 0 12 Feb 2024
LiFi: Lightweight Controlled Text Generation with Fine-Grained Control Codes Chufan Shi Deng Cai Yujiu Yang 59 3 0 10 Feb 2024
Efficient Stagewise Pretraining via Progressive Subnetworks Abhishek Panigrahi Nikunj Saunshi Kaifeng Lyu Sobhan Miryoosefi Sashank J. Reddi Satyen Kale Sanjiv Kumar 38 5 0 08 Feb 2024
Learning to Route Among Specialized Experts for Zero-Shot Generalization Mohammed Muqeeth Haokun Liu Yufan Liu Colin Raffel MoMe 37 34 0 08 Feb 2024
Read to Play (R2-Play): Decision Transformer with Multimodal Game Instruction Yonggang Jin Ge Zhang Hao Zhao Tianyu Zheng Jiawei Guo Liuyu Xiang Shawn Yue Stephen W. Huang Zhaofeng He Jie Fu OffRL 41 4 0 06 Feb 2024
Time-, Memory- and Parameter-Efficient Visual Adaptation Otniel-Bogdan Mercea Alexey Gritsenko Cordelia Schmid Anurag Arnab VLM 40 13 0 05 Feb 2024
KB-Plugin: A Plug-and-play Framework for Large Language Models to Induce Programs over Low-resourced Knowledge Bases Jiajie Zhang S. Cao Linmei Hu Ling Feng Lei Hou Juanzi Li KELM 36 3 0 02 Feb 2024
LoTR: Low Tensor Rank Weight Adaptation Daniel Bershatsky Daria Cherniuk Talgat Daulbaev A. Mikhalev Ivan Oseledets 72 16 0 02 Feb 2024
Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters Umberto Cappellazzo Daniele Falavigna Alessio Brutti MoE 48 3 0 01 Feb 2024
X-PEFT: eXtremely Parameter-Efficient Fine-Tuning for Extreme Multi-Profile Scenarios Namju Kwak Taesup Kim MoE 29 0 0 29 Jan 2024
Effective Controllable Bias Mitigation for Classification and Retrieval using Gate Adapters Shahed Masoudian Cornelia Volaucnik Markus Schedl Navid Rekabsaz 21 5 0 29 Jan 2024
SADAS: A Dialogue Assistant System Towards Remediating Norm Violations in Bilingual Socio-Cultural Conversations Yuncheng Hua Zhuang Li Linhao Luo Kadek Ananta Satriadi Tao Feng ... Lizhen Qu Suraj Sharma Ingrid Zukerman Zhaleh Semnani Azad Gholamreza Haffari 35 2 0 29 Jan 2024
What the Weight?! A Unified Framework for Zero-Shot Knowledge Composition Carolin Holtermann Markus Frohmann Navid Rekabsaz Anne Lauscher MoMe 29 5 0 23 Jan 2024
APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference Bowen Zhao Hannaneh Hajishirzi Qingqing Cao 34 17 0 22 Jan 2024
PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation Nadav Benedek Lior Wolf 32 5 0 20 Jan 2024
Adapters Mixup: Mixing Parameter-Efficient Adapters to Enhance the Adversarial Robustness of Fine-tuned Pre-trained Text Classifiers Tuc Nguyen Thai Le AAML SILM MoE 19 2 0 18 Jan 2024
MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models Divyanshu Aggarwal Ashutosh Sathe Ishaan Watts Sunayana Sitaram 40 1 0 15 Jan 2024
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models Zhengxin Zhang Dan Zhao Xupeng Miao Gabriele Oliaro Qing Li Yong-jia Jiang Zhihao Jia MQ 51 7 0 13 Jan 2024
SamLP: A Customized Segment Anything Model for License Plate Detection Haoxuan Ding Junyuan Gao Yuan. Yuan Qi. Wang MLLM VLM 34 7 0 12 Jan 2024
LinguAlchemy: Fusing Typological and Geographical Elements for Unseen Language Generalization Muhammad Farid Adilazuarda Samuel Cahyawijaya Alham Fikri Aji Genta Indra Winata Ayu Purwarianti 28 5 0 11 Jan 2024
Chain of LoRA: Efficient Fine-tuning of Language Models via Residual Learning Wenhan Xia Chengwei Qin Elad Hazan 60 55 0 08 Jan 2024
LLM Augmented LLMs: Expanding Capabilities through Composition Rachit Bansal Bidisha Samanta Siddharth Dalmia Nitish Gupta Shikhar Vashishth Sriram Ganapathy Abhishek Bapna Prateek Jain Partha P. Talukdar CLL 26 34 0 04 Jan 2024
PEFT for Speech: Unveiling Optimal Placement, Merging Strategies, and Ensemble Techniques Tzu-Han Lin How-Shing Wang Hao-Yung Weng Kuang-Chen Peng Zih-Ching Chen Hung-yi Lee 42 5 0 04 Jan 2024
Overview of the PromptCBLUE Shared Task in CHIP2023 Wei-wei Zhu Xiaoling Wang Mosha Chen Buzhou Tang LM&MA ELM 41 7 0 29 Dec 2023
AdapterDistillation: Non-Destructive Task Composition with Knowledge Distillation Junjie Wang Yicheng Chen Wangshu Zhang Sen Hu Teng Xu Jing Zheng VLM 37 1 0 26 Dec 2023
Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs Juraj Vladika Alexander Fichtl Florian Matthes KELM 30 1 0 21 Dec 2023
PPEA-Depth: Progressive Parameter-Efficient Adaptation for Self-Supervised Monocular Depth Estimation Yue-Jiang Dong Yuanchen Guo Ying-Tian Liu Fang-Lue Zhang Song-Hai Zhang MDE 43 4 0 20 Dec 2023
Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment Lingling Xu Haoran Xie S. J. Qin Xiaohui Tao F. Wang 62 137 0 19 Dec 2023
Sparse is Enough in Fine-tuning Pre-trained Large Language Models Weixi Song Z. Li Lefei Zhang Hai Zhao Bo Du VLM 29 7 0 19 Dec 2023
SA $^2$ VP: Spatially Aligned-and-Adapted Visual Prompt Wenjie Pei Tongqi Xia Fanglin Chen Jinsong Li Jiandong Tian Guangming Lu VLM VPVLM 15 8 0 16 Dec 2023
Gradient-based Parameter Selection for Efficient Fine-Tuning Zhi Zhang Qizhe Zhang Zijun Gao Renrui Zhang Ekaterina Shutova Shiji Zhou Shanghang Zhang 33 15 0 15 Dec 2023
READ-PVLA: Recurrent Adapter with Partial Video-Language Alignment for Parameter-Efficient Transfer Learning in Low-Resource Video-Language Modeling Thong Nguyen Xiaobao Wu Xinshuai Dong Khoi M. Le Zhiyuan Hu Cong-Duy Nguyen See-Kiong Ng Anh Tuan Luu 38 2 0 12 Dec 2023
ControlNet-XS: Designing an Efficient and Effective Architecture for Controlling Text-to-Image Diffusion Models Denis Zavadski Johann-Friedrich Feiden Carsten Rother DiffM 48 5 0 11 Dec 2023
Initialization Matters for Adversarial Transfer Learning Andong Hua Jindong Gu Zhiyu Xue Nicholas Carlini Eric Wong Yao Qin AAML 32 6 0 10 Dec 2023
Customizable Combination of Parameter-Efficient Modules for Multi-Task Learning Haowen Wang Tao Sun Cong Fan Jinjie Gu MoE 16 7 0 06 Dec 2023
MoSA: Mixture of Sparse Adapters for Visual Efficient Tuning Qizhe Zhang Bocheng Zou Ruichuan An Jiaming Liu Shanghang Zhang MoE 29 2 0 05 Dec 2023
Tackling Bias in Pre-trained Language Models: Current Trends and Under-represented Societies Vithya Yogarajan Gillian Dobbie Te Taka Keegan R. Neuwirth ALM 54 11 0 03 Dec 2023
PEFTDebias : Capturing debiasing information using PEFTs Sumit Agarwal Aditya Srikanth Veerubhotla Srijan Bansal 27 3 0 01 Dec 2023
Parameter Efficient Fine-tuning via Cross Block Orchestration for Segment Anything Model Zelin Peng Zhengqin Xu Zhilin Zeng Lingxi Xie Qi Tian Wei Shen 28 10 0 28 Nov 2023
ADAPTER-RL: Adaptation of Any Agent using Reinforcement Learning Yi-Fan Jin Greg Slabaugh Simon Lucas OnRL AI4CE 27 0 0 20 Nov 2023
Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning Clifton A. Poth Hannah Sterz Indraneil Paul Sukannya Purkayastha Leon Arne Engländer Timo Imhof Ivan Vulić Sebastian Ruder Iryna Gurevych Jonas Pfeiffer 37 45 0 18 Nov 2023
Tied-Lora: Enhancing parameter efficiency of LoRA with weight tying Adithya Renduchintala Tugrul Konuk Oleksii Kuchaiev MoMe 41 42 0 16 Nov 2023
SQATIN: Supervised Instruction Tuning Meets Question Answering for Improved Dialogue NLU E. Razumovskaia Goran Glavaš Anna Korhonen Ivan Vulić LRM 32 2 0 16 Nov 2023