AdapterFusion: Non-Destructive Task Composition for Transfer Learning

1 May 2020

Papers citing "AdapterFusion: Non-Destructive Task Composition for Transfer Learning"

50 / 530 papers shown

Title
Towards Incremental Learning in Large Language Models: A Critical Review M. Jovanovic Peter Voss ELM CLL KELM 37 5 0 28 Apr 2024
No Train but Gain: Language Arithmetic for training-free Language Adapters enhancement Mateusz Klimaszewski Piotr Andruszkiewicz Alexandra Birch MoMe 47 4 0 24 Apr 2024
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts Dengchun Li Yingzi Ma Naizheng Wang Zhengmao Ye Zhiyuan Cheng ... Yan Zhang Lei Duan Jie Zuo Cal Yang Mingjie Tang MoE 40 44 0 22 Apr 2024
MLP: Motion Label Prior for Temporal Sentence Localization in Untrimmed 3D Human Motions Sheng Yan Mengyuan Liu Yong Wang Yang Liu Chong Chen Hong Liu 46 0 0 21 Apr 2024
A Large-scale Medical Visual Task Adaptation Benchmark Shentong Mo Xufang Luo Yansen Wang Dongsheng Li MedIm 32 1 0 19 Apr 2024
TartuNLP @ SIGTYP 2024 Shared Task: Adapting XLM-RoBERTa for Ancient and Historical Languages Aleksei Dorkin Kairit Sirts 35 1 0 19 Apr 2024
Cross-Problem Learning for Solving Vehicle Routing Problems Zhuoyi Lin Yaoxin Wu Bangjian Zhou Zhiguang Cao Wen Song Yingqian Zhang Senthilnath Jayavelu 49 10 0 17 Apr 2024
AdaIR: Exploiting Underlying Similarities of Image Restoration Tasks with Adapters Hao-Wei Chen Yu-Syuan Xu Kelvin C. K. Chan Hsien-Kai Kuo Chun-Yi Lee Ming-Hsuan Yang 34 1 0 17 Apr 2024
Diffscaler: Enhancing the Generative Prowess of Diffusion Transformers Nithin Gopalakrishnan Nair Jeya Maria Jose Valanarasu Vishal M. Patel 56 1 0 15 Apr 2024
LoRA Dropout as a Sparsity Regularizer for Overfitting Control Yang Lin Xinyu Ma Xu Chu Yujie Jin Zhibang Yang Yasha Wang Hong-yan Mei 52 19 0 15 Apr 2024
MING-MOE: Enhancing Medical Multi-Task Learning in Large Language Models with Sparse Mixture of Low-Rank Adapter Experts Yusheng Liao Shuyang Jiang Yu Wang Yanfeng Wang MoE 36 5 0 13 Apr 2024
AdapterSwap: Continuous Training of LLMs with Data Removal and Access-Control Guarantees William Fleshman Aleem Khan Marc Marone Benjamin Van Durme CLL KELM 58 3 0 12 Apr 2024
Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models Zihan Fang Zheng Lin Zhe Chen Xianhao Chen Yue Gao Yuguang Fang 56 35 0 09 Apr 2024
Language Models on a Diet: Cost-Efficient Development of Encoders for Closely-Related Languages via Additional Pretraining Nikola Ljubesic Vít Suchomel Peter Rupnik Taja Kuzman Rik van Noord CLL 35 5 0 08 Apr 2024
Facial Affective Behavior Analysis with Instruction Tuning Yifan Li Anh Dao Wentao Bao Zhen Tan Tianlong Chen Huan Liu Yu Kong CVBM 67 15 0 07 Apr 2024
HyperTTS: Parameter Efficient Adaptation in Text to Speech using Hypernetworks Yingting Li Rishabh Bhardwaj Ambuj Mehrish Bo Cheng Soujanya Poria 46 2 0 06 Apr 2024
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation Xinyu Ma Xu Chu Zhibang Yang Yang Lin Xin Gao Junfeng Zhao 46 7 0 05 Apr 2024
AQuA -- Combining Experts' and Non-Experts' Views To Assess Deliberation Quality in Online Discussions Using LLMs Maike Behrendt Stefan Sylvius Wagner Marc Ziegele L. Wilms Anke Stoll Dominique Heinbach Stefan Harmeling 18 3 0 03 Apr 2024
A School Student Essay Corpus for Analyzing Interactions of Argumentative Structure and Quality Maja Stahl Nadine Michel Sebastian Kilsbach Julian Schmidtke Sara Rezat Henning Wachsmuth 24 2 0 03 Apr 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models Fanxu Meng Zhaohui Wang Muhan Zhang VLM 64 76 0 03 Apr 2024
Continual Learning for Smart City: A Survey Li Yang Zhipeng Luo Shi-sheng Zhang Fei Teng Tian-Jie Li HAI 40 8 0 01 Apr 2024
LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction Bo Zou Chao Yang Yu Qiao Chengbin Quan Youjian Zhao 47 6 0 01 Apr 2024
Query-driven Relevant Paragraph Extraction from Legal Judgments Santosh T.Y.S.S Elvin Quero Hernandez Matthias Grabmair AILaw 47 2 0 31 Mar 2024
An Efficient Approach for Studying Cross-Lingual Transfer in Multilingual Language Models Fahim Faisal Antonios Anastasopoulos 35 0 0 29 Mar 2024
Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation Mateusz Klimaszewski Piotr Andruszkiewicz Alexandra Birch 30 0 0 27 Mar 2024
Towards a World-English Language Model for On-Device Virtual Assistants Rricha Jalota Lyan Verwimp Markus Nussbaum-Thom Amr Mousa Arturo Argueta Youssef Oualil 31 0 0 27 Mar 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 48 9 0 27 Mar 2024
ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models Zequan Liu Jiawen Lyn Wei-wei Zhu Xing Tian Yvette Graham OffRL 40 10 0 24 Mar 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 150 318 0 21 Mar 2024
Self-generated Replay Memories for Continual Neural Machine Translation Michele Resta Davide Bacciu CLL 28 2 0 19 Mar 2024
BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient Low-Rank Adaptation of Large Pre-trained Models Rushi Qiang Ruiyi Zhang Pengtao Xie AI4CE 30 8 0 19 Mar 2024
SuperLoRA: Parameter-Efficient Unified Adaptation of Multi-Layer Attention Modules Xiangyu Chen Jing Liu Ye Wang Pu Wang Matthew Brand Guanghui Wang T. Koike-Akino 51 7 0 18 Mar 2024
Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation Wangbo Zhao Jiasheng Tang Yizeng Han Yibing Song Kai Wang Gao Huang F. Wang Yang You 40 11 0 18 Mar 2024
Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language Model Haoyun Xu Runzhe Zhan Derek F. Wong Lidia S. Chao 31 3 0 18 Mar 2024
Hiding and Recovering Knowledge in Text-to-Image Diffusion Models via Learnable Prompts Anh-Vu Bui Khanh Doan Trung Le Paul Montague Tamas Abraham Dinh Q. Phung 30 1 0 18 Mar 2024
OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning Lingyi Hong Shilin Yan Renrui Zhang Wanyun Li Xinyu Zhou ... Kaixun Jiang Yiting Chen Jinglun Li Zhaoyu Chen Wenqiang Zhang VLM 34 39 0 14 Mar 2024
PYRA: Parallel Yielding Re-Activation for Training-Inference Efficient Task Adaptation Yizhe Xiong Hui Chen Tianxiang Hao Zijia Lin Jungong Han Yuesong Zhang Guoxin Wang Yongjun Bao Guiguang Ding 51 17 0 14 Mar 2024
DAM: Dynamic Adapter Merging for Continual Video QA Learning Feng Cheng Ziyang Wang Yi-Lin Sung Yan-Bo Lin Mohit Bansal Gedas Bertasius CLL MoMe 39 10 0 13 Mar 2024
Do Language Models Care About Text Quality? Evaluating Web-Crawled Corpora Across 11 Languages Rik van Noord Taja Kuzman Peter Rupnik Nikola Ljubesic Miquel Espla-Gomis Gema Ramírez-Sánchez Antonio Toral ALM 40 2 0 13 Mar 2024
Conditional computation in neural networks: principles and research trends Simone Scardapane Alessandro Baiocchi Alessio Devoto V. Marsocci Pasquale Minervini Jary Pomponi 34 1 0 12 Mar 2024
MAMMOTH: Massively Multilingual Modular Open Translation @ Helsinki Timothee Mickus Stig-Arne Gronroos Joseph Attieh M. Boggia Ona de Gibert Shaoxiong Ji Niki Andreas Lopi Alessandro Raganato Raúl Vázquez Jörg Tiedemann 22 4 0 12 Mar 2024
Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performance Liting Lin Heng Fan Zhipeng Zhang Yaowei Wang Yong-mei Xu Haibin Ling 52 26 0 08 Mar 2024
Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models Wenfeng Feng Chuzhan Hao Yuewei Zhang Yu Han Hao Wang ALM MoE 42 10 0 06 Mar 2024
FlexLLM: A System for Co-Serving Large Language Model Inference and Parameter-Efficient Finetuning Xupeng Miao Gabriele Oliaro Xinhao Cheng Vineeth Kada Ruohan Gao ... April Yang Yingcheng Wang Mengdi Wu Colin Unger Zhihao Jia MoE 94 9 0 29 Feb 2024
LSPT: Long-term Spatial Prompt Tuning for Visual Representation Learning Shentong Mo Yansen Wang Xufang Luo Dongsheng Li VLM 41 1 0 27 Feb 2024
MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning Pengjie Ren Chengshun Shi Shiguang Wu Mengqi Zhang Zhaochun Ren Maarten de Rijke Zhumin Chen Jiahuan Pei MoE 41 14 0 27 Feb 2024
Advancing Parameter Efficiency in Fine-tuning via Representation Editing Muling Wu Wenhao Liu Xiaohua Wang Tianlong Li Changze Lv Zixuan Ling Jianhao Zhu Cenyuan Zhang Xiaoqing Zheng Xuanjing Huang 28 19 0 23 Feb 2024
PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning Zhisheng Lin Han Fu Chenghao Liu Zhuo Li Jianling Sun MoE MoMe 36 5 0 23 Feb 2024
The Hidden Space of Transformer Language Adapters Jesujoba Oluwadara Alabi Marius Mosbach Matan Eyal Dietrich Klakow Mor Geva 59 8 1 20 Feb 2024
LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks Hanqing Wang Bowen Ping Shuo Wang Xu Han Yun-Nung Chen Zhiyuan Liu Maosong Sun MoMe 33 19 0 18 Feb 2024