AdapterFusion: Non-Destructive Task Composition for Transfer Learning

1 May 2020

Papers citing "AdapterFusion: Non-Destructive Task Composition for Transfer Learning"

50 / 530 papers shown

Title
$π$ -Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation Chengyue Wu Teng Wang Yixiao Ge Zeyu Lu Rui-Zhi Zhou Ying Shan Ping Luo MoMe 88 35 0 27 Apr 2023
PVP: Pre-trained Visual Parameter-Efficient Tuning Zhao Song Ke Yang Naiyang Guan Junjie Zhu Peng Qiao Qingyong Hu VPVLM VLM 35 3 0 26 Apr 2023
I2I: Initializing Adapters with Improvised Knowledge Tejas Srinivasan Furong Jia Mohammad Rostami Jesse Thomason CLL 32 6 0 04 Apr 2023
Strong Baselines for Parameter Efficient Few-Shot Fine-tuning S. Basu Daniela Massiceti S. Hu S. Feizi VLM 37 29 0 04 Apr 2023
UKP-SQuARE v3: A Platform for Multi-Agent QA Research Haritz Puerto Tim Baumgärtner Rachneet Sachdeva Haishuo Fang Haotian Zhang Sewin Tariverdian Kexin Wang Iryna Gurevych 28 2 0 31 Mar 2023
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention Renrui Zhang Jiaming Han Chris Liu Peng Gao Aojun Zhou Xiangfei Hu Shilin Yan Pan Lu Hongsheng Li Yu Qiao MLLM 74 745 0 28 Mar 2023
Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning Vladislav Lialin Vijeta Deshpande Anna Rumshisky 45 167 0 28 Mar 2023
Learning Expressive Prompting With Residuals for Vision Transformers Rajshekhar Das Yonatan Dukler Avinash Ravichandran A. Swaminathan VLM VPVLM 35 21 0 27 Mar 2023
Frame Flexible Network Yitian Zhang Yue Bai Chang Liu Huan Wang Sheng Li Yun Fu 13 4 0 26 Mar 2023
BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning Changdae Oh Hyeji Hwang Hee-young Lee Yongtaek Lim Geunyoung Jung Jiyoung Jung Hosik Choi Kyungwoo Song VLM VPVLM 85 57 0 26 Mar 2023
AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning Qingru Zhang Minshuo Chen Alexander Bukharin Nikos Karampatziakis Pengcheng He Yu Cheng Weizhu Chen Tuo Zhao 34 105 0 18 Mar 2023
LION: Implicit Vision Prompt Tuning Haixin Wang Jianlong Chang Xiao Luo Jinan Sun Zhouchen Lin Qi Tian VLM MLLM VPVLM 38 23 0 17 Mar 2023
Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need Da-Wei Zhou Han-Jia Ye De-Chuan Zhan Ziwei Liu CLL 36 100 0 13 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 33 42 0 10 Mar 2023
Extending the Pre-Training of BLOOM for Improved Support of Traditional Chinese: Models, Methods and Results Philipp Ennen Po-Chun Hsu Chan-Jan Hsu Chang-Le Liu Yen-Chen Wu Yin-Hsiang Liao Chin-Tung Lin Da-shan Shiu Wei-Yun Ma OSLM VLM AI4CE 46 10 0 08 Mar 2023
Towards Zero-Shot Functional Compositionality of Language Models Hangyeol Yu Myeongho Jeong Jamin Shin Hyeongdon Moon Juneyoung Park Seungtaek Choi 37 1 0 06 Mar 2023
MixPHM: Redundancy-Aware Parameter-Efficient Tuning for Low-Resource Visual Question Answering Jingjing Jiang Nanning Zheng MoE 40 6 0 02 Mar 2023
Evaluating Parameter-Efficient Transfer Learning Approaches on SURE Benchmark for Speech Understanding Yingting Li Ambuj Mehrish Shuaijiang Zhao Rishabh Bhardwaj Amir Zadeh Navonil Majumder Rada Mihalcea Soujanya Poria AAML 29 16 0 02 Mar 2023
Learning to Grow Pretrained Models for Efficient Transformer Training Peihao Wang Yikang Shen Lucas Torroba Hennigen P. Greengard Leonid Karlinsky Rogerio Feris David D. Cox Zhangyang Wang Yoon Kim 42 53 0 02 Mar 2023
Rethinking Efficient Tuning Methods from a Unified Perspective Zeyinzi Jiang Chaojie Mao Ziyuan Huang Yiliang Lv Deli Zhao Jingren Zhou 35 10 0 01 Mar 2023
SMoA: Sparse Mixture of Adapters to Mitigate Multiple Dataset Biases Yanchen Liu Jing Yang Yan Chen Jing Liu Huaqin Wu MoE 47 2 0 28 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić Edoardo Ponti MoMe OOD 32 73 0 22 Feb 2023
Task-Specific Skill Localization in Fine-tuned Language Models A. Panigrahi Nikunj Saunshi Haoyu Zhao Sanjeev Arora MoMe 34 68 0 13 Feb 2023
Parameter-efficient Modularised Bias Mitigation via AdapterFusion Deepak Kumar Oleg Lesota George Zerveas Daniel Cohen Carsten Eickhoff Markus Schedl Navid Rekabsaz MoMe KELM 26 25 0 13 Feb 2023
Divergence-Based Domain Transferability for Zero-Shot Classification Alexander Pugantsov R. McCreadie VLM 14 0 0 11 Feb 2023
Continual Pre-training of Language Models Zixuan Ke Yijia Shao Haowei Lin Tatsuya Konishi Gyuhak Kim Bin Liu CLL KELM 25 126 0 07 Feb 2023
UDApter -- Efficient Domain Adaptation Using Adapters Bhavitvya Malik Abhinav Ramesh Kashyap MingSung Kan Soujanya Poria 32 16 0 07 Feb 2023
Structure-informed Language Models Are Protein Designers Zaixiang Zheng Yifan Deng Dongyu Xue Yi Zhou YE Fei Quanquan Gu 42 87 0 03 Feb 2023
Progressive Prompts: Continual Learning for Language Models Anastasia Razdaibiedina Yuning Mao Rui Hou Madian Khabsa M. Lewis Amjad Almahairi VLM KELM CLL 29 127 0 29 Jan 2023
Probing Out-of-Distribution Robustness of Language Models with Parameter-Efficient Transfer Learning Hyunsoo Cho Choonghyun Park Junyeop Kim Hyuhng Joon Kim Kang Min Yoo Sang-goo Lee OODD 35 3 0 27 Jan 2023
Multilingual Detection of Check-Worthy Claims using World Languages and Adapter Fusion Ipek Baris Schlicht Lucie Flek Paolo Rosso 20 7 0 13 Jan 2023
Parameter-Efficient Fine-Tuning Design Spaces Jiaao Chen Aston Zhang Xingjian Shi Mu Li Alexander J. Smola Diyi Yang 44 59 0 04 Jan 2023
SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning M Saiful Bari Aston Zhang Shuai Zheng Xingjian Shi Yi Zhu Chenyu You Mu Li RALM VLM VPVLM LRM 48 5 0 21 Dec 2022
KronA: Parameter Efficient Tuning with Kronecker Adapter Ali Edalati Marzieh S. Tahaei I. Kobyzev V. Nia J. Clark Mehdi Rezagholizadeh 45 94 0 20 Dec 2022
Parameter-efficient Zero-shot Transfer for Cross-Language Dense Retrieval with Adapters Eugene Yang Suraj Nair Dawn J Lawrie J. Mayfield Douglas W. Oard 32 4 0 20 Dec 2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting Zheng-Xin Yong Hailey Schoelkopf Niklas Muennighoff Alham Fikri Aji David Ifeoluwa Adelani ... Genta Indra Winata Stella Biderman Edward Raff Dragomir R. Radev Vassilina Nikoulina CLL VLM AI4CE LRM 35 81 0 19 Dec 2022
Parameter-Efficient Finetuning of Transformers for Source Code Shamil Ayupov Nadezhda Chirkova 22 17 0 12 Dec 2022
FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer Shibo Jie Zhi-Hong Deng 28 126 0 06 Dec 2022
Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning Shih-Cheng Huang Shi Wang Min-Han Shih Saurav Sahay Hung-yi Lee 42 0 0 02 Dec 2022
Adapted Multimodal BERT with Layer-wise Fusion for Sentiment Analysis Odysseas S. Chlapanis Georgios Paraskevopoulos Alexandros Potamianos 32 9 0 01 Dec 2022
CHAPTER: Exploiting Convolutional Neural Network Adapters for Self-supervised Speech Models Zih-Ching Chen Yu-Shun Sung Hung-yi Lee 29 16 0 01 Dec 2022
Learning Label Modular Prompts for Text Classification in the Wild Hailin Chen Amrita Saha Chenyu You Steven C. H. Hoi OOD VLM 26 5 0 30 Nov 2022
SPARTAN: Sparse Hierarchical Memory for Parameter-Efficient Transformers Ameet Deshpande Md Arafat Sultan Anthony Ferritto Ashwin Kalyan Karthik R. Narasimhan Avirup Sil MoE 46 1 0 29 Nov 2022
SciRepEval: A Multi-Format Benchmark for Scientific Document Representations Amanpreet Singh Mike DÁrcy Arman Cohan Doug Downey Sergey Feldman 24 82 0 23 Nov 2022
Semi-Supervised Lifelong Language Learning Ying Zhao Yinhe Zheng Yu Bowen Zhiliang Tian Dongkyu Lee Jian Sun Haiyang Yu Yongbin Li N. Zhang CLL KELM 43 3 0 23 Nov 2022
HyperTuning: Toward Adapting Large Language Models without Back-propagation Jason Phang Yi Mao Pengcheng He Weizhu Chen 31 30 0 22 Nov 2022
ConStruct-VL: Data-Free Continual Structured VL Concepts Learning James Smith Paola Cascante-Bonilla Assaf Arbelle Donghyun Kim Yikang Shen David D. Cox Diyi Yang Z. Kira Rogerio Feris Leonid Karlinsky VLM 47 20 0 17 Nov 2022
Structured Pruning Adapters Lukas Hedegaard Aman Alok Juby Jose Alexandros Iosifidis 38 10 0 17 Nov 2022
Parameter-Efficient Tuning on Layer Normalization for Pre-trained Language Models Wang Qi Yu-Ping Ruan Y. Zuo Taihao Li 27 18 0 16 Nov 2022
Bridging Fairness and Environmental Sustainability in Natural Language Processing Marius Hessenthaler Emma Strubell Dirk Hovy Anne Lauscher 24 8 0 08 Nov 2022