v1v2 (latest)

Parameter-Efficient Transfer Learning for NLP

2 February 2019

N. Houlsby

A. Giurgiu

Stanislaw Jastrzebski

Bruna Morrone

Quentin de Laroussilhe

Papers citing "Parameter-Efficient Transfer Learning for NLP"

50 / 2,860 papers shown

Title
Semi-Siamese Bi-encoder Neural Ranking Model Using Lightweight Fine-Tuning Euna Jung Jaekeol Choi Wonjong Rhee 83 14 0 28 Oct 2021
The Efficiency Misnomer Daoyuan Chen Liuyi Yao Dawei Gao Ashish Vaswani Yaliang Li 112 103 0 25 Oct 2021
Multilingual Unsupervised Neural Machine Translation with Denoising Adapters Ahmet Üstün Alexandre Berard Laurent Besacier Matthias Gallé 84 47 0 20 Oct 2021
Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapters Asa Cooper Stickland Alexandre Berard Vassilina Nikoulina AI4CE 67 29 0 18 Oct 2021
Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Research Ross Gruetzemacher D. Paradice 97 35 0 18 Oct 2021
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora Xisen Jin Dejiao Zhang Henghui Zhu Wei Xiao Shang-Wen Li Xiaokai Wei Andrew O. Arnold Xiang Ren KELM CLL 126 117 0 16 Oct 2021
The Power of Prompt Tuning for Low-Resource Semantic Parsing Nathan Schucher Siva Reddy H. D. Vries VLM 168 36 0 16 Oct 2021
DS-TOD: Efficient Domain Specialization for Task Oriented Dialog Chia-Chien Hung Anne Lauscher Simone Paolo Ponzetto Goran Glavaš 99 31 0 15 Oct 2021
Control Prefixes for Parameter-Efficient Text Generation Jordan Clive Kris Cao Marek Rei 125 32 0 15 Oct 2021
Few-Shot Bot: Prompt-Based Learning for Dialogue Systems Andrea Madotto Zhaojiang Lin Genta Indra Winata Pascale Fung 101 85 0 15 Oct 2021
SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer Tu Vu Brian Lester Noah Constant Rami Al-Rfou Daniel Cer VLM LRM 223 290 0 15 Oct 2021
Exploring Universal Intrinsic Task Subspace via Prompt Tuning Yujia Qin Xiaozhi Wang Yusheng Su Yankai Lin Ning Ding ... Juanzi Li Lei Hou Peng Li Maosong Sun Jie Zhou VLM VPVLM 195 29 0 15 Oct 2021
UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning Yuning Mao Lambert Mathias Rui Hou Amjad Almahairi Hao Ma Jiawei Han Wen-tau Yih Madian Khabsa 109 198 0 14 Oct 2021
Composable Sparse Fine-Tuning for Cross-Lingual Transfer Alan Ansell Edoardo Ponti Anna Korhonen Ivan Vulić CLL MoE 159 143 0 14 Oct 2021
Plug-Tagger: A Pluggable Sequence Labeling Framework Using Language Models Xin Zhou Ruotian Ma Tao Gui Y. Tan Qi Zhang Xuanjing Huang VLM 75 5 0 14 Oct 2021
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 268 373 0 13 Oct 2021
LiST: Lite Prompted Self-training Makes Parameter-Efficient Few-shot Learners Yaqing Wang Subhabrata Mukherjee Xiaodong Liu Jing Gao Ahmed Hassan Awadallah Jianfeng Gao VLM BDL 110 11 0 12 Oct 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 376 1,066 0 09 Oct 2021
A Few More Examples May Be Worth Billions of Parameters Yuval Kirstain Patrick Lewis Sebastian Riedel Omer Levy 133 21 0 08 Oct 2021
Towards a Unified View of Parameter-Efficient Transfer Learning Junxian He Chunting Zhou Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig AAML 217 959 0 08 Oct 2021
Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics Prajjwal Bhargava Aleksandr Drozd Anna Rogers 169 108 0 04 Oct 2021
Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmark Joel Niklaus Ilias Chalkidis Matthias Sturmer ELM AILaw 72 70 0 02 Oct 2021
Single-dataset Experts for Multi-dataset Question Answering Dan Friedman Ben Dodge Danqi Chen MoMe 180 26 0 28 Sep 2021
Understanding and Overcoming the Challenges of Efficient Transformer Quantization Yelysei Bondarenko Markus Nagel Tijmen Blankevoort MQ 83 146 0 27 Sep 2021
Unsupervised Contextualized Document Representation Ankur Gupta Vivek Gupta 31 2 0 22 Sep 2021
The Trade-offs of Domain Adaptation for Neural Language Models David Grangier Dan Iter 84 22 0 21 Sep 2021
Knowledge-Enhanced Evidence Retrieval for Counterargument Generation Yohan Jo Haneul Yoo Jinyeong Bak Alice Oh Chris Reed Eduard H. Hovy RALM 92 12 0 19 Sep 2021
Efficient Attribute Injection for Pretrained Language Models Reinald Kim Amplayo Kang Min Yoo Sang-Woo Lee 45 0 0 16 Sep 2021
A Conditional Generative Matching Model for Multi-lingual Reply Suggestion Budhaditya Deb Guoqing Zheng Milad Shokouhi Ahmed Hassan Awadallah 72 1 0 15 Sep 2021
Residual Adapters for Parameter-Efficient ASR Adaptation to Atypical and Accented Speech Katrin Tomanek Vicky Zayats Dirk Padfield K. Vaillancourt Fadi Biadsy 128 58 0 14 Sep 2021
Automatically Exposing Problems with Neural Dialog Models Dian Yu Kenji Sagae 120 9 0 14 Sep 2021
Legal Transformer Models May Not Always Help Sakbo Geng R. Lebret Karl Aberer VLM AILaw ELM 75 12 0 14 Sep 2021
MDAPT: Multilingual Domain Adaptive Pretraining in a Single Model Rasmus Jorgensen Mareike Hartmann Xiang Dai Desmond Elliott AI4CE 49 13 0 14 Sep 2021
Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translation Xin Zheng Zhirui Zhang Shujian Huang Boxing Chen Jun Xie Weihua Luo Jiajun Chen 132 25 0 14 Sep 2021
xGQA: Cross-Lingual Visual Question Answering Jonas Pfeiffer Gregor Geigle Aishwarya Kamath Jan-Martin O. Steitz Stefan Roth Ivan Vulić Iryna Gurevych 117 62 0 13 Sep 2021
Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning Runxin Xu Fuli Luo Zhiyuan Zhang Chuanqi Tan Baobao Chang Songfang Huang Fei Huang LRM 211 190 0 13 Sep 2021
Total Recall: a Customized Continual Learning Method for Neural Semantic Parsers Zhuang Li Zhuang Li Gholamreza Haffari CLL 88 15 0 11 Sep 2021
Efficient Test Time Adapter Ensembling for Low-resource Language Varieties Xinyi Wang Yulia Tsvetkov Sebastian Ruder Graham Neubig 82 35 0 10 Sep 2021
Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT Zaiqiao Meng Fangyu Liu T. H. Clark Ehsan Shareghi Nigel Collier MoE 88 37 0 10 Sep 2021
Fusing task-oriented and open-domain dialogues in conversational agents Tom Young Frank Xing Vlad Pandelea Jinjie Ni Min Zhang 84 63 0 09 Sep 2021
A Survey on Machine Learning Techniques for Auto Labeling of Video, Audio, and Text Data Shikun Zhang Omid Jafari P. Nagarkar VLM 49 25 0 08 Sep 2021
Sustainable Modular Debiasing of Language Models Anne Lauscher Tobias Lüken Goran Glavaš 150 124 0 08 Sep 2021
Discrete and Soft Prompting for Multilingual Models Mengjie Zhao Hinrich Schütze LRM 92 72 0 08 Sep 2021
MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfer Ilias Chalkidis Manos Fergadiotis Ion Androutsopoulos AILaw 118 111 0 02 Sep 2021
LightNER: A Lightweight Tuning Paradigm for Low-resource NER via Pluggable Prompting Xiang Chen Lei Li Shumin Deng Chuanqi Tan Changliang Xu Fei Huang Luo Si Huajun Chen Ningyu Zhang VLM 147 71 0 31 Aug 2021
Task-Oriented Dialogue System as Natural Language Generation Weizhi Wang Zhirui Zhang Junliang Guo Yinpei Dai Boxing Chen Weihua Luo 115 34 0 31 Aug 2021
How Does Adversarial Fine-Tuning Benefit BERT? J. Ebrahimi Hao Yang Wei Zhang AAML 58 4 0 31 Aug 2021
Efficient Visual Recognition with Deep Neural Networks: A Survey on Recent Advances and New Directions Yang Wu Dingheng Wang Xiaotong Lu Fan Yang Guoqi Li W. Dong Jianbo Shi 110 18 0 30 Aug 2021
Design and Scaffolded Training of an Efficient DNN Operator for Computer Vision on the Edge Vinod Ganesan Pratyush Kumar 130 2 0 25 Aug 2021
AdapterHub Playground: Simple and Flexible Few-Shot Learning with Adapters Tilman Beck Bela Bohlender Christina Viehmann Vincent Hane Yanik Adamson Jaber Khuri Jonas Brossmann Jonas Pfeiffer Iryna Gurevych 76 16 0 18 Aug 2021