v1v2 (latest)

Parameter-Efficient Transfer Learning for NLP

2 February 2019

N. Houlsby

A. Giurgiu

Stanislaw Jastrzebski

Bruna Morrone

Quentin de Laroussilhe

Papers citing "Parameter-Efficient Transfer Learning for NLP"

50 / 2,860 papers shown

Title
Transformers with Learnable Activation Functions Haishuo Fang Ji-Ung Lee N. Moosavi Iryna Gurevych AI4CE 63 8 0 30 Aug 2022
Prompt Tuning with Soft Context Sharing for Vision-Language Models Kun Ding Ying Wang Pengzhang Liu Qiang Yu Hao Zhang Shiming Xiang Chunhong Pan VPVLM VLM 81 15 0 29 Aug 2022
Conversion of Legal Agreements into Smart Legal Contracts using NLP Eason Chen Niall Roche Yuen-Hsien Tseng Walter Hernandez Cruz J. Shangguan Alastair Moore AILaw 44 3 0 27 Aug 2022
DPTDR: Deep Prompt Tuning for Dense Passage Retrieval Zhen-Quan Tang Benyou Wang Ting Yao VLM 78 14 0 24 Aug 2022
Few-Shot Table-to-Text Generation with Prefix-Controlled Generator Yutao Luo Menghua Lu Gongshen Liu Shilin Wang LMTD 68 8 0 23 Aug 2022
Review of Natural Language Processing in Pharmacology D. Trajanov Vangel Trajkovski Makedonka Dimitrieva Jovana Dobreva Milos Jovanovik Matej Klemen Alevs vZagar Marko Robnik-vSikonja LM&MA 117 7 0 22 Aug 2022
PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao VLM CLL 97 44 0 22 Aug 2022
Prompt-Matched Semantic Segmentation Lingbo Liu Jianlong Chang Bruce X. B. Yu Liang Lin Qi Tian Xin Sun VPVLM VLM 111 29 0 22 Aug 2022
A Multi-Head Model for Continual Learning via Out-of-Distribution Replay Gyuhak Kim Zixuan Ke Bin Liu VLM CLL OODD 73 31 0 20 Aug 2022
Ask Question First for Enhancing Lifelong Language Learning Han Wang Ruiliu Fu Xuejun Zhang Jun Zhou Qingwei Zhao CLL 77 0 0 17 Aug 2022
ILLUME: Rationalizing Vision-Language Models through Human Interactions Manuel Brack P. Schramowski Bjorn Deiseroth Kristian Kersting VLM MLLM 54 3 0 17 Aug 2022
Visual Comparison of Language Model Adaptation Rita Sevastjanova E. Cakmak Shauli Ravfogel Ryan Cotterell Mennatallah El-Assady VLM 94 16 0 17 Aug 2022
Reliable Decision from Multiple Subtasks through Threshold Optimization: Content Moderation in the Wild Donghyun Son Byounggyu Lew Kwanghee Choi Yongsu Baek Seungwoo Choi Beomjun Shin S. Ha Buru Chang 88 10 0 16 Aug 2022
Conv-Adapter: Exploring Parameter Efficient Transfer Learning for ConvNets Hao Chen R. Tao Han Zhang Yidong Wang Xiang Li Weirong Ye Jindong Wang Guosheng Hu Marios Savvides VPVLM 129 57 0 15 Aug 2022
Z-BERT-A: a zero-shot Pipeline for Unknown Intent detection Daniele Comi Dimitrios Christofidellis Pier Francesco Piazza Matteo Manica 116 4 0 15 Aug 2022
Reducing Retraining by Recycling Parameter-Efficient Prompts Brian Lester Joshua Yurtsever Siamak Shakeri Noah Constant 68 12 0 10 Aug 2022
Frozen CLIP Models are Efficient Video Learners Ziyi Lin Shijie Geng Renrui Zhang Peng Gao Gerard de Melo Xiaogang Wang Jifeng Dai Yu Qiao Hongsheng Li CLIP VLM 100 209 0 06 Aug 2022
Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models Margaret Li Suchin Gururangan Tim Dettmers M. Lewis Tim Althoff Noah A. Smith Luke Zettlemoyer MoMe 129 154 0 05 Aug 2022
Low-Resource Dense Retrieval for Open-Domain Question Answering: A Comprehensive Survey Xiaoyu Shen Svitlana Vakulenko Marco Del Tredici Gianni Barlacchi Bill Byrne Adria de Gispert RALM VLM 82 20 0 05 Aug 2022
Prompt Tuning for Generative Multimodal Pretrained Models Han Yang Junyang Lin An Yang Peng Wang Chang Zhou Hongxia Yang VLM LRM VPVLM 91 31 0 04 Aug 2022
Efficient Fine-Tuning of Compressed Language Models with Learners Danilo Vucetic Mohammadreza Tayaranian M. Ziaeefard J. Clark B. Meyer W. Gross 68 2 0 03 Aug 2022
Massively Multilingual Lexical Specialization of Multilingual Transformers Tommaso Green Simone Paolo Ponzetto Goran Glavaš 106 0 0 01 Aug 2022
Efficient NLP Model Finetuning via Multistage Data Filtering Ouyang Xu S. Ansari F. Lin Yangfeng Ji 74 4 0 28 Jul 2022
Pro-tuning: Unified Prompt Tuning for Vision Tasks Xing Nie Bolin Ni Jianlong Chang Gaomeng Meng Chunlei Huo Zhaoxiang Zhang Shiming Xiang Qi Tian Chunhong Pan AAML VPVLM VLM 133 76 0 28 Jul 2022
Discrete Key-Value Bottleneck Frederik Trauble Anirudh Goyal Nasim Rahaman Michael C. Mozer Kenji Kawaguchi Yoshua Bengio Bernhard Schölkopf CLL 92 23 0 22 Jul 2022
Emotion Separation and Recognition from a Facial Expression by Generating the Poker Face with Vision Transformers Jia Li Jian‐Hui Nie Dan Guo Richang Hong Meng Wang ViT 84 15 0 22 Jul 2022
Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classification Renrui Zhang Zhang Wei Rongyao Fang Peng Gao Kunchang Li Jifeng Dai Yu Qiao Hongsheng Li VLM 151 321 0 19 Jul 2022
On the Usability of Transformers-based models for a French Question-Answering task Oralie Cattan Christophe Servan Sophie Rosset 39 15 0 19 Jul 2022
Calibrated ensembles can mitigate accuracy tradeoffs under distribution shift Ananya Kumar Tengyu Ma Percy Liang Aditi Raghunathan UQCV OODD OOD 109 39 0 18 Jul 2022
STT: Soft Template Tuning for Few-Shot Adaptation Ping Yu Wei Wang Chunyuan Li Ruiyi Zhang Zhanpeng Jin Changyou Chen VLM 36 0 0 18 Jul 2022
Contrastive Adapters for Foundation Model Group Robustness Michael Zhang Christopher Ré VLM 59 64 0 14 Jul 2022
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers Weng Lam Tam Xiao Liu Kaixuan Ji Lilong Xue Xing Zhang Yuxiao Dong Jiahua Liu Maodi Hu Jie Tang VPVLM 84 27 0 14 Jul 2022
Convolutional Bypasses Are Better Vision Transformer Adapters Shibo Jie Zhi-Hong Deng VPVLM 94 137 0 14 Jul 2022
Embedding Recycling for Language Models Jon Saad-Falcon Amanpreet Singh Luca Soldaini Mike DÁrcy Arman Cohan Doug Downey KELM 63 4 0 11 Jul 2022
FairDistillation: Mitigating Stereotyping in Language Models Pieter Delobelle Bettina Berendt 71 8 0 10 Jul 2022
Getting BART to Ride the Idiomatic Train: Learning to Represent Idiomatic Expressions Ziheng Zeng S. Bhat 57 4 0 08 Jul 2022
Meta-Learning the Difference: Preparing Large Language Models for Efficient Adaptation Zejiang Hou Julian Salazar George Polovets 79 15 0 07 Jul 2022
Continual Learning with Transformers for Image Classification Beyza Ermis Giovanni Zappella Martin Wistuba Aditya Rawal Cédric Archambeau CLL 83 22 0 28 Jun 2022
ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learning Junting Pan Ziyi Lin Xiatian Zhu Jing Shao Hongsheng Li 109 207 0 27 Jun 2022
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold Sebastian Ruder Ivan Vulić Anders Søgaard 86 30 0 20 Jun 2022
A Unified Understanding of Deep NLP Models for Text Classification Zhuguo Li Xiting Wang Weikai Yang Jing Wu Zhengyan Zhang Zhiyuan Liu Maosong Sun Hui Zhang Shixia Liu VLM 61 32 0 19 Jun 2022
CLiMB: A Continual Learning Benchmark for Vision-and-Language Tasks Tejas Srinivasan Ting-Yun Chang Leticia Pinto-Alva Georgios Chochlakis Mohammad Rostami Jesse Thomason VLM CLL 114 76 0 18 Jun 2022
FiT: Parameter Efficient Few-shot Transfer Learning for Personalized and Federated Image Classification Aliaksandra Shysheya J. Bronskill Massimiliano Patacchiola Sebastian Nowozin Richard Turner 3DH FedML 104 28 0 17 Jun 2022
A Unified Evaluation of Textual Backdoor Learning: Frameworks and Benchmarks Ganqu Cui Lifan Yuan Bingxiang He Yangyi Chen Zhiyuan Liu Maosong Sun AAML ELM SILM 95 73 0 17 Jun 2022
GAAMA 2.0: An Integrated System that Answers Boolean and Extractive Questions Scott McCarley Mihaela A. Bornea Sara Rosenthal Anthony Ferritto Md Arafat Sultan Avirup Sil Radu Florian 42 1 0 16 Jun 2022
Zero-Shot Video Question Answering via Frozen Bidirectional Language Models Antoine Yang Antoine Miech Josef Sivic Ivan Laptev Cordelia Schmid 166 240 0 16 Jun 2022
Self-Generated In-Context Learning: Leveraging Auto-regressive Language Models as a Demonstration Generator Sungmin Cho Hyunsoo Cho Junyeob Kim Taeuk Kim Kang Min Yoo Sang-goo Lee 104 66 0 16 Jun 2022
DRAFT: A Novel Framework to Reduce Domain Shifting in Self-supervised Learning and Its Application to Children's ASR Ruchao Fan Abeer Alwan 93 30 0 16 Jun 2022
Sparse Structure Search for Parameter-Efficient Tuning Shengding Hu Zhen Zhang Ning Ding Yadao Wang Yasheng Wang Zhiyuan Liu Maosong Sun 81 17 0 15 Jun 2022
TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformer Jiajun Deng Zhengyuan Yang Daqing Liu Tianlang Chen Wen-gang Zhou Yanyong Zhang Houqiang Li Wanli Ouyang ViT 113 57 0 14 Jun 2022