v1v2 (latest)

Parameter-Efficient Transfer Learning for NLP

2 February 2019

N. Houlsby

A. Giurgiu

Stanislaw Jastrzebski

Bruna Morrone

Quentin de Laroussilhe

Papers citing "Parameter-Efficient Transfer Learning for NLP"

50 / 2,860 papers shown

Title
Making Pretrained Language Models Good Long-tailed Learners Chen Zhang Lei Ren Jingang Wang Wei Wu Dawei Song RALM VLM 81 9 0 11 May 2022
Extracting Latent Steering Vectors from Pretrained Language Models Nishant Subramani Nivedita Suresh Matthew E. Peters LLMSV 95 101 0 10 May 2022
Automated Evaluation for Student Argumentative Writing: A Survey Xinyu Wang Yohan Lee Juneyoung Park 47 13 0 09 May 2022
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention Yifan Chen Devamanyu Hazarika Mahdi Namazifar Yang Liu Di Jin Dilek Z. Hakkani-Tür 59 9 0 07 May 2022
Efficient Few-Shot Fine-Tuning for Opinion Summarization Arthur Bravzinskas Ramesh Nallapati Joey Tianyi Zhou Markus Dreyer 40 24 0 04 May 2022
Training Mixed-Domain Translation Models via Federated Learning Peyman Passban Tanya Roosta Rahul Gupta Ankit R. Chadha Clement Chung FedML AI4CE 94 18 0 03 May 2022
Adaptable Adapters N. Moosavi Quentin Delfosse Kristian Kersting Iryna Gurevych 101 21 0 03 May 2022
Embedding Hallucination for Few-Shot Language Fine-tuning Yiren Jian Chongyang Gao Soroush Vosoughi 87 4 0 03 May 2022
FINETUNA: Fine-tuning Accelerated Molecular Simulations Joseph Musielewicz Xiaoxiao Wang Tian Tian Zachary W. Ulissi 58 33 0 02 May 2022
Robust Fine-tuning via Perturbation and Interpolation from In-batch Instances Shoujie Tong Qingxiu Dong Damai Dai Yifan Song Tianyu Liu Baobao Chang Zhifang Sui AAML 65 6 0 02 May 2022
Engineering flexible machine learning systems by traversing functionally-invariant paths G. Raghavan Bahey Tharwat S. N. Hari Dhruvil Satani Matt Thomson OOD AI4CE 86 8 0 30 Apr 2022
AdapterBias: Parameter-efficient Token-dependent Representation Shift for Adapters in NLP Tasks Chin-Lun Fu Zih-Ching Chen Yun-Ru Lee Hung-yi Lee 91 49 0 30 Apr 2022
Prompt Consistency for Zero-Shot Task Generalization Chunting Zhou Junxian He Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig VLM 115 79 0 29 Apr 2022
Flamingo: a Visual Language Model for Few-Shot Learning Jean-Baptiste Alayrac Jeff Donahue Pauline Luc Antoine Miech Iain Barr ... Mikolaj Binkowski Ricardo Barreira Oriol Vinyals Andrew Zisserman Karen Simonyan MLLM VLM 442 3,621 0 29 Apr 2022
Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation Kexin Yang Dayiheng Liu Wenqiang Lei Baosong Yang Mingfeng Xue Boxing Chen Jun Xie 86 29 0 28 Apr 2022
Super-Prompting: Utilizing Model-Independent Contextual Data to Reduce Data Annotation Required in Visual Commonsense Tasks Navid Rezaei Marek Reformat VLM 52 2 0 25 Apr 2022
Identifying Chinese Opinion Expressions with Extremely-Noisy Crowdsourcing Annotations Xin Zhang Guangwei Xu Yueheng Sun Meishan Zhang Xiaobin Wang Hao Fei 142 11 0 22 Apr 2022
KALA: Knowledge-Augmented Language Model Adaptation Minki Kang Jinheon Baek Sung Ju Hwang VLM KELM 100 36 0 22 Apr 2022
Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnaires Thong Nguyen Andrew Yates Ayah Zirikly Bart Desmet Arman Cohan AI4MH 95 53 0 21 Apr 2022
Standing on the Shoulders of Giant Frozen Language Models Yoav Levine Itay Dalmedigos Ori Ram Yoel Zeldes Daniel Jannai ... Barak Lenz Shai Shalev-Shwartz Amnon Shashua Kevin Leyton-Brown Y. Shoham VLM 103 49 0 21 Apr 2022
Layer-wise Fast Adaptation for End-to-End Multi-Accent Speech Recognition Xun Gong Y. Qian Houjun Huang Yanmin Qian 81 46 0 21 Apr 2022
K-LITE: Learning Transferable Visual Models with External Knowledge Sheng Shen Chunyuan Li Xiaowei Hu Jianwei Yang Yujia Xie ... Ce Liu Kurt Keutzer Trevor Darrell Anna Rohrbach Jianfeng Gao CLIP VLM 72 85 0 20 Apr 2022
Infusing Linguistic Knowledge of SMILES into Chemical Language Models Ingoo Lee Hojung Nam 41 6 0 20 Apr 2022
CodexDB: Generating Code for Processing SQL Queries using GPT-3 Codex Immanuel Trummer LMTD 62 19 0 19 Apr 2022
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models Chunyuan Li Haotian Liu Liunian Harold Li Pengchuan Zhang J. Aneja ... Ping Jin Houdong Hu Zicheng Liu Yong Jae Lee Jianfeng Gao 112 153 0 19 Apr 2022
On The Cross-Modal Transfer from Natural Language to Code through Adapter Modules Divyam Goel Raman Grover Fatemeh H. Fard 76 19 0 19 Apr 2022
VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance Katherine Crowson Stella Biderman Daniel Kornis Dashiell Stander Eric Hallahan Louis Castricato Edward Raff CLIP 195 381 0 18 Apr 2022
Bridging Cross-Lingual Gaps During Leveraging the Multilingual Sequence-to-Sequence Pretraining for Text Generation and Understanding Changtong Zan Liang Ding Li Shen Yu Cao Weifeng Liu Dacheng Tao LRM 103 8 0 16 Apr 2022
Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuning Jesujoba Oluwadara Alabi David Ifeoluwa Adelani Marius Mosbach Dietrich Klakow 95 153 0 13 Apr 2022
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 110 187 0 12 Apr 2022
Learning to Express in Knowledge-Grounded Conversation Xueliang Zhao Tingchen Fu Chongyang Tao Wei Wu Dongyan Zhao Rui Yan 64 6 0 12 Apr 2022
A Call for Clarity in Beam Search: How It Works and When It Stops Jungo Kasai Keisuke Sakaguchi Ronan Le Bras Dragomir R. Radev Yejin Choi Noah A. Smith 108 9 0 11 Apr 2022
Efficient Extraction of Pathologies from C-Spine Radiology Reports using Multi-Task Learning Arijit Sehanobish Nathaniel K. Brown Ishita Daga Jayashri Pawar Danielle Torres Anasuya Das M. Becker Richard Herzog Benjamin Odry Ron Vianu MedIm 62 2 0 09 Apr 2022
IDPG: An Instance-Dependent Prompt Generation Method Zhuofeng Wu Sinong Wang Jiatao Gu Rui Hou Yuxiao Dong V. Vydiswaran Hao Ma VLM 86 62 0 09 Apr 2022
GRAM: Fast Fine-tuning of Pre-trained Language Models for Content-based Collaborative Filtering Yoonseok Yang Kyu Seok Kim Minsam Kim Juneyoung Park VLM 62 8 0 08 Apr 2022
Fair and Argumentative Language Modeling for Computational Argumentation Carolin Holtermann Anne Lauscher Simone Paolo Ponzetto 78 21 0 08 Apr 2022
Federated Learning with Partial Model Personalization Krishna Pillutla Kshitiz Malik Abdel-rahman Mohamed Michael G. Rabbat Maziar Sanjabi Lin Xiao FedML 117 170 0 08 Apr 2022
Incremental Prototype Tuning for Class Incremental Learning Jieren Deng Jianhua Hu Haojian Zhang Yunkuan Wang CLL VLM 116 3 0 07 Apr 2022
Parameter-Efficient Abstractive Question Answering over Tables or Text Vaishali Pal Evangelos Kanoulas Maarten de Rijke LMTD 69 15 0 07 Apr 2022
Domain Adaptation for Time-Series Classification to Mitigate Covariate Shift Felix Ott David Rügamer Lucas Heublein Bernd Bischl Christopher Mutschler OOD TTA AI4TS 84 33 0 07 Apr 2022
Genre-conditioned Acoustic Models for Automatic Lyrics Transcription of Polyphonic Music Xiaoxue Gao Chitralekha Gupta Haizhou Li 78 21 0 07 Apr 2022
Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval Robert Litschko Ivan Vulić Goran Glavaš LRM 146 15 0 05 Apr 2022
Improved and Efficient Conversational Slot Labeling through Question Answering Gabor Fuisz Ivan Vulić Samuel Gibbons I. Casanueva Paweł Budzianowski 93 11 0 05 Apr 2022
"This is my unicorn, Fluffy": Personalizing frozen vision-language representations Niv Cohen Rinon Gal E. Meirom Gal Chechik Yuval Atzmon VLM MLLM 130 88 0 04 Apr 2022
SHiFT: An Efficient, Flexible Search Engine for Transfer Learning Cédric Renggli Xiaozhe Yao Luka Kolar Luka Rimanic Ana Klimovic Ce Zhang OOD 112 5 0 04 Apr 2022
PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models Rabeeh Karimi Mahabadi Luke Zettlemoyer James Henderson Marzieh Saeidi Lambert Mathias Ves Stoyanov Majid Yazdani VLM 85 72 0 03 Apr 2022
Proper Reuse of Image Classification Features Improves Object Detection C. N. Vasconcelos Vighnesh Birodkar Vincent Dumoulin VLM 103 32 0 01 Apr 2022
Scaling Language Model Size in Cross-Device Federated Learning Jae Hun Ro Theresa Breiner Lara McConnaughey Mingqing Chen A. Suresh Shankar Kumar Rajiv Mathews FedML 63 26 0 31 Mar 2022
Parameter-efficient Model Adaptation for Vision Transformers Xuehai He Chunyuan Li Pengchuan Zhang Jianwei Yang Xinze Wang 90 91 0 29 Mar 2022
Fine-tuning Image Transformers using Learnable Memory Mark Sandler A. Zhmoginov Max Vladymyrov Andrew Jackson ViT 93 48 0 29 Mar 2022