v1v2 (latest)

The Power of Scale for Parameter-Efficient Prompt Tuning

18 April 2021

Papers citing "The Power of Scale for Parameter-Efficient Prompt Tuning"

50 / 2,607 papers shown

Title
DeepStruct: Pretraining of Language Models for Structure Prediction Chenguang Wang Xiao Liu Zui Chen Haoyun Hong Jie Tang Dawn Song 276 71 0 21 May 2022
Evaluating and Inducing Personality in Pre-trained Language Models Guangyuan Jiang Manjie Xu Song-Chun Zhu Wenjuan Han Fangqiu Yi Yixin Zhu 114 89 0 20 May 2022
Can Foundation Models Wrangle Your Data? A. Narayan Ines Chami Laurel J. Orr Simran Arora Christopher Ré LMTD AI4CE 239 231 0 20 May 2022
RankGen: Improving Text Generation with Large Ranking Models Kalpesh Krishna Yapei Chang John Wieting Mohit Iyyer AIMat 79 69 0 19 May 2022
A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunities Yisheng Song Ting-Yuan Wang S. Mondal J. P. Sahoo SLR 128 390 0 13 May 2022
Dynamic Prefix-Tuning for Generative Template-based Event Extraction Xiao Liu Heyan Huang Ge Shi Bo Wang 74 101 0 12 May 2022
AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling Haoqin Tu Zhongliang Yang Jinshuai Yang Yong Huang 42 12 0 12 May 2022
RITA: a Study on Scaling Up Generative Protein Sequence Models Daniel Hesslow Niccoló Zanichelli Pascal Notin Iacopo Poli D. Marks 63 99 0 11 May 2022
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning Haokun Liu Derek Tam Mohammed Muqeeth Jay Mohta Tenghao Huang Joey Tianyi Zhou Colin Raffel 119 941 0 11 May 2022
Clinical Prompt Learning with Frozen Language Models Niall Taylor Yi Zhang Dan W Joyce A. Nevado-Holgado Andrey Kormilitzin VLM LM&MA 58 34 0 11 May 2022
Making Pretrained Language Models Good Long-tailed Learners Chen Zhang Lei Ren Jingang Wang Wei Wu Dawei Song RALM VLM 81 9 0 11 May 2022
Towards Unified Prompt Tuning for Few-shot Text Classification Jiadong Wang Chengyu Wang Fuli Luo Chuanqi Tan Minghui Qiu Fei Yang Qiuhui Shi Songfang Huang Ming Gao VLM 70 28 0 11 May 2022
UL2: Unifying Language Learning Paradigms Yi Tay Mostafa Dehghani Vinh Q. Tran Xavier Garcia Jason W. Wei ... Tal Schuster H. Zheng Denny Zhou N. Houlsby Donald Metzler AI4CE 141 313 0 10 May 2022
Extracting Latent Steering Vectors from Pretrained Language Models Nishant Subramani Nivedita Suresh Matthew E. Peters LLMSV 80 101 0 10 May 2022
ProQA: Structural Prompt-based Pre-training for Unified Question Answering Wanjun Zhong Yifan Gao Ning Ding Yujia Qin Zhiyuan Liu Ming Zhou Jiahai Wang Jian Yin Nan Duan 81 34 0 09 May 2022
Context-Aware Abbreviation Expansion Using Large Language Models Shanqing Cai Subhashini Venugopalan Katrin Tomanek Ajit Narayanan Meredith Ringel Morris Michael P. Brenner 66 28 0 08 May 2022
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention Yifan Chen Devamanyu Hazarika Mahdi Namazifar Yang Liu Di Jin Dilek Z. Hakkani-Tür 57 9 0 07 May 2022
Odor Descriptor Understanding through Prompting Laura Sisson 40 1 0 07 May 2022
ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characters Xue Bin Peng Yunrong Guo L. Halper Sergey Levine Sanja Fidler 62 15 0 04 May 2022
P^3 Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based Learning and Pre-finetuning Xiaomeng Hu S. Yu Chenyan Xiong Zhenghao Liu Zhiyuan Liu Geoffrey X. Yu 42 11 0 04 May 2022
Mixed-effects transformers for hierarchical adaptation Julia White Noah D. Goodman Robert D. Hawkins 53 2 0 03 May 2022
Improving In-Context Few-Shot Learning via Self-Supervised Training Mingda Chen Jingfei Du Ramakanth Pasunuru Todor Mihaylov Srini Iyer Ves Stoyanov Zornitsa Kozareva SSL AI4MH 107 67 0 03 May 2022
SparCAssist: A Model Risk Assessment Assistant Based on Sparse Generated Counterfactuals Zijian Zhang Vinay Setty Avishek Anand 56 7 0 03 May 2022
Embedding Hallucination for Few-Shot Language Fine-tuning Yiren Jian Chongyang Gao Soroush Vosoughi 82 4 0 03 May 2022
OPT: Open Pre-trained Transformer Language Models Susan Zhang Stephen Roller Naman Goyal Mikel Artetxe Moya Chen ... Daniel Simig Punit Singh Koura Anjali Sridhar Tianlu Wang Luke Zettlemoyer VLM OSLM AI4CE 397 3,714 0 02 May 2022
CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction Jiaju Lin Qin Chen Jie Zhou Jian Jin Liangye He 82 24 0 01 May 2022
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning Ehud D. Karpas Omri Abend Yonatan Belinkov Barak Lenz Opher Lieber ... Erez Schwartz Gal Shachaf Shai Shalev-Shwartz Amnon Shashua Moshe Tenenholtz LLMAG 74 70 0 01 May 2022
Polyglot Prompt: Multilingual Multitask PrompTraining Jinlan Fu See-Kiong Ng Pengfei Liu 68 8 0 29 Apr 2022
Flamingo: a Visual Language Model for Few-Shot Learning Jean-Baptiste Alayrac Jeff Donahue Pauline Luc Antoine Miech Iain Barr ... Mikolaj Binkowski Ricardo Barreira Oriol Vinyals Andrew Zisserman Karen Simonyan MLLM VLM 431 3,619 0 29 Apr 2022
Natural Language to Code Translation with Execution Freda Shi Daniel Fried Marjan Ghazvininejad Luke Zettlemoyer Sida I. Wang 127 129 0 25 Apr 2022
Standing on the Shoulders of Giant Frozen Language Models Yoav Levine Itay Dalmedigos Ori Ram Yoel Zeldes Daniel Jannai ... Barak Lenz Shai Shalev-Shwartz Amnon Shashua Kevin Leyton-Brown Y. Shoham VLM 99 49 0 21 Apr 2022
VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance Katherine Crowson Stella Biderman Daniel Kornis Dashiell Stander Eric Hallahan Louis Castricato Edward Raff CLIP 170 381 0 18 Apr 2022
Zero-shot Entity and Tweet Characterization with Designed Conditional Prompts and Contexts S. Srivatsa Tushar Mohan Kumari Neha Nishchay Malakar Ponnurangam Kumaraguru Srinath Srinivasa 60 0 0 18 Apr 2022
Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting G. Han Long Chen Jiawei Ma Shiyuan Huang Ramalingam Chellappa Shih-Fu Chang VLM 112 21 0 16 Apr 2022
A Contrastive Cross-Channel Data Augmentation Framework for Aspect-based Sentiment Analysis Bing Wang Liang Ding Qihuang Zhong Ximing Li Dacheng Tao 83 33 0 16 Apr 2022
UniGDD: A Unified Generative Framework for Goal-Oriented Document-Grounded Dialogue Chang Gao Wenxuan Zhang W. Lam 143 13 0 16 Apr 2022
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks Yizhong Wang Swaroop Mishra Pegah Alipoormolabashi Yeganeh Kordi Amirreza Mirzaei ... Chitta Baral Yejin Choi Noah A. Smith Hannaneh Hajishirzi Daniel Khashabi ELM 135 864 0 16 Apr 2022
Improving Passage Retrieval with Zero-Shot Question Generation Devendra Singh Sachan M. Lewis Mandar Joshi Armen Aghajanyan Wen-tau Yih J. Pineau Luke Zettlemoyer OOD LRM 130 168 0 15 Apr 2022
Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detection Minqian Liu Shiyu Chang Lifu Huang KELM CLL 88 29 0 15 Apr 2022
CLUES: A Benchmark for Learning Classifiers using Natural Language Explanations Rakesh R Menon Sayan Ghosh Shashank Srivastava LRM ELM 105 11 0 14 Apr 2022
Label Semantic Aware Pre-training for Few-shot Text Classification Aaron Mueller Jason Krone Salvatore Romeo Saab Mansour Elman Mansimov Yi Zhang Dan Roth VLM 67 38 0 14 Apr 2022
Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification Han Wang Canwen Xu Julian McAuley VLM 74 12 0 13 Apr 2022
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 103 187 0 12 Apr 2022
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? Thomas Wang Adam Roberts Daniel Hesslow Teven Le Scao Hyung Won Chung Iz Beltagy Julien Launay Colin Raffel 143 175 0 12 Apr 2022
Exploring the Universal Vulnerability of Prompt-based Learning Paradigm Lei Xu Yangyi Chen Ganqu Cui Hongcheng Gao Zhiyuan Liu SILM VPVLM 117 76 0 11 Apr 2022
Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0 F. Toni Christopher Akiki Javier de la Rosa Clémentine Fourrier Enrique Manjavacas Stefan Schweter Daniel Alexander van Strien 73 11 0 11 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 134 506 0 10 Apr 2022
Parameter-Efficient Tuning by Manipulating Hidden States of Pretrained Language Models For Classification Tasks Haoran Yang Piji Li Wai Lam 77 4 0 10 Apr 2022
IDPG: An Instance-Dependent Prompt Generation Method Zhuofeng Wu Sinong Wang Jiatao Gu Rui Hou Yuxiao Dong V. Vydiswaran Hao Ma VLM 78 62 0 09 Apr 2022
PSP: Pre-trained Soft Prompts for Few-Shot Abstractive Summarization Xiaochen Liu Yang Gao Yu Bai Jiawei Li Yinan Hu Yang Gao Boxing Chen 110 23 0 09 Apr 2022