Prefix-Tuning: Optimizing Continuous Prompts for Generation

1 January 2021

Xiang Lisa Li

Papers citing "Prefix-Tuning: Optimizing Continuous Prompts for Generation"

50 / 2,607 papers shown

Title
Fine-tuning Image Transformers using Learnable Memory Mark Sandler A. Zhmoginov Max Vladymyrov Andrew Jackson ViT 34 47 0 29 Mar 2022
Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5) Shijie Geng Shuchang Liu Zuohui Fu Yingqiang Ge Yongfeng Zhang VLM AI4TS 28 454 0 24 Mar 2022
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View Boxi Cao Hongyu Lin Xianpei Han Fangchao Liu Le Sun ELM AAML 28 41 0 23 Mar 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 45 1,538 0 23 Mar 2022
How well does CLIP understand texture? Chenyun Wu Subhransu Maji 30 6 0 22 Mar 2022
A Prompting-based Approach for Adversarial Example Generation and Robustness Enhancement Yuting Yang Pei Huang Juan Cao Jintao Li Yun Lin Jin Song Dong Feifei Ma Jian Zhang AAML SILM 38 13 0 21 Mar 2022
Continual Sequence Generation with Adaptive Compositional Modules Yanzhe Zhang Xuezhi Wang Diyi Yang KELM CLL 51 42 0 20 Mar 2022
On Robust Prefix-Tuning for Text Classification Zonghan Yang Yang Liu VLM 26 20 0 19 Mar 2022
Prototypical Verbalizer for Prompt-based Few-shot Tuning Ganqu Cui Shengding Hu Ning Ding Longtao Huang Zhiyuan Liu VLM 20 96 0 18 Mar 2022
PRBoost: Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning Rongzhi Zhang Yue Yu Pranav Shetty Le Song Chao Zhang 32 23 0 18 Mar 2022
Multi-Stage Prompting for Knowledgeable Dialogue Generation Zihan Liu M. Patwary R. Prenger Shrimai Prabhumoye Ming-Yu Liu Mohammad Shoeybi Bryan Catanzaro 32 50 0 16 Mar 2022
Continuous Detection, Rapidly React: Unseen Rumors Detection based on Continual Prompt-Tuning Yuhui Zuo Wei Zhu Guoyong Cai CLL VLM 37 11 0 16 Mar 2022
Iteratively Prompt Pre-trained Language Models for Chain of Thought Boshi Wang Xiang Deng Huan Sun KELM ReLM LRM 44 95 0 16 Mar 2022
Hyperdecoders: Instance-specific decoders for multi-task NLP Hamish Ivison Matthew E. Peters AI4CE 39 20 0 15 Mar 2022
Modular and Parameter-Efficient Multimodal Fusion with Prompting Sheng Liang Mengjie Zhao Hinrich Schütze 38 42 0 15 Mar 2022
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models Archiki Prasad Peter Hase Xiang Zhou Joey Tianyi Zhou 26 118 0 14 Mar 2022
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models Ning Ding Yujia Qin Guang Yang Fu Wei Zonghan Yang ... Jianfei Chen Yang Liu Jie Tang Juan Li Maosong Sun 44 197 0 14 Mar 2022
Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning Yuxin Jiang Linhan Zhang Wei Wang SSL 16 47 0 14 Mar 2022
A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings Haochen Tan Wei Shao Han Wu Ke Yang Linqi Song 30 17 0 11 Mar 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 53 1,296 0 10 Mar 2022
HealthPrompt: A Zero-shot Learning Paradigm for Clinical Natural Language Processing Sonish Sivarajkumar Yanshan Wang VLM LM&MA 39 54 0 09 Mar 2022
Visual-Language Navigation Pretraining via Prompt-based Environmental Self-exploration Xiwen Liang Fengda Zhu Lingling Li Hang Xu Xiaodan Liang LM&Ro VLM 36 29 0 08 Mar 2022
HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Tasks Zhengkun Zhang Wenya Guo Xiaojun Meng Yasheng Wang Yadao Wang Xin Jiang Qun Liu Zhenglu Yang 39 16 0 08 Mar 2022
Input-Tuning: Adapting Unfamiliar Inputs to Frozen Pretrained Models Shengnan An Yifei Li Zeqi Lin Qian Liu Bei Chen Qiang Fu Weizhu Chen Nanning Zheng Jian-Guang Lou VLM AAML 47 40 0 07 Mar 2022
Unfreeze with Care: Space-Efficient Fine-Tuning of Semantic Parsing Models Weiqi Sun Haidar Khan Nicolas Guenon des Mesnards M. Rubino Konstantine Arkoudas 41 5 0 05 Mar 2022
Controlling the Focus of Pretrained Language Generation Models Jiabao Ji Yoon Kim James R. Glass Tianxing He 45 5 0 02 Mar 2022
HyperPrompt: Prompt-based Task-Conditioning of Transformers Yun He H. Zheng Yi Tay Jai Gupta Yu Du ... Yaguang Li Zhaoji Chen Donald Metzler Heng-Tze Cheng Ed H. Chi LRM VLM 26 85 0 01 Mar 2022
Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language Generation Zhuang Li Lizhen Qu Qiongkai Xu Tongtong Wu Tianyang Zhan Gholamreza Haffari CoGe UD DRL 51 4 0 27 Feb 2022
Controllable Natural Language Generation with Contrastive Prefixes Jing Qian Li Dong Yelong Shen Furu Wei Weizhu Chen 10 95 0 27 Feb 2022
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction Yubo Ma Zehao Wang Yixin Cao Mukai Li Meiqi Chen Kunze Wang Jing Shao 40 131 0 24 Feb 2022
Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt Lianzhe Huang Shuming Ma Dongdong Zhang Furu Wei Houfeng Wang VLM LRM 26 32 0 23 Feb 2022
Prompt-Learning for Short Text Classification Yi Zhu Xinke Zhou Jipeng Qiang Yun Li Yunhao Yuan Xindong Wu VLM 18 34 0 23 Feb 2022
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution Ananya Kumar Aditi Raghunathan Robbie Jones Tengyu Ma Percy Liang OODD 50 646 0 21 Feb 2022
$$\mathcal{Y}$-Tuning: An Efficient Tuning Paradigm for Large-Scale Pre-Trained Models via Label Representation Learning$ $\mathcal{Y}$ -Tuning: An Efficient Tuning Paradigm for Large-Scale Pre-Trained Models via Label Representation Learning Yitao Liu Chen An Xipeng Qiu 29 17 0 20 Feb 2022
ST-MoE: Designing Stable and Transferable Sparse Expert Models Barret Zoph Irwan Bello Sameer Kumar Nan Du Yanping Huang J. Dean Noam M. Shazeer W. Fedus MoE 24 182 0 17 Feb 2022
Revisiting Parameter-Efficient Tuning: Are We Really There Yet? Guanzheng Chen Fangyu Liu Zaiqiao Meng Shangsong Liang 26 88 0 16 Feb 2022
EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation Tao Ge Si-Qing Chen Furu Wei MoE 32 20 0 16 Feb 2022
Delving Deeper into Cross-lingual Visual Question Answering Chen Cecilia Liu Jonas Pfeiffer Anna Korhonen Ivan Vulić Iryna Gurevych 42 8 0 15 Feb 2022
P4E: Few-Shot Event Detection as Prompt-Guided Identification and Localization Sha Li Liyuan Liu Yiqing Xie Heng Ji Jiawei Han 41 4 0 15 Feb 2022
Personalized Prompt Learning for Explainable Recommendation Lei Li Yongfeng Zhang Li Chen LRM 27 166 0 15 Feb 2022
Domain Adaptation via Prompt Learning Chunjiang Ge Rui Huang Mixue Xie Zihang Lai Shiji Song Shuang Li Gao Huang VPVLM VLM 38 144 0 14 Feb 2022
I-Tuning: Tuning Frozen Language Models with Image for Lightweight Image Captioning Ziyang Luo Zhipeng Hu Yadong Xi Rongsheng Zhang Jing Ma VLM 28 13 0 14 Feb 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP Yulong Chen Yang Liu Li Dong Shuohang Wang Chenguang Zhu Michael Zeng Yue Zhang VLM 32 45 0 10 Feb 2022
Generating Training Data with Language Models: Towards Zero-Shot Language Understanding Yu Meng Jiaxin Huang Yu Zhang Jiawei Han SyDa 32 229 0 09 Feb 2022
Exploring the Limits of Domain-Adaptive Training for Detoxifying Large-Scale Language Models Wei Ping Ming-Yu Liu Chaowei Xiao Peng Xu M. Patwary Mohammad Shoeybi Bo Li Anima Anandkumar Bryan Catanzaro 31 65 0 08 Feb 2022
Prompt-Guided Injection of Conformation to Pre-trained Protein Model Qiang Zhang Zeyuan Wang Yuqiang Han Haoran Yu Xurui Jin Huajun Chen 33 3 0 07 Feb 2022
Towards Coherent and Consistent Use of Entities in Narrative Generation Pinelopi Papalampidi Kris Cao Tomás Kociský HILM 22 12 0 03 Feb 2022
Co-training Improves Prompt-based Learning for Large Language Models Hunter Lang Monica Agrawal Yoon Kim David Sontag VLM LRM 174 40 0 02 Feb 2022
Deep Learning Approaches on Image Captioning: A Review Taraneh Ghandi H. Pourreza H. Mahyar VLM 30 89 0 31 Jan 2022
Describing Differences between Text Distributions with Natural Language Ruiqi Zhong Charles Burton Snell Dan Klein Jacob Steinhardt VLM 134 42 0 28 Jan 2022