Prefix-Tuning: Optimizing Continuous Prompts for Generation

1 January 2021

Xiang Lisa Li

Papers citing "Prefix-Tuning: Optimizing Continuous Prompts for Generation"

50 / 2,607 papers shown

Title
Protum: A New Method For Prompt Tuning Based on "[MASK]" Pan He Yuxi Chen Yan Wang Yanru Zhang AAML 27 3 0 28 Jan 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 450 8,699 0 28 Jan 2022
Ontology-enhanced Prompt-tuning for Few-shot Learning Hongbin Ye Ningyu Zhang Shumin Deng Xiang Chen Hui Chen Zhiyu Li Xi Chen Huajun Chen 127 62 0 27 Jan 2022
Learning to Compose Diversified Prompts for Image Emotion Classification Sinuo Deng Lifang Wu Ge Shi Lehao Xing Meng Jian Ye Xiang CLIP VLM 26 26 0 26 Jan 2022
Context-Tuning: Learning Contextualized Prompts for Natural Language Generation Tianyi Tang Junyi Li Wayne Xin Zhao Ji-Rong Wen 33 15 0 21 Jan 2022
Black-box Prompt Learning for Pre-trained Language Models Shizhe Diao Zhichao Huang Ruijia Xu Xuechun Li Yong Lin Xiao Zhou Tong Zhang VLM AAML 41 68 0 21 Jan 2022
Fooling MOSS Detection with Pretrained Language Models Stella Biderman Edward Raff DeLMO 19 35 0 19 Jan 2022
Instance-aware Prompt Learning for Language Understanding and Generation Feihu Jin Jinliang Lu Jiajun Zhang Chengqing Zong 25 32 0 18 Jan 2022
What Makes the Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generation Li Lin Yixin Cao Lifu Huang Shuang Li Xuming Hu Lijie Wen Jianmin Wang AI4TS 45 17 0 18 Jan 2022
Memory-assisted prompt editing to improve GPT-3 after deployment Aman Madaan Niket Tandon Peter Clark Yiming Yang KELM 42 0 0 16 Jan 2022
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models Tianbao Xie Chen Henry Wu Peng Shi Ruiqi Zhong Torsten Scholak ... Lingpeng Kong Rui Zhang Noah A. Smith Luke Zettlemoyer Tao Yu LMTD 42 297 0 16 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 34 101 0 15 Jan 2022
A Dual Prompt Learning Framework for Few-Shot Dialogue State Tracking Yuting Yang Wenqiang Lei Pei Huang Juan Cao Jintao Li Tat-Seng Chua 33 14 0 15 Jan 2022
Eliciting Knowledge from Pretrained Language Models for Prototypical Prompt Verbalizer Yinyi Wei Tong Mo Yong-jia Jiang Weiping Li Wen Zhao VLM 37 15 0 14 Jan 2022
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models Hanqing Zhang Haolin Song Shaoyu Li Ming Zhou Dawei Song 57 215 0 14 Jan 2022
Pretrained Language Models for Text Generation: A Survey Junyi Li Tianyi Tang Wayne Xin Zhao J. Nie Ji-Rong Wen AI4CE 38 128 0 14 Jan 2022
Black-Box Tuning for Language-Model-as-a-Service Tianxiang Sun Yunfan Shao Hong Qian Xuanjing Huang Xipeng Qiu VLM 55 256 0 10 Jan 2022
Improved Input Reprogramming for GAN Conditioning Tuan Dinh Daewon Seo Zhixu Du Liang Shang Kangwook Lee AI4CE 27 8 0 07 Jan 2022
Efficient Large Scale Language Modeling with Mixtures of Experts Mikel Artetxe Shruti Bhosale Naman Goyal Todor Mihaylov Myle Ott ... Jeff Wang Luke Zettlemoyer Mona T. Diab Zornitsa Kozareva Ves Stoyanov MoE 61 188 0 20 Dec 2021
Efficient Hierarchical Domain Adaptation for Pretrained Language Models Alexandra Chronopoulou Matthew E. Peters Jesse Dodge 33 42 0 16 Dec 2021
NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics Ximing Lu Sean Welleck Peter West Liwei Jiang Jungo Kasai ... Lianhui Qin Youngjae Yu Rowan Zellers Noah A. Smith Yejin Choi 11 158 0 16 Dec 2021
Prompt Tuning GPT-2 language model for parameter-efficient domain adaptation of ASR systems Saket Dingliwal Ashish Shenoy S. Bodapati Ankur Gandhe R. Gadde Katrin Kirchhoff VLM 33 4 0 16 Dec 2021
DREAM: Improving Situational QA by First Elaborating the Situation Yuling Gu Bhavana Dalvi Peter Clark 21 18 0 16 Dec 2021
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 22 743 0 16 Dec 2021
Reconsidering the Past: Optimizing Hidden States in Language Models Davis Yoshida Kevin Gimpel BDL 31 2 0 16 Dec 2021
Learning To Retrieve Prompts for In-Context Learning Ohad Rubin Jonathan Herzig Jonathan Berant VPVLM RALM 14 667 0 16 Dec 2021
Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts Daniel Khashabi Xinxi Lyu Sewon Min Lianhui Qin Kyle Richardson ... Hannaneh Hajishirzi Tushar Khot Ashish Sabharwal Sameer Singh Yejin Choi 26 75 0 15 Dec 2021
Improving Conversational Recommendation Systems' Quality with Context-Aware Item Meta Information Bowen Yang Cong Han Yu Li Lei Zuo Zhou Yu 17 41 0 15 Dec 2021
LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Framework Mengjie Zhao Fei Mi Yasheng Wang Minglei Li Xin Jiang Qun Liu Hinrich Schütze RALM 40 11 0 14 Dec 2021
VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks Yi-Lin Sung Jaemin Cho Joey Tianyi Zhou VLM VPVLM 37 344 0 13 Dec 2021
ValueNet: A New Dataset for Human Value Driven Dialogue System Liang Qiu Yizhou Zhao Jinchao Li Pan Lu Baolin Peng Jianfeng Gao Song-Chun Zhu 30 35 0 12 Dec 2021
Discourse-Aware Soft Prompting for Text Generation Marjan Ghazvininejad Vladimir Karpukhin Vera Gor Asli Celikyilmaz 31 6 0 10 Dec 2021
Pruning Pretrained Encoders with a Multitask Objective Patrick Xia Richard Shin 47 0 0 10 Dec 2021
Analysis and Prediction of NLP Models Via Task Embeddings Damien Sileo Marie-Francine Moens 24 3 0 10 Dec 2021
Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation Tianyi Liu Zuxuan Wu Wenhan Xiong Jingjing Chen Yu-Gang Jiang VLM MLLM 32 10 0 10 Dec 2021
MAGMA -- Multimodal Augmentation of Generative Models through Adapter-based Finetuning C. Eichenberg Sid Black Samuel Weinbach Letitia Parcalabescu Anette Frank MLLM VLM 23 100 0 09 Dec 2021
Prompting Visual-Language Models for Efficient Video Understanding Chen Ju Tengda Han Kunhao Zheng Ya Zhang Weidi Xie VPVLM VLM 33 364 0 08 Dec 2021
Quantifying Adaptability in Pre-trained Language Models with 500 Tasks Belinda Z. Li Jane A. Yu Madian Khabsa Luke Zettlemoyer A. Halevy Jacob Andreas ELM 30 16 0 06 Dec 2021
VT-CLIP: Enhancing Vision-Language Models with Visual-guided Texts Longtian Qiu Renrui Zhang Ziyu Guo Wei Zhang Zilu Guo Ziyao Zeng Guangnan Zhang VLM CLIP 30 45 0 04 Dec 2021
Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks Xizhou Zhu Jinguo Zhu Hao Li Xiaoshi Wu Xiaogang Wang Hongsheng Li Xiaohua Wang Jifeng Dai 56 129 0 02 Dec 2021
A Simple Long-Tailed Recognition Baseline via Vision-Language Model Teli Ma Shijie Geng Mengmeng Wang Jing Shao Jiasen Lu Hongsheng Li Peng Gao Yu Qiao VLM 40 46 0 29 Nov 2021
True Few-Shot Learning with Prompts -- A Real-World Perspective Timo Schick Hinrich Schütze VLM 27 64 0 26 Nov 2021
Domain Prompt Learning for Efficiently Adapting CLIP to Unseen Domains X. Zhang S. Gu Yutaka Matsuo Yusuke Iwasawa VLM 55 37 0 25 Nov 2021
Training Neural Networks with Fixed Sparse Masks Yi-Lin Sung Varun Nair Colin Raffel FedML 32 197 0 18 Nov 2021
ClipCap: CLIP Prefix for Image Captioning Ron Mokady Amir Hertz Amit H. Bermano CLIP VLM 28 658 0 18 Nov 2021
Few-Shot Self-Rationalization with Natural Language Prompts Ana Marasović Iz Beltagy Doug Downey Matthew E. Peters LRM 30 106 0 16 Nov 2021
On Transferability of Prompt Tuning for Natural Language Processing Yusheng Su Xiaozhi Wang Yujia Qin Chi-Min Chan Yankai Lin ... Peng Li Juanzi Li Lei Hou Maosong Sun Jie Zhou AAML VLM 31 100 0 12 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 86 83 0 08 Nov 2021
Response Generation with Context-Aware Prompt Learning X. Gu Kang Min Yoo Sang-Woo Lee 32 25 0 04 Nov 2021
CLUES: Few-Shot Learning Evaluation in Natural Language Understanding Subhabrata Mukherjee Xiaodong Liu Guoqing Zheng Saghar Hosseini Hao Cheng Greg Yang Christopher Meek Ahmed Hassan Awadallah Jianfeng Gao ELM 33 11 0 04 Nov 2021