Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,810 papers shown

Title
Enhanced compound-protein binding affinity prediction by representing protein multimodal information via a coevolutionary strategy Binjie Guo Hanyu Zheng Haohan Jiang Xiaodan Li Nai-Yang Guan Yanming Zuo Yicheng Zhang Hengfu Yang Xuhua Wang 19 4 0 30 Mar 2022
Evaluating Prompts Across Multiple Choice Tasks In a Zero-Shot Setting Gabriel Orlanski LRM 29 2 0 29 Mar 2022
Bridge-Prompt: Towards Ordinal Action Understanding in Instructional Videos Muheng Li Lei Chen Yueqi Duan Zhilan Hu Jianjiang Feng Jie Zhou Jiwen Lu 19 75 0 26 Mar 2022
Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5) Shijie Geng Shuchang Liu Zuohui Fu Yingqiang Ge Yongfeng Zhang VLM AI4TS 23 454 0 24 Mar 2022
Can Unsupervised Knowledge Transfer from Social Discussions Help Argument Mining? Subhabrata Dutta Jeevesh Juneja Dipankar Das Tanmoy Chakraborty 25 16 0 24 Mar 2022
A Survey on Cross-Lingual Summarization Jiaan Wang Fandong Meng Duo Zheng Yunlong Liang Zhixu Li Jianfeng Qu Jie Zhou AILaw 28 60 0 23 Mar 2022
Prompt-based System for Personality and Interpersonal Reactivity Prediction Bin Li Yixuan Weng 22 7 0 23 Mar 2022
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View Boxi Cao Hongyu Lin Xianpei Han Fangchao Liu Le Sun ELM AAML 28 41 0 23 Mar 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 40 1,538 0 23 Mar 2022
A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning Hugo Elias Berg S. Hall Yash Bhalgat Wonsuk Yang Hannah Rose Kirk Aleksandar Shtedritski Max Bain VLM 25 99 0 22 Mar 2022
How well does CLIP understand texture? Chenyun Wu Subhransu Maji 30 6 0 22 Mar 2022
A Prompting-based Approach for Adversarial Example Generation and Robustness Enhancement Yuting Yang Pei Huang Juan Cao Jintao Li Yun Lin Jin Song Dong Feifei Ma Jian Zhang AAML SILM 38 13 0 21 Mar 2022
On Robust Prefix-Tuning for Text Classification Zonghan Yang Yang Liu VLM 26 20 0 19 Mar 2022
PRBoost: Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning Rongzhi Zhang Yue Yu Pranav Shetty Le Song Chao Zhang 27 23 0 18 Mar 2022
ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection Thomas Hartvigsen Saadia Gabriel Hamid Palangi Maarten Sap Dipankar Ray Ece Kamar 38 353 0 17 Mar 2022
How Many Data Samples is an Additional Instruction Worth? Ravsehaj Singh Puri Swaroop Mishra Mihir Parmar Chitta Baral 25 17 0 17 Mar 2022
RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction Yew Ken Chia Lidong Bing Soujanya Poria Luo Si 26 101 0 17 Mar 2022
Speaker Information Can Guide Models to Better Inductive Biases: A Case Study On Predicting Code-Switching Alissa Ostapenko S. Wintner Melinda Fricke Yulia Tsvetkov 37 5 0 16 Mar 2022
ConTinTin: Continual Learning from Task Instructions Wenpeng Yin Jia Li Caiming Xiong CLL 31 29 0 16 Mar 2022
Continuous Detection, Rapidly React: Unseen Rumors Detection based on Continual Prompt-Tuning Yuhui Zuo Wei Zhu Guoyong Cai CLL VLM 34 11 0 16 Mar 2022
Iteratively Prompt Pre-trained Language Models for Chain of Thought Boshi Wang Xiang Deng Huan Sun KELM ReLM LRM 41 95 0 16 Mar 2022
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction Kuan-Hao Huang I-Hung Hsu Premkumar Natarajan Kai-Wei Chang Nanyun Peng 41 65 0 15 Mar 2022
Things not Written in Text: Exploring Spatial Commonsense from Visual Signals Xiao Liu Da Yin Yansong Feng Dongyan Zhao LRM 21 45 0 15 Mar 2022
Modular and Parameter-Efficient Multimodal Fusion with Prompting Sheng Liang Mengjie Zhao Hinrich Schütze 38 42 0 15 Mar 2022
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models Archiki Prasad Peter Hase Xiang Zhou Joey Tianyi Zhou 26 117 0 14 Mar 2022
CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailment Haoyu Song Li Dong Weinan Zhang Ting Liu Furu Wei VLM CLIP 33 137 0 14 Mar 2022
Towards Unifying the Label Space for Aspect- and Sentence-based Sentiment Analysis Yiming Zhang Min Zhang Sai Wu Jun Zhao 30 14 0 14 Mar 2022
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models Ning Ding Yujia Qin Guang Yang Fu Wei Zonghan Yang ... Jianfei Chen Yang Liu Jie Tang Juan Li Maosong Sun 34 197 0 14 Mar 2022
Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Video Bin Li Yixuan Weng Bin Sun Shutao Li 35 26 0 13 Mar 2022
Low-Rank Softmax Can Have Unargmaxable Classes in Theory but Rarely in Practice Andreas Grivas Nikolay Bogoychev Adam Lopez 17 9 0 12 Mar 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 53 1,294 0 10 Mar 2022
Internet-augmented language models through few-shot prompting for open-domain question answering Angeliki Lazaridou E. Gribovskaya Wojciech Stokowiec N. Grigorev KELM LRM 20 132 0 10 Mar 2022
HealthPrompt: A Zero-shot Learning Paradigm for Clinical Natural Language Processing Sonish Sivarajkumar Yanshan Wang VLM LM&MA 39 54 0 09 Mar 2022
HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Tasks Zhengkun Zhang Wenya Guo Xiaojun Meng Yasheng Wang Yadao Wang Xin Jiang Qun Liu Zhenglu Yang 36 16 0 08 Mar 2022
Input-Tuning: Adapting Unfamiliar Inputs to Frozen Pretrained Models Shengnan An Yifei Li Zeqi Lin Qian Liu Bei Chen Qiang Fu Weizhu Chen Nanning Zheng Jian-Guang Lou VLM AAML 42 40 0 07 Mar 2022
Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Tracking Jamin Shin Hangyeol Yu Hyeongdon Moon Andrea Madotto Juneyoung Park 33 29 0 03 Mar 2022
QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition Andy T. Liu Wei Xiao Henghui Zhu Dejiao Zhang Shang-Wen Li Andrew O. Arnold 14 26 0 03 Mar 2022
EPPAC: Entity Pre-typing Relation Classification with Prompt AnswerCentralizing Jiejun Tan Wenbin Hu Weiwei Liu 24 1 0 01 Mar 2022
Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processing Tal August Lucy Lu Wang Jonathan Bragg Marti A. Hearst Andrew Head Kyle Lo 28 40 0 28 Feb 2022
SemSup: Semantic Supervision for Simple and Scalable Zero-shot Generalization Austin W. Hanjie Ameet Deshpande Karthik Narasimhan VLM 36 2 0 26 Feb 2022
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction Yubo Ma Zehao Wang Yixin Cao Mukai Li Meiqi Chen Kunze Wang Jing Shao 40 131 0 24 Feb 2022
Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt Lianzhe Huang Shuming Ma Dongdong Zhang Furu Wei Houfeng Wang VLM LRM 26 32 0 23 Feb 2022
Prompt-Learning for Short Text Classification Yi Zhu Xinke Zhou Jipeng Qiang Yun Li Yunhao Yuan Xindong Wu VLM 18 34 0 23 Feb 2022
Contextual Semantic Embeddings for Ontology Subsumption Prediction Jiaoyan Chen Yuan He Yuxia Geng Ernesto Jiménez-Ruiz Hang Dong Ian Horrocks 35 51 0 20 Feb 2022
Revisiting Parameter-Efficient Tuning: Are We Really There Yet? Guanzheng Chen Fangyu Liu Zaiqiao Meng Shangsong Liang 26 88 0 16 Feb 2022
ZeroGen: Efficient Zero-shot Learning via Dataset Generation Jiacheng Ye Jiahui Gao Qintong Li Hang Xu Jiangtao Feng Zhiyong Wu Tao Yu Lingpeng Kong SyDa 49 212 0 16 Feb 2022
Personalized Prompt Learning for Explainable Recommendation Lei Li Yongfeng Zhang Li Chen LRM 24 166 0 15 Feb 2022
On Tracking Dialogue State by Inheriting Slot Values in Mentioned Slot Pools Zhoujian Sun Zhengxing Huang Nai Ding 17 7 0 15 Feb 2022
Domain Adaptation via Prompt Learning Chunjiang Ge Rui Huang Mixue Xie Zihang Lai Shiji Song Shuang Li Gao Huang VPVLM VLM 36 144 0 14 Feb 2022
Investigating Explainability of Generative AI for Code through Scenario-based Design Jiao Sun Q. V. Liao Michael J. Muller Mayank Agarwal Stephanie Houde Kartik Talamadupula Justin D. Weisz 36 157 0 10 Feb 2022