Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
Prompt-based Learning for Unpaired Image Captioning Peipei Zhu Tianlin Li Lin Zhu Zhenglong Sun Weishi Zheng Yaowei Wang Chen Chen VLM 97 33 0 26 May 2022
Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling Kaitao Song Yichong Leng Xu Tan Yicheng Zou Tao Qin Dongsheng Li 107 11 0 25 May 2022
Large Language Models are Few-Shot Clinical Information Extractors Monica Agrawal S. Hegselmann Hunter Lang Yoon Kim David Sontag BDL LM&MA 253 350 0 25 May 2022
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning Prakhar Gupta Cathy Jiao Yi-Ting Yeh Shikib Mehri M. Eskénazi Jeffrey P. Bigham ALM 119 48 0 25 May 2022
DFM: Dialogue Foundation Model for Universal Large-Scale Dialogue-Oriented Task Learning Zhi Chen Jijia Bao Lu Chen Yuncong Liu Da Ma ... Xinhsuai Dong Fujiang Ge Qingliang Miao Jian-Guang Lou Kai Yu ALM AI4CE 88 3 0 25 May 2022
Few-shot Reranking for Multi-hop QA via Language Model Prompting Muhammad Khalifa Lajanugen Logeswaran Moontae Lee Ho Hin Lee Lu Wang LRM 114 20 0 25 May 2022
Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generation Tu Vu Aditya Barua Brian Lester Daniel Cer Mohit Iyyer Noah Constant CLL 95 66 0 25 May 2022
ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Data Xiaochuang Han Yulia Tsvetkov 97 31 0 25 May 2022
Is a Question Decomposition Unit All We Need? Pruthvi H. Patel Swaroop Mishra Mihir Parmar Chitta Baral ReLM 220 52 0 25 May 2022
Conditional set generation using Seq2seq models Aman Madaan Dheeraj Rajagopal Niket Tandon Yiming Yang Antoine Bosselut 68 10 0 25 May 2022
Learning a Better Initialization for Soft Prompts via Meta-Learning Yukun Huang Kun Qian Zhou Yu VLM 141 9 0 25 May 2022
Toxicity Detection with Generative Prompt-based Inference Yau-Shian Wang Y. Chang 150 37 0 24 May 2022
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing Linlu Qiu Peter Shaw Panupong Pasupat Tianze Shi Jonathan Herzig Emily Pitler Fei Sha Kristina Toutanova AI4CE LRM 160 54 0 24 May 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 606 4,077 0 24 May 2022
Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition Zihan Wang Kewen Zhao Zilong Wang Jingbo Shang 75 6 0 24 May 2022
On Measuring Social Biases in Prompt-Based Multi-Task Learning Afra Feyza Akyürek Sejin Paik Muhammed Yusuf Kocyigit S. Akbiyik cSerife Leman Runyun Derry Wijaya ALM 93 14 0 23 May 2022
Many-Class Text Classification with Matching Yi-Fan Song Yuxian Gu Minlie Huang VLM 29 1 0 23 May 2022
Looking for a Handsome Carpenter! Debiasing GPT-3 Job Advertisements Conrad Borchers Dalia Sara Gala Ben Gilburt Eduard Oravkin Wilfried Bounsi Yuki M. Asano Hannah Rose Kirk AI4CE 72 29 0 23 May 2022
BBTv2: Towards a Gradient-Free Future with Large Language Models Tianxiang Sun Zhengfu He Hong Qian Yunhua Zhou Xuanjing Huang Xipeng Qiu 150 57 0 23 May 2022
PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models Yuan Yao Qi-An Chen Ao Zhang Wei Ji Zhiyuan Liu Tat-Seng Chua Maosong Sun VLM MLLM 93 38 0 23 May 2022
Prompt Tuning for Discriminative Pre-trained Language Models Yuan Yao Bowen Dong Ao Zhang Zhengyan Zhang Ruobing Xie Zhiyuan Liu Leyu Lin Maosong Sun Jianyong Wang VLM 80 34 0 23 May 2022
Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding Rishabh Bhardwaj Amrita Saha Guosheng Lin Soujanya Poria VLM VPVLM 53 7 0 23 May 2022
Instruction Induction: From Few Examples to Natural Language Task Descriptions Or Honovich Uri Shaham Samuel R. Bowman Omer Levy ELM LRM 283 146 0 22 May 2022
How sensitive are translation systems to extra contexts? Mitigating gender bias in Neural Machine Translation models through relevant contexts Shanya Sharma Manan Dey Koustuv Sinha 57 12 0 22 May 2022
Self-Supervised Speech Representation Learning: A Review Abdel-rahman Mohamed Hung-yi Lee Lasse Borgholt Jakob Drachmann Havtorn Joakim Edin ... Shang-Wen Li Karen Livescu Lars Maaløe Tara N. Sainath Shinji Watanabe SSL AI4TS 287 368 0 21 May 2022
Few-Shot Natural Language Inference Generation with PDD: Prompt and Dynamic Demonstration Kaijian Li Shansan Gong Kenny Q. Zhu 56 0 0 21 May 2022
Evaluating and Inducing Personality in Pre-trained Language Models Guangyuan Jiang Manjie Xu Song-Chun Zhu Wenjuan Han Fangqiu Yi Yixin Zhu 114 89 0 20 May 2022
Can Foundation Models Wrangle Your Data? A. Narayan Ines Chami Laurel J. Orr Simran Arora Christopher Ré LMTD AI4CE 239 231 0 20 May 2022
Are Prompt-based Models Clueless? Pride Kavumba Ryo Takahashi Yusuke Oda VLM 208 13 0 19 May 2022
PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners Canyu Chen Kai Shu VLM 104 8 0 18 May 2022
Automatic Rule Induction for Interpretable Semi-Supervised Learning Reid Pryzant Ziyi Yang Yichong Xu Chenguang Zhu Michael Zeng 81 10 0 18 May 2022
Leveraging Pseudo-labeled Data to Improve Direct Speech-to-Speech Translation Qianqian Dong Fengpeng Yue Tom Ko Mingxuan Wang Qibing Bai Yu Zhang 90 16 0 18 May 2022
What GPT Knows About Who is Who Xiaohan Yang Eduardo Peynetti Vasco Meerman Christy Tanner 206 14 0 16 May 2022
SeqZero: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models Jingfeng Yang Haoming Jiang Qingyu Yin Danqing Zhang Bing Yin Diyi Yang 78 48 0 15 May 2022
Adaptive Prompt Learning-based Few-Shot Sentiment Analysis Pengfei Zhang Tingting Chai Yongdong Xu VLM 80 13 0 15 May 2022
Clinical Prompt Learning with Frozen Language Models Niall Taylor Yi Zhang Dan W Joyce A. Nevado-Holgado Andrey Kormilitzin VLM LM&MA 58 33 0 11 May 2022
Making Pretrained Language Models Good Long-tailed Learners Chen Zhang Lei Ren Jingang Wang Wei Wu Dawei Song RALM VLM 81 9 0 11 May 2022
Towards Unified Prompt Tuning for Few-shot Text Classification Jiadong Wang Chengyu Wang Fuli Luo Chuanqi Tan Minghui Qiu Fei Yang Qiuhui Shi Songfang Huang Ming Gao VLM 70 28 0 11 May 2022
Beyond Bounding Box: Multimodal Knowledge Learning for Object Detection Wei Feng Xingyuan Bu Chenchen Zhang Xubin Li VLM 40 4 0 09 May 2022
ProQA: Structural Prompt-based Pre-training for Unified Question Answering Wanjun Zhong Yifan Gao Ning Ding Yujia Qin Zhiyuan Liu Ming Zhou Jiahai Wang Jian Yin Nan Duan 81 34 0 09 May 2022
Declaration-based Prompt Tuning for Visual Question Answering Yuhang Liu Wei Wei Daowan Peng Feida Zhu MLLM VLM 56 19 0 05 May 2022
Language Models in the Loop: Incorporating Prompting into Weak Supervision Ryan Smith Jason Alan Fries Braden Hancock Stephen H. Bach 112 56 0 04 May 2022
Lexical Knowledge Internalization for Neural Dialog Generation Zhiyong Wu Wei Bi Xiang Li Lingpeng Kong B. Kao 65 2 0 04 May 2022
P^3 Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based Learning and Pre-finetuning Xiaomeng Hu S. Yu Chenyan Xiong Zhenghao Liu Zhiyuan Liu Geoffrey X. Yu 35 11 0 04 May 2022
All You May Need for VQA are Image Captions Soravit Changpinyo Doron Kukliansky Idan Szpektor Xi Chen Nan Ding Radu Soricut 101 76 0 04 May 2022
Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning Oscar Sainz Itziar Gonzalez-Dios Oier López de Lacalle Bonan Min Eneko Agirre 79 50 0 03 May 2022
CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction Jiaju Lin Qin Chen Jie Zhou Jian Jin Liangye He 82 24 0 01 May 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing Chengyu Wang Minghui Qiu Chen Shi Taolin Zhang Tingting Liu Lei Li Jiadong Wang Ming Wang Jun Huang W. Lin 78 21 0 30 Apr 2022
Prompt Consistency for Zero-Shot Task Generalization Chunting Zhou Junxian He Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig VLM 108 79 0 29 Apr 2022
Polyglot Prompt: Multilingual Multitask PrompTraining Jinlan Fu See-Kiong Ng Pengfei Liu 68 8 0 29 Apr 2022