Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,810 papers shown

Title
Towards Unified Prompt Tuning for Few-shot Text Classification Rongxiang Weng Chengyu Wang Fuli Luo Chuanqi Tan Minghui Qiu Fei Yang Qiuhui Shi Songfang Huang Ming Gao VLM 43 28 0 11 May 2022
Beyond Bounding Box: Multimodal Knowledge Learning for Object Detection Wei Feng Xingyuan Bu Chenchen Zhang Xubin Li VLM 12 4 0 09 May 2022
ProQA: Structural Prompt-based Pre-training for Unified Question Answering Wanjun Zhong Yifan Gao Ning Ding Yujia Qin Zhiyuan Liu Ming Zhou Jiahai Wang Jian Yin Nan Duan 20 34 0 09 May 2022
Declaration-based Prompt Tuning for Visual Question Answering Yuhang Liu Wei Wei Daowan Peng Feida Zhu MLLM VLM 27 19 0 05 May 2022
Language Models in the Loop: Incorporating Prompting into Weak Supervision Ryan Smith Jason Alan Fries Braden Hancock Stephen H. Bach 55 53 0 04 May 2022
Lexical Knowledge Internalization for Neural Dialog Generation Zhiyong Wu Wei Bi Xiang Li Lingpeng Kong B. Kao 21 2 0 04 May 2022
P^3 Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based Learning and Pre-finetuning Xiaomeng Hu S. Yu Chenyan Xiong Zhenghao Liu Zhiyuan Liu Geoffrey X. Yu 26 11 0 04 May 2022
All You May Need for VQA are Image Captions Soravit Changpinyo Doron Kukliansky Idan Szpektor Xi Chen Nan Ding Radu Soricut 32 70 0 04 May 2022
Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning Oscar Sainz Itziar Gonzalez-Dios Oier López de Lacalle Bonan Min Eneko Agirre 36 49 0 03 May 2022
CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction Jiaju Lin Qin Chen Jie Zhou Jian Jin Liangye He 22 23 0 01 May 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing Chengyu Wang Minghui Qiu Chen Shi Taolin Zhang Tingting Liu Lei Li Rongxiang Weng Ming Wang Jun Huang W. Lin 27 21 0 30 Apr 2022
Prompt Consistency for Zero-Shot Task Generalization Chunting Zhou Junxian He Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig VLM 26 74 0 29 Apr 2022
Polyglot Prompt: Multilingual Multitask PrompTraining Jinlan Fu See-Kiong Ng Pengfei Liu 29 7 0 29 Apr 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 35 9 0 29 Apr 2022
Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation Kexin Yang Dayiheng Liu Wenqiang Lei Baosong Yang Mingfeng Xue Boxing Chen Jun Xie 38 29 0 28 Apr 2022
NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue I. Casanueva Ivan Vulić Georgios P. Spithourakis Paweł Budzianowski 29 10 0 27 Apr 2022
Probing Simile Knowledge from Pre-trained Language Models Weijie Chen Yongzhu Chang Rongsheng Zhang Jiashu Pu Guandan Chen Le Zhang Yadong Xi Yijiang Chen Chang Su 24 11 0 27 Apr 2022
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations Roy Schwartz Gabriel Stanovsky 42 26 0 27 Apr 2022
ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation Yufei Xu Jing Zhang Qiming Zhang Dacheng Tao ViT 30 515 0 26 Apr 2022
Natural Language to Code Translation with Execution Freda Shi Daniel Fried Marjan Ghazvininejad Luke Zettlemoyer Sida I. Wang 40 124 0 25 Apr 2022
Decorate the Examples: A Simple Method of Prompt Design for Biomedical Relation Extraction Hui-Syuan Yeh Thomas Lavergne Pierre Zweigenbaum 26 10 0 21 Apr 2022
Unsupervised Ranking and Aggregation of Label Descriptions for Zero-Shot Classifiers Angelo Basile Marc Franco-Salvador Paolo Rosso VLM 12 2 0 20 Apr 2022
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models Chunyuan Li Haotian Liu Liunian Harold Li Pengchuan Zhang J. Aneja ... Ping Jin Houdong Hu Zicheng Liu Yong Jae Lee Jianfeng Gao 50 145 0 19 Apr 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 29 4 0 18 Apr 2022
OMG: Observe Multiple Granularities for Natural Language-Based Vehicle Retrieval Yunhao Du Binyu Zhang Xiang Ruan Zhicheng Zhao Zhaohui Hou Hong Chen 35 5 0 18 Apr 2022
Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting G. Han Long Chen Jiawei Ma Shiyuan Huang Ramalingam Chellappa Shih-Fu Chang VLM 32 20 0 16 Apr 2022
A Contrastive Cross-Channel Data Augmentation Framework for Aspect-based Sentiment Analysis Bing Wang Liang Ding Qihuang Zhong Ximing Li Dacheng Tao 34 32 0 16 Apr 2022
UniGDD: A Unified Generative Framework for Goal-Oriented Document-Grounded Dialogue Chang Gao Wenxuan Zhang W. Lam 48 13 0 16 Apr 2022
In-BoXBART: Get Instructions into Biomedical Multi-Task Learning Mihir Parmar Swaroop Mishra Mirali Purohit Man Luo M. H. Murad Chitta Baral 28 22 0 15 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 51 149 0 15 Apr 2022
Image Captioning In the Transformer Age Yangliu Xu Li Li Haiyang Xu Songfang Huang Fei Huang Jianfei Cai ViT 27 5 0 15 Apr 2022
Rows from Many Sources: Enriching row completions from Wikidata with a pre-trained Language Model Carina Negreanu Alperen Karaoglu Jack Williams Shuang Chen Daniel Fabian Andrew D. Gordon Chin-Yew Lin RALM AIMat LMTD 27 2 0 14 Apr 2022
A Unified Multi-task Learning Framework for Multi-goal Conversational Recommender Systems Yang Deng Wenxuan Zhang Weiwen Xu Wenqiang Lei Tat-Seng Chua W. Lam LRM 40 61 0 14 Apr 2022
Impossible Triangle: What's Next for Pre-trained Language Models? Chenguang Zhu Michael Zeng 24 1 0 13 Apr 2022
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 44 176 0 12 Apr 2022
Exploring the Universal Vulnerability of Prompt-based Learning Paradigm Lei Xu Yangyi Chen Yuchen Zhang Hongcheng Gao Zhiyuan Liu SILM VPVLM 27 72 0 11 Apr 2022
Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0 F. Toni Christopher Akiki Javier de la Rosa Clémentine Fourrier Enrique Manjavacas Stefan Schweter Daniel Alexander van Strien 31 10 0 11 Apr 2022
Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning Hongyi Yuan Zheng Yuan Sheng Yu MedIm 22 43 0 11 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 41 465 0 10 Apr 2022
Parameter-Efficient Tuning by Manipulating Hidden States of Pretrained Language Models For Classification Tasks Haoran Yang Piji Li Wai Lam 31 3 0 10 Apr 2022
Contrastive Demonstration Tuning for Pre-trained Language Models Xiaozhuan Liang Ningyu Zhang Shuyang Cheng Zhenru Zhang Chuanqi Tan Huajun Chen VLM ALM VPVLM 47 9 0 09 Apr 2022
Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learning Shicheng Xu Liang Pang Huawei Shen Xueqi Cheng VLM 37 17 0 06 Apr 2022
Can language models learn from explanations in context? Andrew Kyle Lampinen Ishita Dasgupta Stephanie C. Y. Chan Kory Matthewson Michael Henry Tessler Antonia Creswell James L. McClelland Jane X. Wang Felix Hill LRM ReLM 61 286 0 05 Apr 2022
Improved and Efficient Conversational Slot Labeling through Question Answering Gabor Fuisz Ivan Vulić Samuel Gibbons I. Casanueva Paweł Budzianowski 23 11 0 05 Apr 2022
Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers and Ordinal Regression Mohammadmahdi Nouriborji Omid Rohanian David Clifton 26 1 0 01 Apr 2022
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning Ziyun Xu Chengyu Wang Minghui Qiu Fuli Luo Runxin Xu Songfang Huang Jun Huang VLM 46 31 0 01 Apr 2022
Exploring Visual Prompts for Adapting Large-Scale Models Hyojin Bahng Ali Jahanian S. Sankaranarayanan Phillip Isola VLM VPVLM LRM 25 256 0 31 Mar 2022
SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks Kai-Wei Chang Wei-Cheng Tseng Shang-Wen Li Hung-yi Lee 30 22 0 31 Mar 2022
Towards Few-shot Entity Recognition in Document Images: A Label-aware Sequence-to-Sequence Framework Zilong Wang Jingbo Shang 36 10 0 30 Mar 2022
Position-based Prompting for Health Outcome Generation Micheal Abaho Danushka Bollegala P. Williamson S. Dodd 12 9 0 30 Mar 2022