Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,808 papers shown

Title
Prompt-Guided Injection of Conformation to Pre-trained Protein Model Qiang Zhang Zeyuan Wang Yuqiang Han Haoran Yu Xurui Jin Huajun Chen 31 3 0 07 Feb 2022
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts Stephen H. Bach Victor Sanh Zheng-Xin Yong Albert Webson Colin Raffel ... Khalid Almubarak Xiangru Tang Dragomir R. Radev Mike Tian-Jian Jiang Alexander M. Rush VLM 225 339 0 02 Feb 2022
Co-training Improves Prompt-based Learning for Large Language Models Hunter Lang Monica Agrawal Yoon Kim David Sontag VLM LRM 172 39 0 02 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 395 8,559 0 28 Jan 2022
Synchromesh: Reliable code generation from pre-trained language models Gabriel Poesia Oleksandr Polozov Vu Le A. Tiwari Gustavo Soares Christopher Meek Sumit Gulwani 20 156 0 26 Jan 2022
Learning to Compose Diversified Prompts for Image Emotion Classification Sinuo Deng Lifang Wu Ge Shi Lehao Xing Meng Jian Ye Xiang CLIP VLM 24 26 0 26 Jan 2022
Relational Memory Augmented Language Models Qi Liu Dani Yogatama Phil Blunsom KELM RALM 67 32 0 24 Jan 2022
Description-Driven Task-Oriented Dialog Modeling Jeffrey Zhao Raghav Gupta Yuan Cao Dian Yu Mingqiu Wang Harrison Lee Abhinav Rastogi Izhak Shafran Yonghui Wu 48 64 0 21 Jan 2022
Context-Tuning: Learning Contextualized Prompts for Natural Language Generation Tianyi Tang Junyi Li Wayne Xin Zhao Ji-Rong Wen 33 15 0 21 Jan 2022
Black-box Prompt Learning for Pre-trained Language Models Shizhe Diao Zhichao Huang Ruijia Xu Xuechun Li Yong Lin Xiao Zhou Tong Zhang VLM AAML 36 68 0 21 Jan 2022
Fooling MOSS Detection with Pretrained Language Models Stella Biderman Edward Raff DeLMO 19 35 0 19 Jan 2022
CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities Mina Lee Percy Liang Qian Yang HAI 26 358 0 18 Jan 2022
Memory-assisted prompt editing to improve GPT-3 after deployment Aman Madaan Niket Tandon Peter Clark Yiming Yang KELM 38 0 0 16 Jan 2022
SNCSE: Contrastive Learning for Unsupervised Sentence Embedding with Soft Negative Samples Hao Wang Yangguang Li Zhen Huang Yong Dou Lingpeng Kong Jing Shao SSL 19 54 0 16 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 34 101 0 15 Jan 2022
A Dual Prompt Learning Framework for Few-Shot Dialogue State Tracking Yuting Yang Wenqiang Lei Pei Huang Juan Cao Jintao Li Tat-Seng Chua 33 14 0 15 Jan 2022
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models Hanqing Zhang Haolin Song Shaoyu Li Ming Zhou Dawei Song 52 214 0 14 Jan 2022
Pretrained Language Models for Text Generation: A Survey Junyi Li Tianyi Tang Wayne Xin Zhao J. Nie Ji-Rong Wen AI4CE 36 127 0 14 Jan 2022
A Unified Review of Deep Learning for Automated Medical Coding Shaoxiong Ji Wei Sun Xiaobo Li Hang Dong Ara Taalas Yijia Zhang Honghan Wu Esa Pitkänen Pekka Marttinen AI4TS MedIm 26 27 0 08 Jan 2022
Zero-shot Commonsense Question Answering with Cloze Translation and Consistency Optimization Zi-Yi Dou Nanyun Peng ELM 15 26 0 01 Jan 2022
A Simple Baseline for Open-Vocabulary Semantic Segmentation with Pre-trained Vision-language Model Mengde Xu Zheng-Wei Zhang Fangyun Wei Yutong Lin Yue Cao Han Hu Xiang Bai VLM 19 211 0 29 Dec 2021
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 22 738 0 16 Dec 2021
Analyzing the Limits of Self-Supervision in Handling Bias in Language Lisa Bauer Karthik Gopalakrishnan Spandana Gella Yang Liu Joey Tianyi Zhou Dilek Z. Hakkani-Tür ELM 24 1 0 16 Dec 2021
Learning To Retrieve Prompts for In-Context Learning Ohad Rubin Jonathan Herzig Jonathan Berant VPVLM RALM 14 666 0 16 Dec 2021
NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledge R. Reddy Sai Chetan Chinthakindi Zhenhailong Wang Yi R. Fung Kathryn Conger ... Martha Palmer Preslav Nakov Eduard H. Hovy Kevin Small Heng Ji VLM 22 28 0 16 Dec 2021
Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biases Shrimai Prabhumoye Rafal Kocielnik M. Shoeybi Anima Anandkumar Bryan Catanzaro 35 20 0 15 Dec 2021
LMTurk: Few-Shot Learners as Crowdsourcing Workers in a Language-Model-as-a-Service Framework Mengjie Zhao Fei Mi Yasheng Wang Minglei Li Xin Jiang Qun Liu Hinrich Schütze RALM 40 11 0 14 Dec 2021
Dependency Learning for Legal Judgment Prediction with a Unified Text-to-Text Transformer Yunyun Huang Xiaoyu Shen Chuanyi Li Jidong Ge B. Luo AILaw 25 19 0 13 Dec 2021
Discourse-Aware Soft Prompting for Text Generation Marjan Ghazvininejad Vladimir Karpukhin Vera Gor Asli Celikyilmaz 31 6 0 10 Dec 2021
Grounded Language-Image Pre-training Liunian Harold Li Pengchuan Zhang Haotian Zhang Jianwei Yang Chunyuan Li ... Lu Yuan Lei Zhang Lei Li Kai-Wei Chang Jianfeng Gao ObjD VLM 31 1,020 0 07 Dec 2021
Bridging Pre-trained Models and Downstream Tasks for Source Code Understanding Deze Wang Zhouyang Jia Shanshan Li Yue Yu Yun Xiong Wei Dong Xiangke Liao 38 80 0 04 Dec 2021
Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks Xizhou Zhu Jinguo Zhu Hao Li Xiaoshi Wu Xiaogang Wang Hongsheng Li Xiaohua Wang Jifeng Dai 56 129 0 02 Dec 2021
DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting Yongming Rao Wenliang Zhao Guangyi Chen Yansong Tang Zheng Zhu Guan Huang Jie Zhou Jiwen Lu VLM CLIP 94 551 0 02 Dec 2021
PSG: Prompt-based Sequence Generation for Acronym Extraction Bin Li Fei Xia Yi-Zhong Weng Xiusheng Huang Bin Sun Shutao Li 23 6 0 29 Nov 2021
Domain Prompt Learning for Efficiently Adapting CLIP to Unseen Domains X. Zhang S. Gu Yutaka Matsuo Yusuke Iwasawa VLM 41 36 0 25 Nov 2021
LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Model Yukyung Lee Jina Kim Pilsung Kang 9 78 0 18 Nov 2021
GraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Prediction Hanwen Xu Jiayou Zhang Zhirui Wang Shizhuo Zhang M. Bhalerao Yucong Liu Dawei Zhu Sheng Wang 22 5 0 13 Nov 2021
Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling Renrui Zhang Rongyao Fang Wei Zhang Peng Gao Kunchang Li Jifeng Dai Yu Qiao Hongsheng Li VLM 194 385 0 06 Nov 2021
Response Generation with Context-Aware Prompt Learning X. Gu Kang Min Yoo Sang-Woo Lee 22 25 0 04 Nov 2021
OpenPrompt: An Open-source Framework for Prompt-learning Ning Ding Shengding Hu Weilin Zhao Yulin Chen Zhiyuan Liu Haitao Zheng Maosong Sun VLM LLMAG 34 284 0 03 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 83 1,035 0 01 Nov 2021
Semi-Siamese Bi-encoder Neural Ranking Model Using Lightweight Fine-Tuning Euna Jung Jaekeol Choi Wonjong Rhee 22 13 0 28 Oct 2021
MEmoBERT: Pre-training Model with Prompt-based Learning for Multimodal Emotion Recognition Jinming Zhao Ruichen Li Qin Jin Xinchao Wang Haizhou Li 19 25 0 27 Oct 2021
Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubs Kaichao You Yong Liu Ziyang Zhang Jianmin Wang Michael I. Jordan Mingsheng Long 116 31 0 20 Oct 2021
Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation Pei Zhou Karthik Gopalakrishnan Behnam Hedayatnia Seokhwan Kim Jay Pujara Xiang Ren Yang Liu Dilek Z. Hakkani-Tür 39 41 0 16 Oct 2021
Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER Dong-Ho Lee Akshen Kadakia Kangmin Tan Mahak Agarwal Xinyu Feng Takashi Shibuya Ryosuke Mitani Toshiyuki Sekiya Jay Pujara Xiang Ren 43 84 0 16 Oct 2021
Metadata Shaping: Natural Language Annotations for the Tail Simran Arora Sen Wu Enci Liu Christopher Ré 32 0 0 16 Oct 2021
Control Prefixes for Parameter-Efficient Text Generation Jordan Clive Kris Cao Marek Rei 44 32 0 15 Oct 2021
mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka 31 30 0 15 Oct 2021
Few-Shot Bot: Prompt-Based Learning for Dialogue Systems Andrea Madotto Zhaojiang Lin Genta Indra Winata Pascale Fung 48 81 0 15 Oct 2021