Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,821 papers shown

Title
Compositional Prompt Tuning with Motion Cues for Open-vocabulary Video Relation Detection Kaifeng Gao Long Chen Hanwang Zhang Jun Xiao Qianru Sun VLM VPVLM 34 27 0 01 Feb 2023
On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex Terry Yue Zhuo Zhuang Li Yujin Huang Fatemeh Shiri Weiqing Wang Gholamreza Haffari Yuan-Fang Li AAML 39 54 0 30 Jan 2023
Zero-shot Clarifying Question Generation for Conversational Search Zhenduo Wang Yuancheng Tu Corby Rosset Nick Craswell Ming Wu Qingyao Ai 25 21 0 30 Jan 2023
Continual Learning for Predictive Maintenance: Overview and Challenges J. Hurtado Dario Salvati Rudy Semola Mattia Bosio Vincenzo Lomonaco 34 32 0 29 Jan 2023
Debiased Fine-Tuning for Vision-language Models by Prompt Regularization Beier Zhu Yulei Niu Saeil Lee Minhoe Hur Hanwang Zhang VLM VPVLM 37 22 0 29 Jan 2023
Prompt-Based Editing for Text Style Transfer Guoqing Luo Yu Tong Han Lili Mou Mauajama Firdaus 46 23 0 27 Jan 2023
The Exploration of Knowledge-Preserving Prompts for Document Summarisation Cheng Chen Wei Emma Zhang A. Shakeri Makhmoor Fiza KELM 40 0 0 27 Jan 2023
Parameter-Efficient Low-Resource Dialogue State Tracking by Prompt Tuning Mingyu Derek Ma Jiun-Yu Kao Shuyang Gao Arpit Gupta Di Jin Tagyoung Chung Nanyun Peng 36 7 0 26 Jan 2023
Editing Language Model-based Knowledge Graph Embeddings Shuyang Cheng Ningyu Zhang Bo Tian Feiyu Xiong Wei Guo Huajun Chen KELM 56 23 0 25 Jan 2023
The Next Chapter: A Study of Large Language Models in Storytelling Zhuohan Xie Trevor Cohn Jey Han Lau 41 44 0 24 Jan 2023
Matching Exemplar as Next Sentence Prediction (MeNSP): Zero-shot Prompt Learning for Automatic Scoring in Science Education Xuansheng Wu Xinyu He Tianming Li Ninghao Liu Xiaoming Zhai 39 26 0 20 Jan 2023
PromptShots at the FinNLP-2022 ERAI Tasks: Pairwise Comparison and Unsupervised Ranking Peratham Wiriyathammabhum 27 4 0 16 Jan 2023
Multimodality Helps Unimodality: Cross-Modal Few-Shot Learning with Multimodal Models Zhiqiu Lin Samuel Yu Zhiyi Kuang Deepak Pathak Deva Ramana VLM 31 102 0 16 Jan 2023
Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data Jing Wei Sungdong Kim Hyunhoon Jung Young-Ho Kim 55 83 0 14 Jan 2023
Blind Judgement: Agent-Based Supreme Court Modelling With GPT S. Hamilton LLMAG ELM 40 38 0 12 Jan 2023
KAER: A Knowledge Augmented Pre-Trained Language Model for Entity Resolution Liri Fang Lan Li Yiren Liu Vetle I. Torvik Bertram Ludäscher 23 5 0 12 Jan 2023
InPars-Light: Cost-Effective Unsupervised Training of Efficient Rankers Leonid Boytsov Preksha Patel Vivek Sourabh Riddhi Nisar Sayan Kundu R. Ramanathan Eric Nyberg 41 19 0 08 Jan 2023
Second Thoughts are Best: Learning to Re-Align With Human Values from Text Edits Ruibo Liu Chenyan Jia Ge Zhang Ziyu Zhuang Tony X. Liu Soroush Vosoughi 114 35 0 01 Jan 2023
A Survey on In-context Learning Qingxiu Dong Lei Li Damai Dai Ce Zheng Jingyuan Ma ... Zhiyong Wu Baobao Chang Xu Sun Lei Li Zhifang Sui ReLM AIMat 41 479 0 31 Dec 2022
How would Stance Detection Techniques Evolve after the Launch of ChatGPT? Bowen Zhang Daijun Ding Liwen Jing 46 106 0 30 Dec 2022
On Transforming Reinforcement Learning by Transformer: The Development Trajectory Shengchao Hu Li Shen Ya Zhang Yixin Chen Dacheng Tao OffRL 56 25 0 29 Dec 2022
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 41 3 0 27 Dec 2022
Large Language Models Encode Clinical Knowledge K. Singhal Shekoofeh Azizi T. Tu S. S. Mahdavi Jason W. Wei ... A. Rajkomar Joelle Barral Christopher Semturs Alan Karthikesalingam Vivek Natarajan LM&MA ELM AI4MH 79 2,219 0 26 Dec 2022
On Realization of Intelligent Decision-Making in the Real World: A Foundation Decision Model Perspective Ying Wen Bo Liu M. Zhou Shufang Hou Zhe Cao Chenyang Le Jingxiao Chen Zheng Tian Weinan Zhang Jun Wang AI4CE 37 10 0 24 Dec 2022
Not Just Pretty Pictures: Toward Interventional Data Augmentation Using Text-to-Image Generators Jianhao Yuan Francesco Pinto Adam Davies Philip Torr DiffM 34 12 0 21 Dec 2022
Language Models as Inductive Reasoners Zonglin Yang Li Dong Xinya Du Hao Cheng Min Zhang Xiaodong Liu Jianfeng Gao Furu Wei ReLM LRM 35 34 0 21 Dec 2022
MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning Zhiyang Xu Ying Shen Lifu Huang MLLM 43 111 0 21 Dec 2022
MolCPT: Molecule Continuous Prompt Tuning to Generalize Molecular Representation Learning Cameron Diao Kaixiong Zhou Zirui Liu Xiao Huang Xia Hu 36 14 0 20 Dec 2022
Unleashing the Power of Visual Prompting At the Pixel Level Junyang Wu Xianhang Li Chen Wei Huiyu Wang Alan Yuille Yuyin Zhou Cihang Xie VPVLM VLM 36 31 0 20 Dec 2022
Task Ambiguity in Humans and Language Models Alex Tamkin Kunal Handa Ava Shrestha Noah D. Goodman UQLM 66 23 0 20 Dec 2022
MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialogue Nikita Moghe E. Razumovskaia Liane Guillou Ivan Vulić Anna Korhonen Alexandra Birch 45 13 0 20 Dec 2022
Large Language Models Are Reasoning Teachers Namgyu Ho Laura Schmid Se-Young Yun ReLM ELM LRM 42 324 0 20 Dec 2022
When Do Decompositions Help for Machine Reading? Kangda Wei Dawn J Lawrie Benjamin Van Durme Yunmo Chen Orion Weller ReLM 85 2 0 20 Dec 2022
One Embedder, Any Task: Instruction-Finetuned Text Embeddings Hongjin Su Weijia Shi Jungo Kasai Yizhong Wang Yushi Hu Mari Ostendorf Wen-tau Yih Noah A. Smith Luke Zettlemoyer Tao Yu 29 285 0 19 Dec 2022
Position-guided Text Prompt for Vision-Language Pre-training Alex Jinpeng Wang Pan Zhou Mike Zheng Shou Shuicheng Yan VLM 32 37 0 19 Dec 2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting Zheng-Xin Yong Hailey Schoelkopf Niklas Muennighoff Alham Fikri Aji David Ifeoluwa Adelani ... Genta Indra Winata Stella Biderman Edward Raff Dragomir R. Radev Vassilina Nikoulina CLL VLM AI4CE LRM 61 81 0 19 Dec 2022
E-NER -- An Annotated Named Entity Recognition Corpus of Legal Text Ting Wai Terence Au Ingemar J. Cox Vasileios Lampos AILaw 37 24 0 19 Dec 2022
PoE: a Panel of Experts for Generalized Automatic Dialogue Assessment Chen Zhang L. F. D’Haro Qiquan Zhang Thomas Friedrichs Haizhou Li 38 7 0 18 Dec 2022
Foundation models in brief: A historical, socio-technical focus Johannes Schneider VLM 34 9 0 17 Dec 2022
Decoder Tuning: Efficient Language Understanding as Decoding Ganqu Cui Wentao Li Ning Ding Longtao Huang Zhiyuan Liu Maosong Sun 31 6 0 16 Dec 2022
FewFedWeight: Few-shot Federated Learning Framework across Multiple NLP Tasks Weilong Dong Xinwei Wu Junzhuo Li Shuangzhi Wu Chao Bian Deyi Xiong FedML 51 6 0 16 Dec 2022
Controllable Text Generation via Probability Density Estimation in the Latent Space Yuxuan Gu Xiaocheng Feng Sicheng Ma Lingyuan Zhang Heng Gong Weihong Zhong Bing Qin 29 18 0 16 Dec 2022
Transformers learn in-context by gradient descent J. Oswald Eyvind Niklasson E. Randazzo João Sacramento A. Mordvintsev A. Zhmoginov Max Vladymyrov MLT 59 452 0 15 Dec 2022
Artificial Intelligence for Health Message Generation: Theory, Method, and an Empirical Study Using Prompt Engineering Sue Lim Ralf Schmälzle 29 57 0 14 Dec 2022
Federated Few-Shot Learning for Mobile NLP Dongqi Cai Shangguang Wang Yaozong Wu F. Lin Mengwei Xu FedML 33 12 0 12 Dec 2022
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization Yiwei Qin Graham Neubig Pengfei Liu 34 3 0 12 Dec 2022
PromptCAL: Contrastive Affinity Learning via Auxiliary Prompts for Generalized Novel Category Discovery Shengxiang Zhang Salman Khan Zhiqiang Shen Muzammal Naseer Guangyi Chen Fahad Shahbaz Khan CLL VLM 42 59 0 11 Dec 2022
From Cloze to Comprehension: Retrofitting Pre-trained Masked Language Model to Pre-trained Machine Reader Weiwen Xu Xin Li Wenxuan Zhang Meng Zhou W. Lam Luo Si Lidong Bing 32 2 0 09 Dec 2022
Task Bias in Vision-Language Models Sachit Menon I. Chandratreya Carl Vondrick VLM SSL 27 6 0 08 Dec 2022
Harnessing the Power of Multi-Task Pretraining for Ground-Truth Level Natural Language Explanations Björn Plüster Jakob Ambsdorf Lukas Braach Jae Hee Lee S. Wermter 33 6 0 08 Dec 2022