Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
A Frustratingly Simple Decoding Method for Neural Text Generation Haoran Yang Deng Cai Huayang Li Wei Bi Wai Lam Shuming Shi 84 11 0 22 May 2023
MvP: Multi-view Prompting Improves Aspect Sentiment Tuple Prediction Zhibin Gou Qi Guo Yujiu Yang 99 64 0 22 May 2023
GPT-3.5, GPT-4, or BARD? Evaluating LLMs Reasoning Ability in Zero-Shot Setting and Performance Boosting Through Prompts Jessica Nayeli López Espejel E. Ettifouri Mahaman Sanoussi Yahaya Alassan El Mehdi Chouham Walid Dahhane ELM LRM 73 90 0 21 May 2023
Zero-shot Visual Relation Detection via Composite Visual Cues from Large Language Models Lin Li Jun Xiao Guikun Chen Jian Shao Yueting Zhuang Long Chen VLM 137 27 0 21 May 2023
A Pilot Study on Dialogue-Level Dependency Parsing for Chinese Gongyao Jiang Shuang Liu Meishan Zhang Hao Fei 47 2 0 21 May 2023
OntoType: Ontology-Guided and Pre-Trained Language Model Assisted Fine-Grained Entity Typing Tanay Komarlu Minhao Jiang Xuan Wang Jiawei Han 49 1 0 21 May 2023
LMs: Understanding Code Syntax and Semantics for Code Analysis Wei Ma Shangqing Liu Zhihao Lin Wenhan Wang Q. Hu Ye Liu Cen Zhang Liming Nie Li Li Yang Liu 124 16 0 20 May 2023
OPT-R: Exploring the Role of Explanations in Finetuning and Prompting for Reasoning Skills of Large Language Models Badr AlKhamissi Siddharth Verma Ping Yu Zhijing Jin Asli Celikyilmaz Mona T. Diab LRM ReLM 61 10 0 19 May 2023
CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing Zhibin Gou Zhihong Shao Yeyun Gong Yelong Shen Yujiu Yang Nan Duan Weizhu Chen KELM LRM 156 399 0 19 May 2023
LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Model Chenjie Cao Yunuo Cai Qiaole Dong Yikai Wang Yanwei Fu DiffM 100 15 0 19 May 2023
Decouple knowledge from parameters for plug-and-play language modeling Xin Cheng Yankai Lin Preslav Nakov Dongyan Zhao Rui Yan KELM 88 2 0 19 May 2023
ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings Shibo Hao Tianyang Liu Zhen Wang Zhiting Hu RALM LLMAG 155 183 0 19 May 2023
Hint of Thought prompting: an explainable and zero-shot approach to reasoning tasks with LLMs IokTong Lei Zhidong Deng ReLM RALM LRM 69 4 0 19 May 2023
Post Hoc Explanations of Language Models Can Improve Language Models Satyapriya Krishna Jiaqi Ma Dylan Slack Asma Ghandeharioun Sameer Singh Himabindu Lakkaraju ReLM LRM 90 59 0 19 May 2023
Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization Puyuan Peng Brian Yan Shinji Watanabe David Harwath VLM LRM 119 49 0 18 May 2023
TEPrompt: Task Enlightenment Prompt Learning for Implicit Discourse Relation Recognition Wei Xiang Chao Liang Bang Wang 45 7 0 18 May 2023
Transformer-based Variable-rate Image Compression with Region-of-interest Control Chia-Hao Kao Ying Weng Yi-Hsin Chen Wei-Chen Chiu Wenmin Peng 73 9 0 18 May 2023
Sasha: Creative Goal-Oriented Reasoning in Smart Homes with Large Language Models Evan King Haoxiang Yu Sangsu Lee Christine Julien LM&Ro 36 20 0 16 May 2023
SatLM: Satisfiability-Aided Language Models Using Declarative Prompting Xi Ye Qiaochu Chen Işıl Dillig Greg Durrett ReLM ReCod LRM 106 73 0 16 May 2023
Prompt-Tuning Decision Transformer with Preference Ranking Shengchao Hu Li Shen Ya Zhang Dacheng Tao OffRL 85 14 0 16 May 2023
UOR: Universal Backdoor Attacks on Pre-trained Language Models Wei Du Peixuan Li Yue Liu Haodong Zhao Gongshen Liu AAML 67 9 0 16 May 2023
Pre-Training to Learn in Context Yuxian Gu Li Dong Furu Wei Minlie Huang CLIP LRM ReLM 167 38 0 16 May 2023
Learning to Generalize for Cross-domain QA Yingjie Niu Linyi Yang Ruihai Dong Yue Zhang 92 6 0 14 May 2023
A Comprehensive Survey on Segment Anything Model for Vision and Beyond Chunhui Zhang Li Liu Yawen Cui Guanjie Huang Weilin Lin Yiqian Yang Yuehong Hu VLM 102 101 0 14 May 2023
Text2Cohort: Facilitating Intuitive Access to Biomedical Data with Natural Language Cohort Discovery Pranav Kulkarni Adway U. Kanhere Paul H. Yi Vishwa S. Parekh 51 0 0 12 May 2023
Multimodal Sentiment Analysis: A Survey Songning Lai Xifeng Hu Hao Xu Zhaoxia Ren Zhi Liu 92 36 0 12 May 2023
Two-in-One: A Model Hijacking Attack Against Text Generation Models Waiman Si Michael Backes Yang Zhang A. Salem SILM 71 22 0 12 May 2023
Prompt Learning to Mitigate Catastrophic Forgetting in Cross-lingual Transfer for Open-domain Dialogue Generation Lei Liu J. Huang CLL 80 2 0 12 May 2023
When Giant Language Brains Just Aren't Enough! Domain Pizzazz with Knowledge Sparkle Dust Minh Le Nguyen Duy-Hung Nguyen Shahab Sabahi Hung Le Jeffrey Yang Hajime Hotta 94 1 0 12 May 2023
Visual Tuning Bruce X. B. Yu Jianlong Chang Haixin Wang Lin Liu Shijie Wang ... Lingxi Xie Haojie Li Zhouchen Lin Qi Tian Chang Wen Chen VLM 174 41 0 10 May 2023
Technical Understanding from IML Hands-on Experience: A Study through a Public Event for Science Museum Visitors Wataru Kawabe Yuri Nakao Akihisa Shitara Yusuke Sugano 73 1 0 10 May 2023
Large Language Models Need Holistically Thought in Medical Conversational QA Yixuan Weng Bin Li Fei Xia Minjun Zhu Bing Sun Shizhu He Kang Liu Jun Zhao LM&MA AI4MH LRM DiffM ELM 102 5 0 09 May 2023
Interpretable multimodal sentiment analysis based on textual modality descriptions by using large-scale language models Sixia Li S. Okada 78 3 0 07 May 2023
Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation Kun Zhou Yifan Li Wayne Xin Zhao Ji-Rong Wen DiffM 90 19 0 06 May 2023
Using ChatGPT for Entity Matching Ralph Peeters Christian Bizer AI4MH 109 29 0 05 May 2023
Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledge Jiawei Liu Ziteng Xiong Yi-ping Jiang Yongqiang Ma Wei Lu Yong Huang Qikai Cheng 51 1 0 05 May 2023
Programming-by-Demonstration for Long-Horizon Robot Tasks Noah T Patton Kia Rahmani Meghana Missula Joydeep Biswas Icsil Dillig 98 12 0 04 May 2023
Prompt-ICM: A Unified Framework towards Image Coding for Machines with Task-driven Prompts Ruoyu Feng Jinming Liu Xin Jin Xiaohan Pan Heming Sun Zhibo Chen VLM 112 13 0 04 May 2023
PTP: Boosting Stability and Performance of Prompt Tuning with Perturbation-Based Regularizer Lichang Chen Heng-Chiao Huang Varun Madhavan AAML 176 12 0 03 May 2023
Causality-aware Concept Extraction based on Knowledge-guided Prompting Siyu Yuan Deqing Yang Jinxi Liu Shuyu Tian Jiaqing Liang Yanghua Xiao R. Xie 128 15 0 03 May 2023
Pre-train and Search: Efficient Embedding Table Sharding with Pre-trained Neural Cost Models Daochen Zha Louis Feng Liangchen Luo Bhargav Bhushanam Zirui Liu ... J. McMahon Yuzhen Huang Bryan Clarke A. Kejariwal Helen Zhou 115 7 0 03 May 2023
Towards Imperceptible Document Manipulations against Neural Ranking Models Xuanang Chen Xianpei Han Zheng Ye Le Sun Yingfei Sun AAML 81 17 0 03 May 2023
Psychologically-Inspired Causal Prompts Zhiheng Lyu Zhijing Jin Justus Mattern Rada Mihalcea Mrinmaya Sachan Bernhard Schoelkopf CML 68 0 0 02 May 2023
Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Models Shuai Zhao Jinming Wen Anh Tuan Luu Jiaqi Zhao Jie Fu SILM 176 99 0 02 May 2023
Reliable Gradient-free and Likelihood-free Prompt Tuning Maohao Shen S. Ghosh P. Sattigeri Subhro Das Yuheng Bu G. Wornell VLM 115 12 0 30 Apr 2023
POUF: Prompt-oriented unsupervised fine-tuning for large pre-trained models Korawat Tanwisuth Shujian Zhang Huangjie Zheng Pengcheng He Mingyuan Zhou VLM VPVLM 190 28 0 29 Apr 2023
Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT Zhe Xiao Yuzhong Chen Lu Zhang Jun Yao Zihao Wu ... Yixuan Yuan Dinggang Shen Dajiang Zhu Tianming Liu Xi Jiang VLM MLLM 138 17 0 29 Apr 2023
Prompt Engineering for Healthcare: Methodologies and Applications Jiaqi Wang Enze Shi Sigang Yu Zihao Wu Chong Ma ... Dajiang Zhu Yixuan Yuan Dinggang Shen Tianming Liu Shu Zhang LM&MA 136 116 0 28 Apr 2023
Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation Wenqing Zheng S. Sharan Ajay Jaiswal Kevin Wang Yihan Xi Dejia Xu Zhangyang Wang 135 27 0 28 Apr 2023
Framing the News:From Human Perception to Large Language Model Inferences David Alonso del Barrio D. Gática-Pérez 95 14 0 27 Apr 2023