Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
Learning Combinatorial Prompts for Universal Controllable Image Captioning Zhen Wang Jun Xiao Yueting Zhuang Fei Gao Jian Shao Long Chen 112 5 0 11 Mar 2023
Task and Motion Planning with Large Language Models for Object Rearrangement Yan Ding Xiaohan Zhang Chris Paxton Shiqi Zhang LM&Ro LRM 95 185 0 10 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 95 47 0 10 Mar 2023
From Visual Prompt Learning to Zero-Shot Transfer: Mapping Is All You Need Ziqing Yang Zeyang Sha Michael Backes Yang Zhang VPVLM VLM 89 3 0 09 Mar 2023
Rethinking Visual Prompt Learning as Masked Visual Token Modeling Ning Liao Bowen Shi Xiaopeng Zhang Min Cao Junchi Yan Qi Tian VLM 83 8 0 09 Mar 2023
Cost-Effective Hyperparameter Optimization for Large Language Model Generation Inference Chi Wang Susan Liu Ahmed Hassan Awadallah 99 45 0 08 Mar 2023
Does Synthetic Data Generation of LLMs Help Clinical Text Mining? Ruixiang Tang Xiaotian Han Xiaoqian Jiang Helen Zhou LM&MA AI4MH SyDa 104 186 0 08 Mar 2023
Can large language models build causal graphs? Stephanie Long Tibor Schuster Alexandre Piché ELM 87 68 0 07 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT Yihan Cao Siyu Li Yixin Liu Zhiling Yan Yutong Dai Philip S. Yu Lichao Sun 120 554 0 07 Mar 2023
Foundation Models for Decision Making: Problems, Methods, and Opportunities Sherry Yang Ofir Nachum Yilun Du Jason W. Wei Pieter Abbeel Dale Schuurmans LM&Ro OffRL LRM AI4CE 200 172 0 07 Mar 2023
Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting Hai Dang Sven Goller Florian Lehmann Daniel Buschek AI4CE 148 79 0 06 Mar 2023
OpenICL: An Open-Source Framework for In-context Learning Zhenyu Wu Yaoxiang Wang Jiacheng Ye Jiangtao Feng Jingjing Xu Yu Qiao Zhiyong Wu 70 53 0 06 Mar 2023
Dynamic Prompting: A Unified Framework for Prompt Tuning Xianjun Yang Wei Cheng Xujiang Zhao Wenchao Yu Linda R. Petzold Haifeng Chen VLM 119 16 0 06 Mar 2023
Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning Zhen Wang Yikang Shen Leonid Karlinsky Rogerio Feris Huan Sun Yoon Kim VLM VPVLM 98 118 0 06 Mar 2023
FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Tasks Xiaoping Han Xiatian Zhu Licheng Yu Li Zhang Yi-Zhe Song Tao Xiang VLM 87 45 0 04 Mar 2023
The Contribution of Knowledge in Visiolinguistic Learning: A Survey on Tasks and Challenges Maria Lymperaiou Giorgos Stamou VLM 101 4 0 04 Mar 2023
MathPrompter: Mathematical Reasoning using Large Language Models Shima Imani Liang Du H. Shrivastava KELM ReLM LRM 109 214 0 04 Mar 2023
Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM Rachel Bawden François Yvon VLM LRM 90 65 0 03 Mar 2023
Visual Exemplar Driven Task-Prompting for Unified Perception in Autonomous Driving Xiwen Liang Minzhe Niu Jianhua Han Hang Xu Chunjing Xu Xiaodan Liang VLM 91 14 0 03 Mar 2023
Ask and You Shall Receive (a Graph Drawing): Testing ChatGPT's Potential to Apply Graph Layout Algorithms Sara Di Bartolomeo Giorgio Severi V. Schetinger Cody Dunne 80 10 0 03 Mar 2023
Structure Pretraining and Prompt Tuning for Knowledge Graph Transfer Wen Zhang Yushan Zhu Yin Hua Yuxia Geng Yufen Huang Yajing Xu Wenting Song Hua-zeng Chen 83 27 0 03 Mar 2023
Multi-task neural networks by learned contextual inputs Anders T. Sandnes B. Grimstad O. Kolbjørnsen 51 2 0 01 Mar 2023
SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks Kai-Wei Chang Yu-Kai Wang Hua Shen Iu-thing Kang Wei-Cheng Tseng Shang-Wen Li Hung-yi Lee VLM 88 46 0 01 Mar 2023
Rethinking Efficient Tuning Methods from a Unified Perspective Zeyinzi Jiang Chaojie Mao Ziyuan Huang Yiliang Lv Deli Zhao Jingren Zhou 85 11 0 01 Mar 2023
Competence-Based Analysis of Language Models Adam Davies Jize Jiang Chengxiang Zhai ELM 71 5 0 01 Mar 2023
StrucTexTv2: Masked Visual-Textual Prediction for Document Image Pre-training Yu Yu Yulin Li Chengquan Zhang Xiaoqiang Zhang Zengyuan Guo Xiameng Qin Kun Yao Junyu Han Errui Ding Jingdong Wang 80 45 0 01 Mar 2023
HugNLP: A Unified and Comprehensive Library for Natural Language Processing Jiadong Wang Nuo Chen Qiushi Sun Wenkang Huang Chengyu Wang Ming Gao 71 4 0 28 Feb 2023
Fluid Transformers and Creative Analogies: Exploring Large Language Models' Capacity for Augmenting Cross-Domain Analogical Creativity Zijian Ding Arvind Srinivasan Stephen MacNeil Joel Chan 61 35 0 27 Feb 2023
MetaAID 2.0: An Extensible Framework for Developing Metaverse Applications via Human-controllable Pre-trained Models Hongyin Zhu 58 6 0 25 Feb 2023
Robot Behavior-Tree-Based Task Generation with Large Language Models Yue Cao C. S. Lee LM&Ro 67 29 0 24 Feb 2023
Pre-Finetuning for Few-Shot Emotional Speech Recognition Maximillian Chen Zhou Yu 75 4 0 24 Feb 2023
STA: Self-controlled Text Augmentation for Improving Text Classifications Congcong Wang Gonzalo Fiz Pontiveros Steven Derby Tri Kurniawan Wijaya 72 4 0 24 Feb 2023
SGL-PT: A Strong Graph Learner with Graph Prompt Tuning Yun Zhu Jianhao Guo Siliang Tang 120 30 0 24 Feb 2023
Dr ChatGPT, tell me what I want to hear: How prompt knowledge impacts health answer correctness Guido Zuccon Bevan Koopman KELM AI4MH MedIm 65 42 0 23 Feb 2023
Boosting Adversarial Transferability using Dynamic Cues Muzammal Naseer Ahmad A Mahmood Salman Khan Fahad Shahbaz Khan AAML 68 6 0 23 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić Edoardo Ponti MoMe OOD 161 80 0 22 Feb 2023
Guiding Large Language Models via Directional Stimulus Prompting Zekun Li Baolin Peng Pengcheng He Michel Galley Jianfeng Gao Xi Yan LLMAG LRM LM&Ro 134 101 0 22 Feb 2023
Construction of Knowledge Graphs: State and Challenges Marvin Hofer Daniel Obraczka A. Saeedi Hanna Köpcke Erhard Rahm 78 38 0 22 Feb 2023
In-context Example Selection with Influences Nguyen Tai Eric Wong 94 54 0 21 Feb 2023
ChatGPT: Jack of all trades, master of none Jan Kocoñ Igor Cichecki Oliwier Kaszyca Mateusz Kochanek Dominika Szydło ... Maciej Piasecki Lukasz Radliñski Konrad Wojtasik Stanislaw Wo'zniak Przemyslaw Kazienko AI4MH 191 558 0 21 Feb 2023
A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT Jules White Quchen Fu Sam Hays Michael Sandborn Carlos Olea Henry Gilbert Ashraf Elnashar Jesse Spencer-Smith Douglas C. Schmidt LLMAG 205 1,136 0 21 Feb 2023
Mask-guided BERT for Few Shot Text Classification Wenxiong Liao Zheng Liu Haixing Dai Zihao Wu Yiyang Zhang ... Dajiang Zhu Tianming Liu Sheng Li Xiang Li Hongmin Cai VLM 95 41 0 21 Feb 2023
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey Tianlin Li Guangyao Chen Guangwu Qian Pengcheng Gao Xiaoyong Wei Yaowei Wang Yonghong Tian Wen Gao AI4CE VLM 184 216 0 20 Feb 2023
Can discrete information extraction prompts generalize across language models? Nathanaël Carraz Rakotonirina Roberto Dessì Fabio Petroni Sebastian Riedel Marco Baroni 72 8 0 20 Feb 2023
Language-Specific Representation of Emotion-Concept Knowledge Causally Supports Emotion Inference Ming Li Yusheng Su Hsiu-Yuan Huang Jiali Cheng Xin Hu ... Yujia Qin Xiaozhi Wang Kristen A. Lindquist Zhi-Yun Liu Dan Zhang 74 6 0 19 Feb 2023
Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao AI4MH 136 245 0 19 Feb 2023
RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions Yunlong Wang Shuyuan Shen Brian Y. Lim 96 96 0 19 Feb 2023
Scalable Prompt Generation for Semi-supervised Learning with Language Models Yuhang Zhou Suraj Maharjan Bei Liu VLM 94 14 0 18 Feb 2023
Prompting Large Language Models With the Socratic Method Edward Y. Chang LRM ELM 117 52 0 17 Feb 2023
Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts Zhihong Chen Shizhe Diao Benyou Wang Guanbin Li Xiang Wan MedIm 127 33 0 17 Feb 2023