Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,820 papers shown

Title
Fluid Transformers and Creative Analogies: Exploring Large Language Models' Capacity for Augmenting Cross-Domain Analogical Creativity Zijian Ding Arvind Srinivasan Stephen MacNeil Joel Chan 34 35 0 27 Feb 2023
MetaAID 2.0: An Extensible Framework for Developing Metaverse Applications via Human-controllable Pre-trained Models Hongyin Zhu 30 6 0 25 Feb 2023
Robot Behavior-Tree-Based Task Generation with Large Language Models Yue Cao C. S. Lee LM&Ro 33 28 0 24 Feb 2023
Pre-Finetuning for Few-Shot Emotional Speech Recognition Maximillian Chen Zhou Yu 52 3 0 24 Feb 2023
STA: Self-controlled Text Augmentation for Improving Text Classifications Congcong Wang Gonzalo Fiz Pontiveros Steven Derby Tri Kurniawan Wijaya 51 3 0 24 Feb 2023
SGL-PT: A Strong Graph Learner with Graph Prompt Tuning Yun Zhu Jianhao Guo Siliang Tang 49 29 0 24 Feb 2023
Dr ChatGPT, tell me what I want to hear: How prompt knowledge impacts health answer correctness Guido Zuccon Bevan Koopman KELM AI4MH MedIm 14 41 0 23 Feb 2023
Boosting Adversarial Transferability using Dynamic Cues Muzammal Naseer Ahmad A Mahmood Salman Khan Fahad Shahbaz Khan AAML 33 5 0 23 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić Edoardo Ponti MoMe OOD 53 72 0 22 Feb 2023
Guiding Large Language Models via Directional Stimulus Prompting Zekun Li Baolin Peng Pengcheng He Michel Galley Jianfeng Gao Xi Yan LLMAG LRM LM&Ro 45 96 0 22 Feb 2023
Construction of Knowledge Graphs: State and Challenges Marvin Hofer Daniel Obraczka A. Saeedi Hanna Köpcke Erhard Rahm 31 32 0 22 Feb 2023
In-context Example Selection with Influences Nguyen Tai Eric Wong 44 48 0 21 Feb 2023
ChatGPT: Jack of all trades, master of none Jan Kocoñ Igor Cichecki Oliwier Kaszyca Mateusz Kochanek Dominika Szydło ... Maciej Piasecki Lukasz Radliñski Konrad Wojtasik Stanislaw Wo'zniak Przemyslaw Kazienko AI4MH 55 536 0 21 Feb 2023
A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT Jules White Quchen Fu Sam Hays Michael Sandborn Carlos Olea Henry Gilbert Ashraf Elnashar Jesse Spencer-Smith Douglas C. Schmidt LLMAG 94 1,062 0 21 Feb 2023
Mask-guided BERT for Few Shot Text Classification Wenxiong Liao Zheng Liu Haixing Dai Zihao Wu Yiyang Zhang ... Dajiang Zhu Tianming Liu Sheng Li Xiang Li Hongmin Cai VLM 52 39 0 21 Feb 2023
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey Tianlin Li Guangyao Chen Guangwu Qian Pengcheng Gao Xiaoyong Wei Yaowei Wang Yonghong Tian Wen Gao AI4CE VLM 53 206 0 20 Feb 2023
Can discrete information extraction prompts generalize across language models? Nathanaël Carraz Rakotonirina Roberto Dessì Fabio Petroni Sebastian Riedel Marco Baroni 44 7 0 20 Feb 2023
Language-Specific Representation of Emotion-Concept Knowledge Causally Supports Emotion Inference Ming Li Yusheng Su Hsiu-Yuan Huang Jiali Cheng Xin Hu ... Yujia Qin Xiaozhi Wang Kristen A. Lindquist Zhi-Yun Liu Dan Zhang 40 5 0 19 Feb 2023
Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao AI4MH 66 240 0 19 Feb 2023
RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions Yunlong Wang Shuyuan Shen Brian Y. Lim 46 88 0 19 Feb 2023
Scalable Prompt Generation for Semi-supervised Learning with Language Models Yuhang Zhou Suraj Maharjan Bei Liu VLM 36 14 0 18 Feb 2023
Prompting Large Language Models With the Socratic Method Edward Y. Chang LRM ELM 72 48 0 17 Feb 2023
Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts Zhihong Chen Shizhe Diao Benyou Wang Guanbin Li Xiang Wan MedIm 61 30 0 17 Feb 2023
Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning? Chengwei Qin Q. Li Ruochen Zhao Shafiq Joty VLM LRM 28 15 0 16 Feb 2023
Towards Efficient Visual Adaption via Structural Re-parameterization Gen Luo Minglang Huang Yiyi Zhou Xiaoshuai Sun Guannan Jiang Zhiyu Wang Rongrong Ji VLM VPVLM 14 79 0 16 Feb 2023
Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition Minsu Kim Hyungil Kim Y. Ro VLM 20 18 0 16 Feb 2023
LabelPrompt: Effective Prompt-based Learning for Relation Classification Weinan Zhang Xiaoning Song Zhenhua Feng Tianyang Xu Xiaojun Wu VLM 42 4 0 16 Feb 2023
GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks Zemin Liu Xingtong Yu Yuan Fang Xinming Zhang LLMAG AI4CE 27 137 0 16 Feb 2023
À-la-carte Prompt Tuning (APT): Combining Distinct Data Via Composable Prompting Benjamin Bowman Alessandro Achille Luca Zancato Matthew Trager Pramuditha Perera Giovanni Paolini Stefano Soatto VPVLM 34 19 0 15 Feb 2023
NL2CMD: An Updated Workflow for Natural Language to Bash Commands Translation Quchen Fu Zhongwei Teng Marco Georgaklis Jules White C. Schmidt 33 6 0 15 Feb 2023
ScatterShot: Interactive In-context Example Curation for Text Transformation Tongshuang Wu Hua Shen Daniel S. Weld Jeffrey Heer Marco Tulio Ribeiro 29 23 0 14 Feb 2023
PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees Chulin Xie De-An Huang Wen-Hsuan Chu Daguang Xu Chaowei Xiao Yue Liu Anima Anandkumar FedML 49 10 0 13 Feb 2023
Beyond Uniform Smoothness: A Stopped Analysis of Adaptive SGD Matthew Faw Litu Rout Constantine Caramanis Sanjay Shakkottai 24 38 0 13 Feb 2023
Distinguishability Calibration to In-Context Learning Hongjing Li Hanqi Yan Yanran Li Li Qian Yulan He Lin Gui 34 2 0 13 Feb 2023
Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Tracking Derek Chen Kun Qian Zhou Yu 28 5 0 12 Feb 2023
Cross-Modal Fine-Tuning: Align then Refine Junhong Shen Liam Li Lucio Dery Corey Staten M. Khodak Graham Neubig Ameet Talwalkar 45 36 0 11 Feb 2023
Adversarial Transformer Language Models for Contextual Commonsense Inference Pedro Colon-Hernandez H. Lieberman Yida Xin Claire Yin C. Breazeal Peter Chin 51 2 0 10 Feb 2023
Global Constraints with Prompting for Zero-Shot Event Argument Classification Zizheng Lin Hongming Zhang Yangqiu Song 48 16 0 09 Feb 2023
Black Box Adversarial Prompting for Foundation Models Natalie Maus Patrick Chao Eric Wong Jacob R. Gardner VLM 39 56 0 08 Feb 2023
GPTScore: Evaluate as You Desire Jinlan Fu See-Kiong Ng Zhengbao Jiang Pengfei Liu LM&MA ALM ELM 20 270 0 08 Feb 2023
Zero-shot Generation of Coherent Storybook from Plain Text Story using Diffusion Models Hyeonho Jeong Gihyun Kwon Jong Chul Ye 45 21 0 08 Feb 2023
Controlling Personality Style in Dialogue with Zero-Shot Prompt-Based Learning Angela Ramirez Mamon Alsalihy Kartik Aggarwal Cecilia Li Liren Wu M. Walker 38 13 0 08 Feb 2023
PLACES: Prompting Language Models for Social Conversation Synthesis Maximillian Chen Alexandros Papangelis Chenyang Tao Seokhwan Kim Andrew Rosenbaum Yang Liu Zhou Yu Dilek Z. Hakkani-Tür 47 78 0 07 Feb 2023
Conversation Regression Testing: A Design Technique for Prototyping Generalizable Prompt Strategies for Pre-trained Language Models J.D. Zamfirescu-Pereira Bjoern Hartmann Qian Yang 10 2 0 06 Feb 2023
Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrieval Kuniaki Saito Kihyuk Sohn Xiang Zhang Chun-Liang Li Chen-Yu Lee Kate Saenko Tomas Pfister 35 107 0 06 Feb 2023
Coherence and Diversity through Noise: Self-Supervised Paraphrase Generation via Structure-Aware Denoising Rishabh Gupta Venktesh V. Mukesh Mohania Vikram Goyal 27 1 0 06 Feb 2023
Generative Diffusion Models on Graphs: Methods and Applications Junfeng Fang Wenqi Fan Yunqing Liu Jiatong Li Hang Li Hui Liu Jiliang Tang Qing Li MedIm DiffM 38 59 0 06 Feb 2023
Regulating ChatGPT and other Large Generative AI Models P. Hacker A. Engel M. Mauer AILaw 42 332 0 05 Feb 2023
A Survey of Deep Learning: From Activations to Transformers Johannes Schneider Michalis Vlachos ViT MedIm AI4TS AI4CE 55 10 0 01 Feb 2023
Compositional Prompt Tuning with Motion Cues for Open-vocabulary Video Relation Detection Kaifeng Gao Long Chen Hanwang Zhang Jun Xiao Qianru Sun VLM VPVLM 34 27 0 01 Feb 2023