Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,811 papers shown

Title
Visual Prompt Based Personalized Federated Learning Guang-Ming Li Wansen Wu Yan Sun Li Shen Baoyuan Wu Dacheng Tao FedML VLM 34 18 0 15 Mar 2023
Deep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey Huali Xu Shuaifeng Zhi Shuzhou Sun Vishal M. Patel Li Liu 55 13 0 15 Mar 2023
Diversity-Aware Meta Visual Prompting Qidong Huang Xiaoyi Dong DongDong Chen Weiming Zhang Feifei Wang Gang Hua Neng H. Yu VLM VPVLM 46 53 0 14 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 38 27 0 14 Mar 2023
Model-tuning Via Prompts Makes NLP Models Adversarially Robust Mrigank Raman Pratyush Maini J. Zico Kolter Zachary Chase Lipton Danish Pruthi AAML 38 17 0 13 Mar 2023
A Survey of Graph Prompting Methods: Techniques, Applications, and Challenges Xuansheng Wu Kaixiong Zhou Mingchen Sun Xin Wang Ninghao Liu 64 12 0 13 Mar 2023
PromptFusion: Decoupling Stability and Plasticity for Continual Learning Haoran Chen Zuxuan Wu Xintong Han Menglin Jia Yu-Gang Jiang CLL 128 12 0 13 Mar 2023
Large Language Models in the Workplace: A Case Study on Prompt Engineering for Job Type Classification Benjamin Clavié Alexandru Ciceu Frederick Naylor Guillaume Soulié Thomas Brightwell LLMAG 30 42 0 13 Mar 2023
SelfPromer: Self-Prompt Dehazing Transformers with Depth-Consistency Cong Wang Jin-shan Pan Wanyu Lin Jiangxin Dong Xiaomei Wu VLM MDE 39 40 0 13 Mar 2023
ViM: Vision Middleware for Unified Downstream Transferring Yutong Feng Biao Gong Jianwen Jiang Yiliang Lv Yujun Shen Deli Zhao Jingren Zhou 37 1 0 13 Mar 2023
MetaTroll: Few-shot Detection of State-Sponsored Trolls with Transformer Adapters Lin Tian Xiuzhen Zhang Jey Han Lau 32 10 0 13 Mar 2023
TranSG: Transformer-Based Skeleton Graph Prototype Contrastive Learning with Structure-Trajectory Prompted Reconstruction for Person Re-Identification Haocong Rao Steven C. H. Hoi 22 26 0 13 Mar 2023
ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generation Bang-ju Yang Fenglin Liu Yuexian Zou Xian Wu Yaowei Wang David Clifton 38 9 0 11 Mar 2023
ChatGPT Prompt Patterns for Improving Code Quality, Refactoring, Requirements Elicitation, and Software Design Jules White Sam Hays Quchen Fu Jesse Spencer-Smith Douglas C. Schmidt LLMAG 33 156 0 11 Mar 2023
Learning Combinatorial Prompts for Universal Controllable Image Captioning Zhen Wang Jun Xiao Yueting Zhuang Fei Gao Jian Shao Long Chen 60 5 0 11 Mar 2023
Task and Motion Planning with Large Language Models for Object Rearrangement Yan Ding Xiaohan Zhang Chris Paxton Shiqi Zhang LM&Ro LRM 34 181 0 10 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 44 43 0 10 Mar 2023
From Visual Prompt Learning to Zero-Shot Transfer: Mapping Is All You Need Ziqing Yang Zeyang Sha Michael Backes Yang Zhang VPVLM VLM 43 3 0 09 Mar 2023
Rethinking Visual Prompt Learning as Masked Visual Token Modeling Ning Liao Bowen Shi Xiaopeng Zhang Min Cao Junchi Yan Qi Tian VLM 39 7 0 09 Mar 2023
Cost-Effective Hyperparameter Optimization for Large Language Model Generation Inference Chi Wang Susan Liu Ahmed Hassan Awadallah 19 40 0 08 Mar 2023
Does Synthetic Data Generation of LLMs Help Clinical Text Mining? Ruixiang Tang Xiaotian Han Xiaoqian Jiang Xia Hu LM&MA AI4MH SyDa 37 172 0 08 Mar 2023
Can large language models build causal graphs? Stephanie Long Tibor Schuster Alexandre Piché ELM 17 60 0 07 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT Yihan Cao Siyu Li Yixin Liu Zhiling Yan Yutong Dai Philip S. Yu Lichao Sun 43 514 0 07 Mar 2023
Foundation Models for Decision Making: Problems, Methods, and Opportunities Sherry Yang Ofir Nachum Yilun Du Jason W. Wei Pieter Abbeel Dale Schuurmans LM&Ro OffRL LRM AI4CE 101 156 0 07 Mar 2023
Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting Hai Dang Sven Goller Florian Lehmann Daniel Buschek AI4CE 96 75 0 06 Mar 2023
OpenICL: An Open-Source Framework for In-context Learning Zhenyu Wu Yaoxiang Wang Jiacheng Ye Jiangtao Feng Jingjing Xu Yu Qiao Zhiyong Wu 29 49 0 06 Mar 2023
Dynamic Prompting: A Unified Framework for Prompt Tuning Xianjun Yang Wei Cheng Xujiang Zhao Wenchao Yu Linda R. Petzold Haifeng Chen VLM 32 15 0 06 Mar 2023
Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning Zhen Wang Yikang Shen Leonid Karlinsky Rogerio Feris Huan Sun Yoon Kim VLM VPVLM 49 108 0 06 Mar 2023
FAME-ViL: Multi-Tasking Vision-Language Model for Heterogeneous Fashion Tasks Xiaoping Han Xiatian Zhu Licheng Yu Li Zhang Yi-Zhe Song Tao Xiang VLM 29 38 0 04 Mar 2023
The Contribution of Knowledge in Visiolinguistic Learning: A Survey on Tasks and Challenges Maria Lymperaiou Giorgos Stamou VLM 37 4 0 04 Mar 2023
MathPrompter: Mathematical Reasoning using Large Language Models Shima Imani Liang Du H. Shrivastava KELM ReLM LRM 34 197 0 04 Mar 2023
Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM Rachel Bawden François Yvon VLM LRM 32 60 0 03 Mar 2023
Visual Exemplar Driven Task-Prompting for Unified Perception in Autonomous Driving Xiwen Liang Minzhe Niu Jianhua Han Hang Xu Chunjing Xu Xiaodan Liang VLM 36 14 0 03 Mar 2023
Ask and You Shall Receive (a Graph Drawing): Testing ChatGPT's Potential to Apply Graph Layout Algorithms Sara Di Bartolomeo Giorgio Severi V. Schetinger Cody Dunne 51 8 0 03 Mar 2023
Structure Pretraining and Prompt Tuning for Knowledge Graph Transfer Wen Zhang Yushan Zhu Yin Hua Yuxia Geng Yufen Huang Yajing Xu Wenting Song Hua-zeng Chen 56 26 0 03 Mar 2023
Multi-task neural networks by learned contextual inputs Anders T. Sandnes B. Grimstad O. Kolbjørnsen 22 1 0 01 Mar 2023
SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks Kai-Wei Chang Yu-Kai Wang Hua Shen Iu-thing Kang Wei-Cheng Tseng Shang-Wen Li Hung-yi Lee VLM 34 44 0 01 Mar 2023
Rethinking Efficient Tuning Methods from a Unified Perspective Zeyinzi Jiang Chaojie Mao Ziyuan Huang Yiliang Lv Deli Zhao Jingren Zhou 43 10 0 01 Mar 2023
Competence-Based Analysis of Language Models Adam Davies Jize Jiang Chengxiang Zhai ELM 39 4 0 01 Mar 2023
StrucTexTv2: Masked Visual-Textual Prediction for Document Image Pre-training Yu Yu Yulin Li Chengquan Zhang Xiaoqiang Zhang Zengyuan Guo Xiameng Qin Kun Yao Junyu Han Errui Ding Jingdong Wang 29 45 0 01 Mar 2023
HugNLP: A Unified and Comprehensive Library for Natural Language Processing Rongxiang Weng Nuo Chen Qiushi Sun Wenkang Huang Chengyu Wang Ming Gao 37 3 0 28 Feb 2023
Fluid Transformers and Creative Analogies: Exploring Large Language Models' Capacity for Augmenting Cross-Domain Analogical Creativity Zijian Ding Arvind Srinivasan Stephen MacNeil Joel Chan 34 35 0 27 Feb 2023
MetaAID 2.0: An Extensible Framework for Developing Metaverse Applications via Human-controllable Pre-trained Models Hongyin Zhu 25 6 0 25 Feb 2023
Robot Behavior-Tree-Based Task Generation with Large Language Models Yue Cao C. S. Lee LM&Ro 28 28 0 24 Feb 2023
Pre-Finetuning for Few-Shot Emotional Speech Recognition Maximillian Chen Zhou Yu 42 3 0 24 Feb 2023
STA: Self-controlled Text Augmentation for Improving Text Classifications Congcong Wang Gonzalo Fiz Pontiveros Steven Derby Tri Kurniawan Wijaya 46 3 0 24 Feb 2023
SGL-PT: A Strong Graph Learner with Graph Prompt Tuning Yun Zhu Jianhao Guo Siliang Tang 37 29 0 24 Feb 2023
Dr ChatGPT, tell me what I want to hear: How prompt knowledge impacts health answer correctness Guido Zuccon Bevan Koopman KELM AI4MH MedIm 14 41 0 23 Feb 2023
Boosting Adversarial Transferability using Dynamic Cues Muzammal Naseer Ahmad A Mahmood Salman Khan Fahad Shahbaz Khan AAML 30 5 0 23 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić Edoardo Ponti MoMe OOD 45 72 0 22 Feb 2023