Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,811 papers shown

Title
Log Parsing: How Far Can ChatGPT Go? Van-Hoang Le Hongyu Zhang 20 36 0 02 Jun 2023
Prompt Tuning Large Language Models on Personalized Aspect Extraction for Recommendations Pan Li Yuyan Wang Ed H. Chi Minmin Chen 32 12 0 02 Jun 2023
DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection Rui Shao Tianxing Wu Liqiang Nie Ziwei Liu 39 11 0 01 Jun 2023
Interpretable Math Word Problem Solution Generation Via Step-by-step Planning Mengxue Zhang Zichao Wang Zhichao Yang Weiqi Feng Andrew Lan LRM 22 17 0 01 Jun 2023
Exploring EFL students' prompt engineering in human-AI story writing: an Activity Theory perspective David James Woo Kai Guo Hengky Susanto 31 7 0 01 Jun 2023
Applying language models to algebraic topology: generating simplicial cycles using multi-labeling in Wu's formula Kirill Brilliantov Fedor Pavutnitskiy D. Pasechnyuk German Magai 30 0 0 01 Jun 2023
Adapting Pre-trained Language Models to Vision-Language Tasks via Dynamic Visual Prompting Shubin Huang Qiong Wu Yiyi Zhou Weijie Chen Rongsheng Zhang Xiaoshuai Sun Rongrong Ji VLM VPVLM LRM 16 0 0 01 Jun 2023
Preference-grounded Token-level Guidance for Language Model Fine-tuning Shentao Yang Shujian Zhang Congying Xia Yihao Feng Caiming Xiong Mi Zhou 34 23 0 01 Jun 2023
Prompt Algebra for Task Composition Pramuditha Perera Matthew Trager L. Zancato Alessandro Achille Stefano Soatto VLM 33 8 0 01 Jun 2023
Cooperative Hardware-Prompt Learning for Snapshot Compressive Imaging Jiamian Wang Zong-Jhe Wu Yulun Zhang Xin Yuan Tao R. Lin Zhiqiang Tao FedML 73 3 0 01 Jun 2023
MuseCoco: Generating Symbolic Music from Text Peiling Lu Xin Xu C. Kang Botao Yu Chengyi Xing Xuejiao Tan Jiang Bian 31 40 0 31 May 2023
Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learning Xiaoxin He Xavier Bresson T. Laurent Adam Perold Yann LeCun Bryan Hooi 38 73 0 31 May 2023
Learning Task-preferred Inference Routes for Gradient De-conflict in Multi-output DNNs Yi Sun Xin Xu Jiaqiang Li Xiaochang Hu Yifei Shi L. Zeng 43 2 0 31 May 2023
ScoNe: Benchmarking Negation Reasoning in Language Models With Fine-Tuning and In-Context Learning Jingyuan Selena She Christopher Potts Sam Bowman Atticus Geiger 37 13 0 30 May 2023
What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization Yufeng Zhang Fengzhuo Zhang Zhuoran Yang Zhaoran Wang BDL 41 66 0 30 May 2023
GPT Models in Construction Industry: Opportunities, Limitations, and a Use Case Validation Abdullahi Saka Ridwan Taiwo Nurudeen Saka B. Salami Saheed Ajayi Kabiru O. Akande Hadi Kazemi 41 60 0 30 May 2023
Contextual Knowledge Learning For Dialogue Generation Wen Zheng Natasa Milic-Frayling Ke Zhou 39 4 0 29 May 2023
ChatGPT-powered Conversational Drug Editing Using Retrieval and Domain Feedback Shengchao Liu Jiong Wang Yijin Yang Chengpeng Wang Ling Liu Hongyu Guo Chaowei Xiao LM&MA KELM AI4MH 36 39 0 29 May 2023
Explicit Visual Prompting for Universal Foreground Segmentations Weihuang Liu Xi Shen Chi-Man Pun Xiaodong Cun VPVLM VLM 46 14 0 29 May 2023
Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation Jia-Bin Huang Yi Ren Rongjie Huang Dongchao Yang Zhenhui Ye Chen Zhang Jinglin Liu Xiang Yin Zejun Ma Zhou Zhao DiffM 37 59 0 29 May 2023
ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER Amirhossein Layegh A. H. Payberah A. Soylu Dumitru Roman M. Matskin VLM 30 8 0 29 May 2023
Continual Task Allocation in Meta-Policy Network via Sparse Prompting Yijun Yang Tianyi Zhou Jing Jiang Guodong Long Yuhui Shi CLL OffRL 49 9 0 29 May 2023
Plug-and-Play Knowledge Injection for Pre-trained Language Models Zhengyan Zhang Zhiyuan Zeng Yankai Lin Huadong Wang Deming Ye ... Xu Han Zhiyuan Liu Peng Li Maosong Sun Jie Zhou KELM 49 11 0 28 May 2023
Plug-and-Play Document Modules for Pre-trained Models Chaojun Xiao Zhengyan Zhang Xu Han Chi-Min Chan Yankai Lin Zhiyuan Liu Xiangyang Li Zhonghua Li Bo Zhao Maosong Sun KELM 39 5 0 28 May 2023
Prompt-Guided Retrieval Augmentation for Non-Knowledge-Intensive Tasks Zhicheng Guo Sijie Cheng Yile Wang Peng Li Yang Liu RALM 30 18 0 28 May 2023
Integrating Action Knowledge and LLMs for Task Planning and Situation Handling in Open Worlds Yan Ding Xiaohan Zhang S. Amiri Nieqing Cao Hao Yang Andy Kaminski Chad Esselink Shiqi Zhang LM&Ro 40 49 0 27 May 2023
Zero- and Few-Shot Event Detection via Prompt-Based Meta Learning Zhenrui Yue Huimin Zeng Mengfei Lan Heng Ji D. Wang VLM 26 14 0 27 May 2023
Im-Promptu: In-Context Composition from Image Prompts Bhishma Dedhia Michael Chang Jake C. Snell Thomas Griffiths N. Jha LRM MLLM 37 1 0 26 May 2023
Large language models improve Alzheimer's disease diagnosis using multi-modality data Yingjie Feng Jun Wang Xianfeng Gu Xiaoyin Xu Hao Fei LM&MA 35 10 0 26 May 2023
PromptNER: Prompt Locating and Typing for Named Entity Recognition Yongliang Shen Zeqi Tan Shuhui Wu Wenqi Zhang Rongsheng Zhang Yadong Xi Weiming Lu Yueting Zhuang 46 34 0 26 May 2023
BiomedGPT: A Unified and Generalist Biomedical Generative Pre-trained Transformer for Vision, Language, and Multimodal Tasks Kai Zhang Jun Yu Eashan Adhikarla Rong Zhou Zhilin Yan ... Xun Chen Yong Chen Quanzheng Li Hongfang Liu Lichao Sun LM&MA MedIm 37 160 0 26 May 2023
Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification Kexi Ji Yixin Lian Jingsheng Gao Baoyuan Wang VLM 35 21 0 26 May 2023
Playing repeated games with Large Language Models Elif Akata Lion Schulz Julian Coda-Forno Seong Joon Oh Matthias Bethge Eric Schulz 428 122 0 26 May 2023
Not wacky vs. definitely wacky: A study of scalar adverbs in pretrained language models Isabelle Lorge J. Pierrehumbert 44 0 0 25 May 2023
Passive learning of active causal strategies in agents and language models Andrew Kyle Lampinen Stephanie C. Y. Chan Ishita Dasgupta A. Nam Jane X. Wang 37 15 0 25 May 2023
UFO: Unified Fact Obtaining for Commonsense Question Answering Zhifeng Li Yifan Fan Bowei Zou Yu Hong HILM LRM 45 1 0 25 May 2023
INTapt: Information-Theoretic Adversarial Prompt Tuning for Enhanced Non-Native Speech Recognition Eunseop Yoon Hee Suk Yoon John Harvill M. Hasegawa-Johnson Chang D. Yoo VLM 16 3 0 25 May 2023
Do You Hear The People Sing? Key Point Analysis via Iterative Clustering and Abstractive Summarisation Hao Li Viktor Schlegel Riza Batista-Navarro Goran Nenadic 27 6 0 25 May 2023
EDM3: Event Detection as Multi-task Text Generation Ujjwala Anantheswaran Himanshu Gupta Mihir Parmar Kuntal Kumar Pal Chitta Baral 45 5 0 25 May 2023
Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspective Guhao Feng Bohang Zhang Yuntian Gu Haotian Ye Di He Liwei Wang LRM 47 225 0 24 May 2023
Topic-Guided Self-Introduction Generation for Social Media Users Chunpu Xu Jing Li Pijian Li Min Yang 41 0 0 24 May 2023
ChatAgri: Exploring Potentials of ChatGPT on Cross-linguistic Agricultural Text Classification Biao Zhao Weiqiang Jin Javier Del Ser Guangyao Yang 46 60 0 24 May 2023
PESCO: Prompt-enhanced Self Contrastive Learning for Zero-shot Text Classification Yau-Shian Wang Ta-Chung Chi Ruohong Zhang Yiming Yang VLM 30 13 0 24 May 2023
Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis Sohee Yang Jonghyeon Kim Joel Jang Seonghyeon Ye Hyunji Lee Minjoon Seo 36 9 0 24 May 2023
Exploring Diverse In-Context Configurations for Image Captioning Xu Yang Yongliang Wu Mingzhuo Yang Haokun Chen Xin Geng MLLM 27 52 0 24 May 2023
Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models Natalie Shapira Mosh Levy S. Alavi Xuhui Zhou Yejin Choi Yoav Goldberg Maarten Sap Vered Shwartz LLMAG ELM 33 118 0 24 May 2023
Vision + Language Applications: A Survey Yutong Zhou N. Shimada VLM 37 6 0 24 May 2023
Few-shot Unified Question Answering: Tuning Models or Prompts? Srijan Bansal Semih Yavuz Bo Pang Meghana Moorthy Bhat Yingbo Zhou 36 2 0 23 May 2023
Unraveling ChatGPT: A Critical Analysis of AI-Generated Goal-Oriented Dialogues and Annotations Tiziano Labruna Sofia Brenna Andrea Zaninello Bernardo Magnini 29 14 0 23 May 2023
RetICL: Sequential Retrieval of In-Context Examples with Reinforcement Learning Alexander Scarlatos Andrew Lan OffRL LRM 34 20 0 23 May 2023