Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,811 papers shown

Title
Do prompt positions really matter? Junyu Mao Stuart E. Middleton Mahesan Niranjan VLM 31 3 0 23 May 2023
Language Model Self-improvement by Reinforcement Learning Contemplation Jing-Cheng Pang Pengyuan Wang Kaiyuan Li Xiong-Hui Chen Jiacheng Xu Zongzhang Zhang Yang Yu LRM KELM 15 45 0 23 May 2023
VIP5: Towards Multimodal Foundation Models for Recommendation Shijie Geng Juntao Tan Shuchang Liu Zuohui Fu Yongfeng Zhang 37 73 0 23 May 2023
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future Linyi Yang Yangqiu Song Xuan Ren Chenyang Lyu Yidong Wang Lingqiao Liu Jindong Wang Jennifer Foster Yue Zhang OOD 44 2 0 23 May 2023
Evaluating Factual Consistency of Summaries with Large Language Models Shiqi Chen Siyang Gao Junxian He ELM LRM HILM 37 6 0 23 May 2023
A Dive into SAM Prior in Image Restoration Zeyu Xiao Jiawang Bai Zhihe Lu Zhiwei Xiong 34 16 0 23 May 2023
A Study of Generative Large Language Model for Medical Research and Healthcare C.A.I. Peng Xi Yang Aokun Chen Kaleb E. Smith Nima M. Pournejatian ... W. Hogan E. Shenkman Yi Guo Jiang Bian Yonghui Wu LM&MA ELM AI4MH 155 249 0 22 May 2023
Can ChatGPT Detect Intent? Evaluating Large Language Models for Spoken Language Understanding Mutian He Philip N. Garner ELM AI4MH LRM 53 22 0 22 May 2023
Can LLMs facilitate interpretation of pre-trained language models? Basel Mousi Nadir Durrani Fahim Dalvi 41 12 0 22 May 2023
SPARSEFIT: Few-shot Prompting with Sparse Fine-tuning for Jointly Generating Predictions and Natural Language Explanations Jesus Solano Oana-Maria Camburu Pasquale Minervini 25 1 0 22 May 2023
Exploring User Perspectives on ChatGPT: Applications, Perceptions, and Implications for AI-Integrated Education Reza Hadi Mogavi Chaohua Deng Justin Juho Kim Pengyuan Zhou Young D. Kwon ... Simone Bassanelli A. Bucchiarone Sujit Gujar Lennart E. Nacke Pan Hui 30 46 0 22 May 2023
Automated stance detection in complex topics and small languages: the challenging case of immigration in polarizing news media Marko Mets Andres Karjus Indrek Ibrus Maximilian Schich 26 17 0 22 May 2023
Evaluating Prompt-based Question Answering for Object Prediction in the Open Research Knowledge Graph Jennifer D'Souza Moussab Hrou Sören Auer 24 2 0 22 May 2023
GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphs Pengcheng Jiang Cao Xiao Adam Cross Jimeng Sun AI4MH 31 22 0 22 May 2023
A Frustratingly Simple Decoding Method for Neural Text Generation Haoran Yang Deng Cai Huayang Li Wei Bi Wai Lam Shuming Shi 51 11 0 22 May 2023
MvP: Multi-view Prompting Improves Aspect Sentiment Tuple Prediction Zhibin Gou Qi Guo Yujiu Yang 38 55 0 22 May 2023
GPT-3.5, GPT-4, or BARD? Evaluating LLMs Reasoning Ability in Zero-Shot Setting and Performance Boosting Through Prompts Jessica Nayeli López Espejel E. Ettifouri Mahaman Sanoussi Yahaya Alassan El Mehdi Chouham Walid Dahhane ELM LRM 34 85 0 21 May 2023
Zero-shot Visual Relation Detection via Composite Visual Cues from Large Language Models Lin Li Jun Xiao Guikun Chen Jian Shao Yueting Zhuang Long Chen VLM 42 27 0 21 May 2023
A Pilot Study on Dialogue-Level Dependency Parsing for Chinese Gongyao Jiang Shuang Liu Meishan Zhang Hao Fei 25 2 0 21 May 2023
OntoType: Ontology-Guided and Pre-Trained Language Model Assisted Fine-Grained Entity Typing Tanay Komarlu Minhao Jiang Xuan Wang Jiawei Han 23 0 0 21 May 2023
LMs: Understanding Code Syntax and Semantics for Code Analysis Wei Ma Shangqing Liu Zhihao Lin Wenhan Wang Q. Hu Ye Liu Cen Zhang Liming Nie Li Li Yang Liu 39 16 0 20 May 2023
OPT-R: Exploring the Role of Explanations in Finetuning and Prompting for Reasoning Skills of Large Language Models Badr AlKhamissi Siddharth Verma Ping Yu Zhijing Jin Asli Celikyilmaz Mona T. Diab LRM ReLM 35 10 0 19 May 2023
CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing Zhibin Gou Zhihong Shao Yeyun Gong Yelong Shen Yujiu Yang Nan Duan Weizhu Chen KELM LRM 36 360 0 19 May 2023
LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Model Chenjie Cao Yunuo Cai Qiaole Dong Yikai Wang Yanwei Fu DiffM 40 15 0 19 May 2023
Decouple knowledge from parameters for plug-and-play language modeling Xin Cheng Yankai Lin Preslav Nakov Dongyan Zhao Rui Yan KELM 35 2 0 19 May 2023
ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings Shibo Hao Tianyang Liu Zhen Wang Zhiting Hu RALM LLMAG 76 174 0 19 May 2023
Hint of Thought prompting: an explainable and zero-shot approach to reasoning tasks with LLMs IokTong Lei Zhidong Deng ReLM RALM LRM 27 4 0 19 May 2023
Post Hoc Explanations of Language Models Can Improve Language Models Satyapriya Krishna Jiaqi Ma Dylan Slack Asma Ghandeharioun Sameer Singh Himabindu Lakkaraju ReLM LRM 30 55 0 19 May 2023
Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization Puyuan Peng Brian Yan Shinji Watanabe David Harwath VLM LRM 42 46 0 18 May 2023
TEPrompt: Task Enlightenment Prompt Learning for Implicit Discourse Relation Recognition Wei Xiang Chao Liang Bang Wang 17 7 0 18 May 2023
Transformer-based Variable-rate Image Compression with Region-of-interest Control Chia-Hao Kao Ying Weng Yi-Hsin Chen Wei-Chen Chiu Wenmin Peng 29 7 0 18 May 2023
Sasha: Creative Goal-Oriented Reasoning in Smart Homes with Large Language Models Evan King Haoxiang Yu Sangsu Lee Christine Julien LM&Ro 34 15 0 16 May 2023
SatLM: Satisfiability-Aided Language Models Using Declarative Prompting Xi Ye Qiaochu Chen Işıl Dillig Greg Durrett ReLM ReCod LRM 40 64 0 16 May 2023
Prompt-Tuning Decision Transformer with Preference Ranking Shengchao Hu Li Shen Ya Zhang Dacheng Tao OffRL 37 14 0 16 May 2023
UOR: Universal Backdoor Attacks on Pre-trained Language Models Wei Du Peixuan Li Yue Liu Haodong Zhao Gongshen Liu AAML 44 7 0 16 May 2023
Pre-Training to Learn in Context Yuxian Gu Li Dong Furu Wei Minlie Huang CLIP LRM ReLM 125 38 0 16 May 2023
Learning to Generalize for Cross-domain QA Yingjie Niu Linyi Yang Ruihai Dong Yue Zhang 29 6 0 14 May 2023
A Comprehensive Survey on Segment Anything Model for Vision and Beyond Chunhui Zhang Li Liu Yawen Cui Guanjie Huang Weilin Lin Yiqian Yang Yuehong Hu VLM 48 90 0 14 May 2023
Text2Cohort: Facilitating Intuitive Access to Biomedical Data with Natural Language Cohort Discovery Pranav Kulkarni Adway U. Kanhere Paul H. Yi Vishwa S. Parekh 27 0 0 12 May 2023
Multimodal Sentiment Analysis: A Survey Songning Lai Xifeng Hu Hao Xu Zhaoxia Ren Zhi Liu 47 32 0 12 May 2023
Two-in-One: A Model Hijacking Attack Against Text Generation Models Waiman Si Michael Backes Yang Zhang A. Salem SILM 34 22 0 12 May 2023
Prompt Learning to Mitigate Catastrophic Forgetting in Cross-lingual Transfer for Open-domain Dialogue Generation Lei Liu J. Huang CLL 34 2 0 12 May 2023
When Giant Language Brains Just Aren't Enough! Domain Pizzazz with Knowledge Sparkle Dust Minh Le Nguyen Duy-Hung Nguyen Shahab Sabahi Hung Le Jeffrey Yang Hajime Hotta 46 1 0 12 May 2023
Visual Tuning Bruce X. B. Yu Jianlong Chang Haixin Wang Lin Liu Shijie Wang ... Lingxi Xie Haojie Li Zhouchen Lin Qi Tian Chang Wen Chen VLM 62 38 0 10 May 2023
Technical Understanding from IML Hands-on Experience: A Study through a Public Event for Science Museum Visitors Wataru Kawabe Yuri Nakao Akihisa Shitara Yusuke Sugano 39 1 0 10 May 2023
Large Language Models Need Holistically Thought in Medical Conversational QA Yixuan Weng Bin Li Fei Xia Minjun Zhu Bing Sun Shizhu He Kang Liu Jun Zhao LM&MA AI4MH LRM DiffM ELM 34 5 0 09 May 2023
Interpretable multimodal sentiment analysis based on textual modality descriptions by using large-scale language models Sixia Li S. Okada 37 3 0 07 May 2023
Diffusion-NAT: Self-Prompting Discrete Diffusion for Non-Autoregressive Text Generation Kun Zhou Yifan Li Wayne Xin Zhao Ji-Rong Wen DiffM 31 14 0 06 May 2023
Using ChatGPT for Entity Matching Ralph Peeters Christian Bizer AI4MH 30 26 0 05 May 2023
Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledge Jiawei Liu Ziteng Xiong Yi-ping Jiang Yongqiang Ma Wei Lu Yong Huang Qikai Cheng 33 1 0 05 May 2023