Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
Energy-based Models are Zero-Shot Planners for Compositional Scene Rearrangement N. Gkanatsios Ayush Jain Zhou Xian Yunchu Zhang C. Atkeson Katerina Fragkiadaki LM&Ro 160 33 0 27 Apr 2023
On the Generalization Error of Meta Learning for the Gibbs Algorithm Yuheng Bu Harsha Vardhan Tetali Gholamali Aminian Miguel R. D. Rodrigues G. Wornell AI4CE 94 3 0 27 Apr 2023
Multimodal Grounding for Embodied AI via Augmented Reality Headsets for Natural Language Driven Task Planning Selma Wanna Fabian Parra R. Valner Karl Kruusamäe Mitch Pryor LM&Ro 73 2 0 26 Apr 2023
FVP: Fourier Visual Prompting for Source-Free Unsupervised Domain Adaptation of Medical Image Segmentation Yan Wang Jian Cheng Yixin Chen Shuai Shao Lanyun Zhu Zhenzhou Wu Tianming Liu Haogang Zhu OOD MedIm 126 26 0 26 Apr 2023
Learnable Ophthalmology SAM Zhongxi Qiu Yan Hu Heng Li Jiang-Dong Liu VLM MedIm 95 27 0 26 Apr 2023
Towards Medical Artificial General Intelligence via Knowledge-Enhanced Multimodal Pretraining Bingqian Lin Zicong Chen Mingjie Li Haokun Lin Hang Xu ... Ling-Hao Chen Xiaojun Chang Yi Yang L. Xing Xiaodan Liang LM&MA MedIm AI4CE 94 14 0 26 Apr 2023
CitePrompt: Using Prompts to Identify Citation Intent in Scientific Papers Avishek Lahiri Debarshi Kumar Sanyal Imon Mukherjee 44 8 0 25 Apr 2023
Empirical Evaluation of ChatGPT on Requirements Information Retrieval Under Zero-Shot Setting Jianzhang Zhang Yiyang Chen Nan Niu Yinglin Wang Chuang Liu 99 20 0 25 Apr 2023
Semantic Compression With Large Language Models Henry Gilbert Michael Sandborn Douglas C. Schmidt Jesse Spencer-Smith Jules White 54 23 0 25 Apr 2023
Who's the Best Detective? LLMs vs. MLs in Detecting Incoherent Fourth Grade Math Answers Felipe Urrutia R. Araya 61 3 0 21 Apr 2023
DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction Mohammadreza Pourreza Davood Rafiei ReLM LRM 127 357 0 21 Apr 2023
GeoLayoutLM: Geometric Pre-training for Visual Information Extraction Chuwei Luo Changxu Cheng Qi Zheng Cong Yao 78 49 0 21 Apr 2023
Prompt-Learning for Cross-Lingual Relation Extraction Chiaming Hsu Changtong Zan Liang Ding Longyue Wang Xiaoting Wang Weifeng Liu Fu Lin Wenbin Hu LRM 73 6 0 20 Apr 2023
MasakhaNEWS: News Topic Classification for African languages David Ifeoluwa Adelani Marek Masiak Israel Abebe Azime Jesujoba Oluwadara Alabi A. Tonja ... Moges Ahmed Mehamed Evrard Ngabire Jules Jules Ivan Ssenkungu Pontus Stenetorp 121 24 0 19 Apr 2023
Progressive-Hint Prompting Improves Reasoning in Large Language Models Chuanyang Zheng Zhengying Liu Enze Xie Zhenguo Li Yu Li LLMAG ReLM LRM 123 106 0 19 Apr 2023
Emotion fusion for mental illness detection from social media: A survey Tianlin Zhang Kailai Yang Shaoxiong Ji Sophia Ananiadou 95 57 0 19 Apr 2023
MixPro: Simple yet Effective Data Augmentation for Prompt-based Learning Bohan Li Longxu Dou Yutai Hou Yunlong Feng Honglin Mu Qingfu Zhu Qinghua Sun Wanxiang Che VLM 78 4 0 19 Apr 2023
BIM-GPT: a Prompt-Based Virtual Assistant Framework for BIM Information Retrieval Junwen Zheng M. Fischer 58 13 0 18 Apr 2023
Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Task Zihao Wu Lu Zhang Chao-Yang Cao Xiao-Xing Yu Haixing Dai ... Quanzheng Li Dinggang Shen Xiang Li Dajiang Zhu Tianming Liu LM&MA 66 39 0 18 Apr 2023
D2CSE: Difference-aware Deep continuous prompts for Contrastive Sentence Embeddings HyunJae Lee VLM 54 0 0 18 Apr 2023
An Evaluation on Large Language Model Outputs: Discourse and Memorization Adrian de Wynter Xun Wang Alex Sokolov Qilong Gu Si-Qing Chen ELM 141 34 0 17 Apr 2023
Hyper-Decision Transformer for Efficient Online Policy Adaptation Mengdi Xu Yuchen Lu Songlin Yang Shun Zhang Ding Zhao Chuang Gan OffRL 73 41 0 17 Apr 2023
An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT Chong Ma Zihao Wu Jiaqi Wang Shaochen Xu Yaonai Wei ... Tuo Zhang Dajiang Zhu Dinggang Shen Tianming Liu Xiang Li MedIm LM&MA 99 103 0 17 Apr 2023
In-Context Operator Learning with Data Prompts for Differential Equation Problems Liu Yang Siting Liu Tingwei Meng Stanley J. Osher 137 65 0 17 Apr 2023
Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Coding Ziang Xiao Xingdi Yuan Q. V. Liao Rania Abdelghani Pierre-Yves Oudeyer 80 149 0 17 Apr 2023
Enhancing Automated Program Repair through Fine-tuning and Prompt Engineering Rishov Paul Md. Mohib Hossain Mohammed Latif Siddiq Masum Hasan Anindya Iqbal Joanna C. S. Santos KELM 79 12 0 16 Apr 2023
VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping Zheng Zhang Jie Ying Gao Ranjodh Singh Dhaliwal Toby Jia-Jun Li 98 95 0 16 Apr 2023
SikuGPT: A Generative Pre-trained Model for Intelligent Information Processing of Ancient Texts from the Perspective of Digital Humanities Chang Liu Dongbo Wang Zhixiao Zhao Die Hu Mengcheng Wu ... Si Shen Bin Li Jiangfeng Liu Hai Zhang Lianzheng Zhao 49 10 0 16 Apr 2023
Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models Yaohua Zha Jinpeng Wang Tao Dai Bin Chen Zhi Wang Shutao Xia VLM 117 48 0 14 Apr 2023
Just Tell Me: Prompt Engineering in Business Process Management Kiran Busch Alexander Rochlitzer Diana Sola Henrik Leopold 94 29 0 14 Apr 2023
RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment Hanze Dong Wei Xiong Deepanshu Goyal Yihan Zhang Winnie Chow Boyao Wang Shizhe Diao Jipeng Zhang Kashun Shum Tong Zhang ALM 162 470 0 13 Apr 2023
How Useful are Educational Questions Generated by Large Language Models? Sabina Elkins E. Kochmar Jackie C.K. Cheung Iulian Serban ELM AI4Ed 76 34 0 13 Apr 2023
"What It Wants Me To Say": Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language Models Michael Xieyang Liu Advait Sarkar Carina Negreanu B. Zorn Jack Williams N. Toronto Andrew D. Gordon 95 111 0 13 Apr 2023
Solving Tensor Low Cycle Rank Approximation Yichuan Deng Yeqi Gao Zhao Song 80 6 0 13 Apr 2023
LINGO : Visually Debiasing Natural Language Instructions to Support Task Diversity Anjana Arunkumar Shubham Sharma Rakhi Agrawal Sriramakrishnan Chandrasekaran Chris Bryan 80 0 0 12 Apr 2023
Boosted Prompt Ensembles for Large Language Models Silviu Pitis Michael Ruogu Zhang Andrew Wang Jimmy Ba LRM LLMAG 73 43 0 12 Apr 2023
Global Prompt Cell: A Portable Control Module for Effective Prompt Tuning Chi-Liang Liu Hao Wang Nuwa Xi Sendong Zhao Bing Qin VLM 79 1 0 12 Apr 2023
Prompt Learning for News Recommendation Zizhuo Zhang Bang-wei Wang AI4TS 73 66 0 11 Apr 2023
FashionSAP: Symbols and Attributes Prompt for Fine-grained Fashion Vision-Language Pre-training Yunpeng Han Lisai Zhang Qingcai Chen Zhijian Chen Zhonghua Li Jianxin Yang Bo Zhao AI4TS VLM 89 13 0 11 Apr 2023
ImageCaptioner $^2$ : Image Captioner for Image Captioning Bias Amplification Assessment Eslam Mohamed Bakr Pengzhan Sun Erran L. Li Mohamed Elhoseiny 53 6 0 10 Apr 2023
Exploring Effective Factors for Improving Visual In-Context Learning Yanpeng Sun Qiang Chen Jian Wang Jingdong Wang Zechao Li LRM VLM 106 26 0 10 Apr 2023
Interaction-Aware Prompting for Zero-Shot Spatio-Temporal Action Detection Wei-Jhe Huang Jheng-Hsien Yeh Min-Hung Chen Gueter Josmy Faure S. Lai 89 4 0 10 Apr 2023
Similarity-Aware Multimodal Prompt Learning for Fake News Detection Ye Jiang Xiaomin Yu Yimin Wang Xiaoman Xu Xingyi Song Diana Maynard 85 27 0 09 Apr 2023
Revisiting Automated Prompting: Are We Actually Doing Better? Yulin Zhou Yiren Zhao Ilia Shumailov Robert D. Mullins Y. Gal 117 8 0 07 Apr 2023
Does Prompt-Tuning Language Model Ensure Privacy? Shangyu Xie Wei Dai Esha Ghosh Sambuddha Roy Dan Schwartz Kim Laine SILM 97 4 0 07 Apr 2023
Vita-CLIP: Video and text adaptive CLIP via Multimodal Prompting Syed Talal Wasim Muzammal Naseer Salman Khan Fahad Shahbaz Khan M. Shah VLM VPVLM 117 79 0 06 Apr 2023
Approach Intelligent Writing Assistants Usability with Seven Stages of Action Avinash Bhat Disha Shrivastava Jin L. C. Guo 48 2 0 06 Apr 2023
"It's Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice Programmers James Prather B. Reeves Paul Denny Brett A. Becker Juho Leinonen Andrew Luxton-Reilly Garrett B. Powell James Finnie-Ansley E. Santos 84 152 0 05 Apr 2023
PromptAid: Prompt Exploration, Perturbation, Testing and Iteration using Visual Analytics for Large Language Models Aditi Mishra Utkarsh Soni Anjana Arunkumar Jinbin Huang Bum Chul Kwon Chris Bryan LRM 83 35 0 04 Apr 2023
Learning to Name Classes for Vision and Language Models Sarah Parisot Yongxin Yang Jingyu Sun VLM 89 10 0 04 Apr 2023