Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
XplainLLM: A QA Explanation Dataset for Understanding LLM Decision-Making Zichen Chen Jianda Chen Mitali Gaidhani Ambuj K. Singh Misha Sra 67 5 0 15 Nov 2023
How You Prompt Matters! Even Task-Oriented Constraints in Instructions Affect LLM-Generated Text Detection Ryuto Koike Masahiro Kaneko Naoaki Okazaki DeLMO 53 8 0 14 Nov 2023
ActiveDC: Distribution Calibration for Active Finetuning Wenshuai Xu Zhenhui Hu Yu Lu Jinzhou Meng Qingjie Liu Yunhong Wang 111 1 0 13 Nov 2023
Gen-Z: Generative Zero-Shot Text Classification with Contextualized Label Descriptions Sachin Kumar Chan Young Park Yulia Tsvetkov VLM 63 3 0 13 Nov 2023
Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer Bowen Tan Yun Zhu Lijuan Liu Eric P. Xing Zhiting Hu Jindong Chen ALM LRM 103 7 0 12 Nov 2023
Word Definitions from Large Language Models Yunting Yin Steven Skiena Samuel Kim Yunting Yin Steven Skiena AILaw 127 0 0 10 Nov 2023
AccEPT: An Acceleration Scheme for Speeding Up Edge Pipeline-parallel Training Yuhao Chen Yuxuan Yan Qianqian Yang Yuanchao Shu Shibo He Zhiguo Shi Jiming Chen 84 0 0 10 Nov 2023
GIPCOL: Graph-Injected Soft Prompting for Compositional Zero-Shot Learning Guangyue Xu Joyce Chai Parisa Kordjamshidi VLM 78 15 0 09 Nov 2023
TencentLLMEval: A Hierarchical Evaluation of Real-World Capabilities for Human-Aligned LLMs Shuyi Xie Wenlin Yao Yong Dai Shaobo Wang Donlin Zhou ... Zhichao Hu Dong Yu Zhengyou Zhang Jing Nie Yuhong Liu ELM ALM 98 4 0 09 Nov 2023
Chain of Images for Intuitively Reasoning Fanxu Meng Haotong Yang Yiding Wang Muhan Zhang LRM 78 10 0 09 Nov 2023
An Experiment in Retrofitting Competency Questions for Existing Ontologies Reham Alharbi Valentina Tamma Floriana Grasso Terry R. Payne 60 13 0 09 Nov 2023
Evaluating multiple large language models in pediatric ophthalmology J. Holmes Rui Peng Yiwei Li Jinyu Hu Zheng Liu ... Wei Liu Hong Wei Jie Zou Tianming Liu Yi Shao AI4Ed ELM LM&MA 49 2 0 07 Nov 2023
Scene-Driven Multimodal Knowledge Graph Construction for Embodied AI Yaoxian Song Penglei Sun Haoyu Liu Li Zhixu Wei Song Yanghua Xiao Xiaofang Zhou LM&Ro 120 16 0 07 Nov 2023
Instruct Me More! Random Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 77 19 0 07 Nov 2023
AI Chatbot for Generating Episodic Future Thinking (EFT) Cue Texts for Health Sareh Ahmadi Edward A. Fox AI4MH 21 1 0 06 Nov 2023
ProSG: Using Prompt Synthetic Gradients to Alleviate Prompt Forgetting of RNN-like Language Models Haotian Luo Kunming Wu Cheng Dai Sixian Ding Xinhao Chen 37 1 0 03 Nov 2023
A Graph-to-Text Approach to Knowledge-Grounded Response Generation in Human-Robot Interaction Nicholas Walker Stefan Ultes Pierre Lison LM&Ro 164 1 0 03 Nov 2023
Unleashing the Creative Mind: Language Model As Hierarchical Policy For Improved Exploration on Challenging Problem Solving Z. Ling Yunhao Fang Xuanlin Li Tongzhou Mu Mingu Lee Reza Pourreza Roland Memisevic Hao Su LRM 93 4 0 01 Nov 2023
Prompt-based Logical Semantics Enhancement for Implicit Discourse Relation Recognition Chenxu Wang Ping Jian Mu Huang 53 5 0 01 Nov 2023
DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models Xinwei Wu Junzhuo Li Minghui Xu Weilong Dong Shuangzhi Wu Chao Bian Deyi Xiong MU KELM 99 55 0 31 Oct 2023
Strategies to Harness the Transformers' Potential: UNSL at eRisk 2023 Horacio Thompson L. Cagnina Marcelo Errecalde 31 4 0 30 Oct 2023
Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models Pushkal Katara Zhou Xian Katerina Fragkiadaki LM&Ro 126 44 0 27 Oct 2023
Unlocking the Potential of Prompt-Tuning in Bridging Generalized and Personalized Federated Learning Wenlong Deng Christos Thrampoulidis Xiaoxiao Li 134 12 0 27 Oct 2023
A Survey on Trustworthy Edge Intelligence: From Security and Reliability To Transparency and Sustainability Xiaojie Wang Beibei Wang Yu Wu Zhaolong Ning Song Guo Feng Yu 79 16 0 27 Oct 2023
Data Augmentation for Emotion Detection in Small Imbalanced Text Data Anna Koufakou Diego Grisales Ragy Costa de jesus Oscar Fox 63 3 0 25 Oct 2023
Improving a Named Entity Recognizer Trained on Noisy Data with a Few Clean Instances Zhendong Chu Ruiyi Zhang Tong Yu R. Jain Vlad I. Morariu Jiuxiang Gu A. Nenkova NoLa 118 2 0 25 Oct 2023
MultiPrompter: Cooperative Prompt Optimization with Multi-Agent Reinforcement Learning Dong-Ki Kim Sungryull Sohn Lajanugen Logeswaran Dongsub Shim Honglak Lee LLMAG 85 1 0 25 Oct 2023
Enhancing Document Information Analysis with Multi-Task Pre-training: A Robust Approach for Information Extraction in Visually-Rich Documents Tofik Ali Partha Pratim Roy 57 0 0 25 Oct 2023
Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition Sander Schulhoff Jeremy Pinto Anaum Khan Louis-Franccois Bouchard Chenglei Si Svetlina Anati Valen Tagliabue Anson Liu Kost Christopher Carnahan Jordan L. Boyd-Graber SILM 98 46 0 24 Oct 2023
Density of States Prediction of Crystalline Materials via Prompt-guided Multi-Modal Transformer Namkyeong Lee Heewoong Noh Sungwon Kim Dongmin Hyun Gyoung S. Na Chanyoung Park 54 6 0 24 Oct 2023
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules Chaojun Xiao Yuqi Luo Wenbin Zhang Pengle Zhang Xu Han ... Zhengyan Zhang Ruobing Xie Zhiyuan Liu Maosong Sun Jie Zhou 78 1 0 24 Oct 2023
Confounder Balancing in Adversarial Domain Adaptation for Pre-Trained Large Models Fine-Tuning Shuoran Jiang Qingcai Chen Yang Xiang Youcheng Pan Xiangping Wu AI4CE 126 1 0 24 Oct 2023
A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models Yuanfeng Song Yuanqin He Xuefang Zhao Hanlin Gu Di Jiang Haijun Yang Lixin Fan Qiang Yang 76 6 0 24 Oct 2023
The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Risks Xiaoyi Chen Siyuan Tang Rui Zhu Shijun Yan Lei Jin Zihao Wang Liya Su Zhikun Zhang Wenyuan Xu Haixu Tang AAML PILM 76 24 0 24 Oct 2023
Interpreting Answers to Yes-No Questions in User-Generated Content Shivam Mathur Keun Hee Park Dhivya Chinnappa Saketh Kotamraju Eduardo Blanco 49 0 0 24 Oct 2023
Efficient Data Learning for Open Information Extraction with Pre-trained Language Models Zhiyuan Fan Shizhu He 35 1 0 23 Oct 2023
Efficient Cross-Task Prompt Tuning for Few-Shot Conversational Emotion Recognition Yige Xu Zhiwei Zeng Zhiqi Shen VLM 82 3 0 23 Oct 2023
CITB: A Benchmark for Continual Instruction Tuning Zihan Zhang Meng Fang Ling-Hao Chen Mohammad-Reza Namazi-Rad ALM CLL 97 26 0 23 Oct 2023
Prompt Engineering Through the Lens of Optimal Control Yifan Luo Yiming Tang Chengfeng Shen Zhennan Zhou Bin Dong OffRL 67 7 0 22 Oct 2023
Large Language Models and Multimodal Retrieval for Visual Word Sense Disambiguation Anastasia Kritharoula Maria Lymperaiou Giorgos Stamou 96 6 0 21 Oct 2023
An LLM can Fool Itself: A Prompt-Based Adversarial Attack Xilie Xu Keyi Kong Ning Liu Li-zhen Cui Di Wang Jingfeng Zhang Mohan Kankanhalli AAML SILM 129 88 0 20 Oct 2023
Enhancing Zero-Shot Crypto Sentiment with Fine-tuned Language Model and Prompt Engineering Rahman S. M. Wahidur Ishmam Tashdeed Manjit Kaur Heung-No Lee ALM 96 17 0 20 Oct 2023
AutoMix: Automatically Mixing Language Models Pranjal Aggarwal Aman Madaan Ankit Anand Srividya Pranavi Potharaju Swaroop Mishra ... Karthik Kappaganthu Yiming Yang Shyam Upadhyay Manaal Faruqui Mausam 194 26 0 19 Oct 2023
Named Entity Recognition for Monitoring Plant Health Threats in Tweets: a ChouBERT Approach Shufan Jiang Rafael Angarita Stéphane Cormier Francis Rousseaux 21 0 0 19 Oct 2023
Exploring In-Context Learning of Textless Speech Language Model for Speech Classification Tasks Ming-Hao Hsu Kai-Wei Chang Shang-Wen Li Hung-yi Lee 96 7 0 19 Oct 2023
Quantifying Privacy Risks of Prompts in Visual Prompt Learning Yixin Wu Rui Wen Michael Backes Pascal Berrang Mathias Humbert Yun Shen Yang Zhang AAML VPVLM 107 10 0 18 Oct 2023
Utilising a Large Language Model to Annotate Subject Metadata: A Case Study in an Australian National Research Data Catalogue Shiwei Zhang Ming-Lun Wu Xiuzhen Zhang 73 4 0 17 Oct 2023
Entity Matching using Large Language Models Ralph Peeters Christian Bizer 86 15 0 17 Oct 2023
Unifying Image Processing as Visual Prompting Question Answering Yihao Liu Xiangyu Chen Xianzheng Ma Xintao Wang Jiantao Zhou Yu Qiao Chao Dong MLLM 88 20 0 16 Oct 2023
Using Global Land Cover Product as Prompt for Cropland Mapping via Visual Foundation Model Chao Tao Aoran Hu Rong Xiao Haifeng Li Yuze Wang AI4CE VLM 88 1 0 16 Oct 2023