Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,811 papers shown

Title
Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphs Xingtong Yu Zhenghao Liu Yuan Fang Zemin Liu Sihong Chen Xinming Zhang 48 24 0 26 Nov 2023
BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP Jiawang Bai Kuofeng Gao Shaobo Min Shu-Tao Xia Zhifeng Li Wei Liu VLM 34 38 0 26 Nov 2023
GPT Struct Me: Probing GPT Models on Narrative Entity Extraction Hugo Sousa Nuno Guimarães A. Jorge Ricardo Campos 96 8 0 24 Nov 2023
Progressive Learning with Visual Prompt Tuning for Variable-Rate Image Compression Shiyu Qin Yimin Zhou Jinpeng Wang Bin Chen Baoyi An Tao Dai Shu-Tao Xia VLM 40 1 0 23 Nov 2023
Enhancing Summarization Performance through Transformer-Based Prompt Engineering in Automated Medical Reporting Daphne van Zandvoort Laura Wiersema Tom Huibers S. Dulmen S. Brinkkemper LM&MA MedIm 33 7 0 22 Nov 2023
CSMeD: Bridging the Dataset Gap in Automated Citation Screening for Systematic Literature Reviews Wojciech Kusa Óscar E. Mendoza Matthias Samwald Petr Knoth Allan Hanbury 47 4 0 21 Nov 2023
A Survey on Large Language Models for Personalized and Explainable Recommendations Junyi Chen LRM 138 12 0 21 Nov 2023
Applications of Large Scale Foundation Models for Autonomous Driving Yu Huang Yue Chen Zhu Li ELM AI4CE LRM ALM LM&Ro 63 15 0 20 Nov 2023
Experts-in-the-Loop: Establishing an Effective Workflow in Crafting Privacy Q&A Zahra Kolagar Anna Leschanowsky Birgit Popp 35 1 0 18 Nov 2023
(Why) Is My Prompt Getting Worse? Rethinking Regression Testing for Evolving LLM APIs Wanqin Ma Chenyang Yang Christian Kastner 29 21 0 18 Nov 2023
Towards Robust and Accurate Visual Prompting Qi Li Liangzhi Li Zhouqiang Jiang Bowen Wang VPVLM VLM 34 3 0 18 Nov 2023
Learning interactions to boost human creativity with bandits and GPT-4 Ara Vartanian Xiaoxi Sun Yun-Shiuan Chuang Siddharth Suresh Xiaojin Zhu Timothy T. Rogers 14 1 0 16 Nov 2023
Language Generation from Brain Recordings Ziyi Ye Qingyao Ai Yiqun Liu Maarten de Rijke Min Zhang Christina Lioma Tuukka Ruotsalo 32 0 0 16 Nov 2023
StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem Solving Chang Gao Haiyun Jiang Deng Cai Shuming Shi Wai Lam LRM 44 3 0 15 Nov 2023
XplainLLM: A QA Explanation Dataset for Understanding LLM Decision-Making Zichen Chen Jianda Chen Mitali Gaidhani Ambuj K. Singh Misha Sra 38 4 0 15 Nov 2023
How You Prompt Matters! Even Task-Oriented Constraints in Instructions Affect LLM-Generated Text Detection Ryuto Koike Masahiro Kaneko Naoaki Okazaki DeLMO 27 6 0 14 Nov 2023
ActiveDC: Distribution Calibration for Active Finetuning Wenshuai Xu Zhenhui Hu Yu Lu Jinzhou Meng Qingjie Liu Yunhong Wang 28 1 0 13 Nov 2023
Gen-Z: Generative Zero-Shot Text Classification with Contextualized Label Descriptions Sachin Kumar Chan Young Park Yulia Tsvetkov VLM 34 2 0 13 Nov 2023
Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer Bowen Tan Yun Zhu Lijuan Liu Eric P. Xing Zhiting Hu Jindong Chen ALM LRM 45 7 0 12 Nov 2023
Word Definitions from Large Language Models Yunting Yin Steven Skiena Samuel Kim Yunting Yin Steven Skiena AILaw 48 0 0 10 Nov 2023
AccEPT: An Acceleration Scheme for Speeding Up Edge Pipeline-parallel Training Yuhao Chen Yuxuan Yan Qianqian Yang Yuanchao Shu Shibo He Zhiguo Shi Jiming Chen 50 0 0 10 Nov 2023
GIPCOL: Graph-Injected Soft Prompting for Compositional Zero-Shot Learning Guangyue Xu Joyce Chai Parisa Kordjamshidi VLM 23 16 0 09 Nov 2023
TencentLLMEval: A Hierarchical Evaluation of Real-World Capabilities for Human-Aligned LLMs Shuyi Xie Wenlin Yao Yong Dai Shaobo Wang Donlin Zhou ... Zhichao Hu Dong Yu Zhengyou Zhang Jing Nie Yuhong Liu ELM ALM 21 4 0 09 Nov 2023
Chain of Images for Intuitively Reasoning Fanxu Meng Haotong Yang Yiding Wang Muhan Zhang LRM 41 7 0 09 Nov 2023
An Experiment in Retrofitting Competency Questions for Existing Ontologies Reham Alharbi Valentina Tamma Floriana Grasso Terry R. Payne 35 10 0 09 Nov 2023
Evaluating multiple large language models in pediatric ophthalmology J. Holmes Rui Peng Yiwei Li Jinyu Hu Zheng Liu ... Wei Liu Hong Wei Jie Zou Tianming Liu Yi Shao AI4Ed ELM LM&MA 26 0 0 07 Nov 2023
Scene-Driven Multimodal Knowledge Graph Construction for Embodied AI Yaoxian Song Penglei Sun Haoyu Liu Li Zhixu Wei Song Yanghua Xiao Xiaofang Zhou LM&Ro 56 15 0 07 Nov 2023
Instruct Me More! Random Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 35 16 0 07 Nov 2023
AI Chatbot for Generating Episodic Future Thinking (EFT) Cue Texts for Health Sareh Ahmadi Edward A. Fox AI4MH 6 1 0 06 Nov 2023
ProSG: Using Prompt Synthetic Gradients to Alleviate Prompt Forgetting of RNN-like Language Models Haotian Luo Kunming Wu Cheng Dai Sixian Ding Xinhao Chen 27 1 0 03 Nov 2023
A Graph-to-Text Approach to Knowledge-Grounded Response Generation in Human-Robot Interaction Nicholas Walker Stefan Ultes Pierre Lison LM&Ro 61 1 0 03 Nov 2023
Unleashing the Creative Mind: Language Model As Hierarchical Policy For Improved Exploration on Challenging Problem Solving Z. Ling Yunhao Fang Xuanlin Li Tongzhou Mu Mingu Lee Reza Pourreza Roland Memisevic Hao Su LRM 38 4 0 01 Nov 2023
Prompt-based Logical Semantics Enhancement for Implicit Discourse Relation Recognition Chenxu Wang Ping Jian Mu Huang 11 5 0 01 Nov 2023
DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models Xinwei Wu Junzhuo Li Minghui Xu Weilong Dong Shuangzhi Wu Chao Bian Deyi Xiong MU KELM 32 46 0 31 Oct 2023
Strategies to Harness the Transformers' Potential: UNSL at eRisk 2023 Horacio Thompson L. Cagnina Marcelo Errecalde 19 4 0 30 Oct 2023
Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models Pushkal Katara Zhou Xian Katerina Fragkiadaki LM&Ro 63 39 0 27 Oct 2023
Unlocking the Potential of Prompt-Tuning in Bridging Generalized and Personalized Federated Learning Wenlong Deng Christos Thrampoulidis Xiaoxiao Li 40 12 0 27 Oct 2023
A Survey on Trustworthy Edge Intelligence: From Security and Reliability To Transparency and Sustainability Xiaojie Wang Beibei Wang Yu Wu Zhaolong Ning Song Guo Feng Yu 42 13 0 27 Oct 2023
Data Augmentation for Emotion Detection in Small Imbalanced Text Data Anna Koufakou Diego Grisales Ragy Costa de jesus Oscar Fox 20 2 0 25 Oct 2023
Improving a Named Entity Recognizer Trained on Noisy Data with a Few Clean Instances Zhendong Chu Ruiyi Zhang Tong Yu R. Jain Vlad I. Morariu Jiuxiang Gu A. Nenkova NoLa 38 2 0 25 Oct 2023
MultiPrompter: Cooperative Prompt Optimization with Multi-Agent Reinforcement Learning Dong-Ki Kim Sungryull Sohn Lajanugen Logeswaran Dongsub Shim Honglak Lee LLMAG 47 1 0 25 Oct 2023
Enhancing Document Information Analysis with Multi-Task Pre-training: A Robust Approach for Information Extraction in Visually-Rich Documents Tofik Ali Partha Pratim Roy 19 0 0 25 Oct 2023
Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition Sander Schulhoff Jeremy Pinto Anaum Khan Louis-Franccois Bouchard Chenglei Si Svetlina Anati Valen Tagliabue Anson Liu Kost Christopher Carnahan Jordan L. Boyd-Graber SILM 39 41 0 24 Oct 2023
Density of States Prediction of Crystalline Materials via Prompt-guided Multi-Modal Transformer Namkyeong Lee Heewoong Noh Sungwon Kim Dongmin Hyun Gyoung S. Na Chanyoung Park 34 6 0 24 Oct 2023
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules Chaojun Xiao Yuqi Luo Wenbin Zhang Pengle Zhang Xu Han ... Zhengyan Zhang Ruobing Xie Zhiyuan Liu Maosong Sun Jie Zhou 35 0 0 24 Oct 2023
Confounder Balancing in Adversarial Domain Adaptation for Pre-Trained Large Models Fine-Tuning Shuoran Jiang Qingcai Chen Yang Xiang Youcheng Pan Xiangping Wu AI4CE 26 0 0 24 Oct 2023
A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models Yuanfeng Song Yuanqin He Xuefang Zhao Hanlin Gu Di Jiang Haijun Yang Lixin Fan Qiang Yang 40 3 0 24 Oct 2023
The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Risks Xiaoyi Chen Siyuan Tang Rui Zhu Shijun Yan Lei Jin Zihao Wang Liya Su Zhikun Zhang Xiaofeng Wang Haixu Tang AAML PILM 24 17 0 24 Oct 2023
Interpreting Answers to Yes-No Questions in User-Generated Content Shivam Mathur Keun Hee Park Dhivya Chinnappa Saketh Kotamraju Eduardo Blanco 26 0 0 24 Oct 2023
Efficient Data Learning for Open Information Extraction with Pre-trained Language Models Zhiyuan Fan Shizhu He 18 1 0 23 Oct 2023