Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
Localized Zeroth-Order Prompt Optimization Wenyang Hu Yao Shu Zongmin Yu Zhaoxuan Wu Xiangqiang Lin Zhongxiang Dai See-Kiong Ng Bryan Kian Hsiang Low 63 8 0 05 Mar 2024
Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustment Congzhi Zhang Linhai Zhang Jialong Wu Deyu Zhou Guoqiang Xu CML AI4CE LRM 107 21 0 05 Mar 2024
The Minimum Information about CLinical Artificial Intelligence Checklist for Generative Modeling Research (MI-CLAIM-GEN) Brenda Y. Miao Irene Y. Chen C. Y. Williams Jaysón M. Davidson Augusto Garcia-Agundez ... Bin Yu Milena Gianfrancesco A. Butte Beau Norgeot Madhumita Sushil VLM 96 2 0 05 Mar 2024
A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods Hanlei Jin Yang Zhang Dan Meng Jun Wang Jinghua Tan 249 96 0 05 Mar 2024
RIFF: Learning to Rephrase Inputs for Few-shot Fine-tuning of Language Models Saeed Najafi Alona Fyshe 78 2 0 04 Mar 2024
One Prompt Word is Enough to Boost Adversarial Robustness for Pre-trained Vision-Language Models Lin Li Haoyan Guan Jianing Qiu Michael W. Spratling AAML VLM VPVLM 101 24 0 04 Mar 2024
AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks Jiacen Xu Jack W. Stokes Geoff McDonald Xuesong Bai David Marshall Siyue Wang Adith Swaminathan Zhou Li 106 59 0 02 Mar 2024
Benchmarking zero-shot stance detection with FlanT5-XXL: Insights from training data, prompting, and decoding strategies into its near-SoTA performance Rachith Aiyappa Shruthi Senthilmani Jisun An Haewoon Kwak Yong-Yeol Ahn 73 3 0 01 Mar 2024
Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook Xingchen Zou Yibo Yan Xixuan Hao Yuehong Hu Haomin Wen ... Junbo Zhang Yong Li Tianrui Li Yu Zheng Yuxuan Liang HAI AI4TS 104 45 0 29 Feb 2024
SEED: Customize Large Language Models with Sample-Efficient Adaptation for Code Generation Xue Jiang Yihong Dong Zhi Jin Ge Li VLM 114 6 0 29 Feb 2024
Pointing out the Shortcomings of Relation Extraction Models with Semantically Motivated Adversarials Gennaro Nolano Moritz Blum Basil Ell Philipp Cimiano 57 1 0 29 Feb 2024
Global and Local Prompts Cooperation via Optimal Transport for Federated Learning Hongxia Li Wei Huang Jingya Wang Ye-ling Shi FedML VLM 116 21 0 29 Feb 2024
ICE-SEARCH: A Language Model-Driven Feature Selection Approach T. Yang Tim Tianyi Yang Fuyuan Lyu Shaoshan Liu Xue Xue Liu 122 4 0 28 Feb 2024
Content-Centric Prototyping of Generative AI Applications: Emerging Approaches and Challenges in Collaborative Software Teams Hari Subramonyam Divy Thakkar Jurgen Dieber Anoop Sinha 88 7 0 27 Feb 2024
Linguistic Knowledge Can Enhance Encoder-Decoder Models (If You Let It) Alessio Miaschi F. Dell’Orletta Giulia Venturi 87 1 0 27 Feb 2024
FaultProfIT: Hierarchical Fault Profiling of Incident Tickets in Large-scale Cloud Systems Junjie Huang Jinyang Liu Zhuangbin Chen Zhihan Jiang Yichen Li Jiazhen Gu Cong Feng Zengyin Yang Yongqiang Yang Michael R. Lyu 56 10 0 27 Feb 2024
FedLPPA: Learning Personalized Prompt and Aggregation for Federated Weakly-supervised Medical Image Segmentation Li Lin Yixiang Liu Jiewei Wu Pujin Cheng Zhiyuan Cai Kenneth K. Y. Wong Xiaoying Tang FedML 135 6 0 27 Feb 2024
A Piece of Theatre: Investigating How Teachers Design LLM Chatbots to Assist Adolescent Cyberbullying Education Michael A. Hedderich Natalie N. Bazarova Wenting Zou Ryun Shim Xinda Ma Qian Yang 97 27 0 27 Feb 2024
Chain-of-Thought Prompting of Large Language Models for Discovering and Fixing Software Vulnerabilities Yu Nong Mohammed Aldeen Long Cheng Hongxin Hu Feng Chen Haipeng Cai LRM 72 32 0 27 Feb 2024
Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models Yixin Liu Kai Zhang Yuan Li Zhiling Yan Chujie Gao ... Yue Huang Hanchi Sun Jianfeng Gao Lifang He Lichao Sun VLM VGen EGVM 194 300 0 27 Feb 2024
Deconstructing the Veneer of Simplicity: Co-Designing Introductory Generative AI Workshops with Local Entrepreneurs Yasmine Kotturi Angel Anderson Glenn Ford Michael Skirpan Jeffrey P. Bigham 85 8 0 26 Feb 2024
Dealing with Data for RE: Mitigating Challenges while using NLP and Generative AI S. Ghaisas Anmol Singhal 37 0 0 26 Feb 2024
MemoryPrompt: A Light Wrapper to Improve Context Tracking in Pre-trained Language Models Nathanaël Carraz Rakotonirina Marco Baroni VLM KELM 37 1 0 23 Feb 2024
In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization Ruiqi Zhang Jingfeng Wu Peter L. Bartlett 113 16 0 22 Feb 2024
NLAS-multi: A Multilingual Corpus of Automatically Generated Natural Language Argumentation Schemes Ramon Ruiz-Dolz Joaquín Taverner John Lawrence Chris Reed 85 8 0 22 Feb 2024
Multi-modal Stance Detection: New Datasets and Model Bin Liang Ang Li Jingqian Zhao Lin Gui Min Yang Yue Yu Kam-Fai Wong Ruifeng Xu 66 5 0 22 Feb 2024
FLAME: Self-Supervised Low-Resource Taxonomy Expansion using Large Language Models Sahil Mishra Ujjwal Sudev Tanmoy Chakraborty 36 3 0 21 Feb 2024
Wisdom of Committee: Distilling from Foundation Model to Specialized Application Model Zichang Liu Qingyun Liu Yuening Li Liang Liu Anshumali Shrivastava Shuchao Bi Lichan Hong Ed H. Chi Zhe Zhao VLM 73 5 0 21 Feb 2024
CLIPping the Deception: Adapting Vision-Language Models for Universal Deepfake Detection Sohail Ahmed Khan Duc-Tien Dang-Nguyen VLM 97 25 0 20 Feb 2024
PRECISE Framework: GPT-based Text For Improved Readability, Reliability, and Understandability of Radiology Reports For Patient-Centered Care Satvik Tripathi Liam Mutter Meghana C Muppuri Suhani Dheer Emiliano Garza-Frias ... Aakash Jha M. Dezube A. Tabari Christopher P. Bridge Dania Daye LM&MA 28 0 0 20 Feb 2024
UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction Yuan Yuan Jingtao Ding J. Feng Depeng Jin Yong Li AI4TS 107 71 0 19 Feb 2024
Where It Really Matters: Few-Shot Environmental Conservation Media Monitoring for Low-Resource Languages Sameer Jain Sedrick Scott Keh Shova Chettri Karun Dewan Pablo R. Izquierdo ... Pooja Shreshtha Cesar Suarez Zheyuan Ryan Shi Lei Li Fei Fang 52 0 0 19 Feb 2024
Uncovering Latent Human Wellbeing in Language Model Embeddings Pedro Freire ChengCheng Tan Adam Gleave Dan Hendrycks Scott Emmons 82 1 0 19 Feb 2024
In-Context Learning Demonstration Selection via Influence Analysis Vinay M.S. Minh-Hao Van Xintao Wu 100 6 0 19 Feb 2024
An Empirical Categorization of Prompting Techniques for Large Language Models: A Practitioner's Guide Oluwole Fagbohun Rachel M. Harrison Anton Dereventsov 131 9 0 18 Feb 2024
Ain't Misbehavin' -- Using LLMs to Generate Expressive Robot Behavior in Conversations with the Tabletop Robot Haru Zining Wang Paul Reisert Eric Nichols Randy Gomez 40 7 0 18 Feb 2024
ChatDiet: Empowering Personalized Nutrition-Oriented Food Recommender Chatbots through an LLM-Augmented Framework Zhongqi Yang Elahe Khatibi N. Nagesh Mahyar Abbasian Iman Azimi Ramesh C. Jain Amir M. Rahmani 95 46 0 18 Feb 2024
Puzzle Solving using Reasoning of Large Language Models: A Survey Panagiotis Giadikiaroglou Maria Lymperaiou Giorgos Filandrianos Giorgos Stamou ELM ReLM LRM 146 34 0 17 Feb 2024
TuneTables: Context Optimization for Scalable Prior-Data Fitted Networks Ben Feuer R. Schirrmeister Valeriia Cherepanova Chinmay Hegde Frank Hutter Micah Goldblum Niv Cohen Colin White 99 19 0 17 Feb 2024
Any-Shift Prompting for Generalization over Distributions Zehao Xiao Jiayi Shen Mohammad Mahdi Derakhshani Tianran Ouyang Cees G. M. Snoek OOD VPVLM VLM 120 10 0 15 Feb 2024
Balancing the Causal Effects in Class-Incremental Learning Junhao Zheng Ruiyan Wang Chongzhi Zhang Hu Feng Qianli Ma CML CLL 113 0 0 15 Feb 2024
All in One and One for All: A Simple yet Effective Method towards Cross-domain Graph Pretraining Haihong Zhao Aochuan Chen Xiangguo Sun Hong Cheng Jia Li 98 42 0 15 Feb 2024
Efficient Prompt Optimization Through the Lens of Best Arm Identification Chengshuai Shi Kun Yang Zihan Chen Jundong Li Jing Yang Cong Shen 93 10 0 15 Feb 2024
Prompt-based Personalized Federated Learning for Medical Visual Question Answering He Zhu Ren Togo Takahiro Ogawa Miki Haseyama MedIm 64 6 0 15 Feb 2024
How Secure Are Large Language Models (LLMs) for Navigation in Urban Environments? Congcong Wen Jiazhao Liang Shuaihang Yuan Hao Huang Geeta Chandra Raju Bethala Yu-Shen Liu Mengyu Wang Anthony Tzes Yi Fang AAML 95 6 0 14 Feb 2024
Proof-of-concept: Using ChatGPT to Translate and Modernize an Earth System Model from Fortran to Python/JAX Anthony Zhou Linnia Hawkins Pierre Gentine 48 2 0 13 Feb 2024
Large Language Models for the Automated Analysis of Optimization Algorithms Camilo Chacón Sartori Christian Blum Gabriela Ochoa 101 3 0 13 Feb 2024
Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models Jiacheng Ye Shansan Gong Liheng Chen Lin Zheng Jiahui Gao ... Chuan Wu Xin Jiang Zhenguo Li Wei Bi Lingpeng Kong DiffM LRM AI4CE 152 16 0 12 Feb 2024
Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous Driving and Zero-Shot Instruction Following Brian Yang Huangyuan Su N. Gkanatsios Tsung-Wei Ke Ayush Jain Jeff Schneider Katerina Fragkiadaki DiffM 104 25 0 09 Feb 2024
A Unified Causal View of Instruction Tuning Luyao Chen Wei Huang Ruqing Zhang Wei Chen Jiafeng Guo Xueqi Cheng 55 1 0 09 Feb 2024