Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,809 papers shown

Title
Large Language Models are Contrastive Reasoners Liang Yao ReLM ELM LRM 45 2 0 13 Mar 2024
DrPlanner: Diagnosis and Repair of Motion Planners Using Large Language Models Yuanfei Lin Chenran Li Mingyu Ding Masayoshi Tomizuka Wei Zhan Matthias Althoff 41 5 0 12 Mar 2024
Fine-tuning vs Prompting, Can Language Models Understand Human Values? Pingwei Sun 32 1 0 12 Mar 2024
DiPrompT: Disentangled Prompt Tuning for Multiple Latent Domain Generalization in Federated Learning Sikai Bai Jiewei Zhang Shuaicheng Li Song Guo Jingcai Guo Jun Hou Tao Han Xiaocheng Lu FedML 34 14 0 11 Mar 2024
FaceChain-SuDe: Building Derived Class to Inherit Category Attributes for One-shot Subject-Driven Generation Pengchong Qiao Lei Shang Chang-Shu Liu Baigui Sun Xiang Ji Jie Chen CVBM 38 3 0 11 Mar 2024
Enhancing 3D Object Detection with 2D Detection-Guided Query Anchors Haoxuanye Ji Pengpeng Liang Erkang Cheng 3DPC 41 3 0 10 Mar 2024
POV: Prompt-Oriented View-Agnostic Learning for Egocentric Hand-Object Interaction in the Multi-View World Boshen Xu Sipeng Zheng Qin Jin 52 7 0 09 Mar 2024
Extending Activation Steering to Broad Skills and Multiple Behaviours Teun van der Weij Massimo Poesio Nandi Schoots LLMSV 47 12 0 09 Mar 2024
Deep Prompt Multi-task Network for Abuse Language Detection Jian Zhu Yuping Ruan Jingfei Chang Wenhui Sun Hui Wan Jian Long Cheng Luo AAML 24 2 0 08 Mar 2024
Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question Answering Hongda Sun Yuxuan Liu Chengwei Wu Haiyu Yan Cheng Tai Xin Gao Shuo Shang Rui Yan 30 7 0 08 Mar 2024
Denoising Autoregressive Representation Learning Yazhe Li J. Bornschein Ting Chen DiffM 40 3 0 08 Mar 2024
KnowledgeVIS: Interpreting Language Models by Comparing Fill-in-the-Blank Prompts Adam Joseph Coscia Alex Endert VLM 38 9 0 07 Mar 2024
Chain of Thought Explanation for Dialogue State Tracking Lin Xu Ningxin Peng Daquan Zhou See-Kiong Ng Jinlan Fu LRM 27 1 0 07 Mar 2024
Levels of AI Agents: from Rules to Large Language Models Yu Huang AI4CE ELM LM&Ro 43 2 0 06 Mar 2024
Localized Zeroth-Order Prompt Optimization Wenyang Hu Yao Shu Zongmin Yu Zhaoxuan Wu Xiangqiang Lin Zhongxiang Dai See-Kiong Ng Bryan Kian Hsiang Low 35 6 0 05 Mar 2024
Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustment Congzhi Zhang Linhai Zhang Jialong Wu Deyu Zhou Guoqiang Xu CML AI4CE LRM 44 15 0 05 Mar 2024
The Minimum Information about CLinical Artificial Intelligence Checklist for Generative Modeling Research (MI-CLAIM-GEN) Brenda Y. Miao Irene Y. Chen C. Y. Williams Jaysón M. Davidson Augusto Garcia-Agundez ... Bin Yu Milena Gianfrancesco A. Butte Beau Norgeot Madhumita Sushil VLM 42 2 0 05 Mar 2024
A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods Hanlei Jin Yang Zhang Dan Meng Jun Wang Jinghua Tan 68 80 0 05 Mar 2024
RIFF: Learning to Rephrase Inputs for Few-shot Fine-tuning of Language Models Saeed Najafi Alona Fyshe 32 1 0 04 Mar 2024
One Prompt Word is Enough to Boost Adversarial Robustness for Pre-trained Vision-Language Models Lin Li Haoyan Guan Jianing Qiu Michael W. Spratling AAML VLM VPVLM 31 21 0 04 Mar 2024
AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks Jiacen Xu Jack W. Stokes Geoff McDonald Xuesong Bai David Marshall Siyue Wang Adith Swaminathan Zhou Li 50 50 0 02 Mar 2024
Benchmarking zero-shot stance detection with FlanT5-XXL: Insights from training data, prompting, and decoding strategies into its near-SoTA performance Rachith Aiyappa Shruthi Senthilmani Jisun An Haewoon Kwak Yong-Yeol Ahn 29 3 0 01 Mar 2024
Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook Xingchen Zou Yibo Yan Xixuan Hao Yuehong Hu Haomin Wen ... Junbo Zhang Yong Li Tianrui Li Yu Zheng Keli Zhang HAI AI4TS 49 37 0 29 Feb 2024
SEED: Customize Large Language Models with Sample-Efficient Adaptation for Code Generation Xue Jiang Yihong Dong Zhi Jin Ge Li VLM 47 4 0 29 Feb 2024
Pointing out the Shortcomings of Relation Extraction Models with Semantically Motivated Adversarials Gennaro Nolano Moritz Blum Basil Ell Philipp Cimiano 35 1 0 29 Feb 2024
Global and Local Prompts Cooperation via Optimal Transport for Federated Learning Hongxia Li Wei Huang Jingya Wang Ye-ling Shi FedML VLM 41 19 0 29 Feb 2024
ICE-SEARCH: A Language Model-Driven Feature Selection Approach T. Yang Tim Tianyi Yang Fuyuan Lyu Shaoshan Liu Xue Xue Liu 36 4 0 28 Feb 2024
Content-Centric Prototyping of Generative AI Applications: Emerging Approaches and Challenges in Collaborative Software Teams Hari Subramonyam Divy Thakkar Jurgen Dieber Anoop Sinha 53 1 0 27 Feb 2024
Linguistic Knowledge Can Enhance Encoder-Decoder Models (If You Let It) Alessio Miaschi F. Dell’Orletta Giulia Venturi 55 0 0 27 Feb 2024
FaultProfIT: Hierarchical Fault Profiling of Incident Tickets in Large-scale Cloud Systems Junjie Huang Jinyang Liu Zhuangbin Chen Zhihan Jiang Yichen Li Jiazhen Gu Cong Feng Zengyin Yang Yongqiang Yang Michael R. Lyu 35 8 0 27 Feb 2024
FedLPPA: Learning Personalized Prompt and Aggregation for Federated Weakly-supervised Medical Image Segmentation Li Lin Yixiang Liu Jiewei Wu Pujin Cheng Zhiyuan Cai Kenneth K. Y. Wong Xiaoying Tang FedML 37 6 0 27 Feb 2024
A Piece of Theatre: Investigating How Teachers Design LLM Chatbots to Assist Adolescent Cyberbullying Education Michael A. Hedderich Natalie N. Bazarova Wenting Zou Ryun Shim Xinda Ma Qian Yang 22 23 0 27 Feb 2024
Chain-of-Thought Prompting of Large Language Models for Discovering and Fixing Software Vulnerabilities Yu Nong Mohammed Aldeen Long Cheng Hongxin Hu Feng Chen Haipeng Cai LRM 26 27 0 27 Feb 2024
Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models Yixin Liu Kai Zhang Yuan Li Zhiling Yan Chujie Gao ... Yue Huang Hanchi Sun Jianfeng Gao Lifang He Lichao Sun VLM VGen EGVM 75 260 0 27 Feb 2024
Deconstructing the Veneer of Simplicity: Co-Designing Introductory Generative AI Workshops with Local Entrepreneurs Yasmine Kotturi Angel Anderson Glenn Ford Michael Skirpan Jeffrey P. Bigham 34 8 0 26 Feb 2024
Dealing with Data for RE: Mitigating Challenges while using NLP and Generative AI S. Ghaisas Anmol Singhal 27 0 0 26 Feb 2024
MemoryPrompt: A Light Wrapper to Improve Context Tracking in Pre-trained Language Models Nathanaël Carraz Rakotonirina Marco Baroni VLM KELM 27 0 0 23 Feb 2024
In-Context Learning of a Linear Transformer Block: Benefits of the MLP Component and One-Step GD Initialization Ruiqi Zhang Jingfeng Wu Peter L. Bartlett 44 12 0 22 Feb 2024
NLAS-multi: A Multilingual Corpus of Automatically Generated Natural Language Argumentation Schemes Ramon Ruiz-Dolz Joaquín Taverner John Lawrence Chris Reed 46 7 0 22 Feb 2024
Multi-modal Stance Detection: New Datasets and Model Bin Liang Ang Li Jingqian Zhao Lin Gui Min Yang Yue Yu Kam-Fai Wong Ruifeng Xu 42 5 0 22 Feb 2024
FLAME: Self-Supervised Low-Resource Taxonomy Expansion using Large Language Models Sahil Mishra Ujjwal Sudev Tanmoy Chakraborty 19 2 0 21 Feb 2024
Wisdom of Committee: Distilling from Foundation Model to Specialized Application Model Zichang Liu Qingyun Liu Yuening Li Liang Liu Anshumali Shrivastava Shuchao Bi Lichan Hong Ed H. Chi Zhe Zhao VLM 44 4 0 21 Feb 2024
CLIPping the Deception: Adapting Vision-Language Models for Universal Deepfake Detection Sohail Ahmed Khan Duc-Tien Dang-Nguyen VLM 35 22 0 20 Feb 2024
PRECISE Framework: GPT-based Text For Improved Readability, Reliability, and Understandability of Radiology Reports For Patient-Centered Care Satvik Tripathi Liam Mutter Meghana C Muppuri Suhani Dheer Emiliano Garza-Frias ... Aakash Jha M. Dezube A. Tabari Christopher P. Bridge Dania Daye LM&MA 21 0 0 20 Feb 2024
UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction Yuan Yuan Jingtao Ding J. Feng Depeng Jin Yong Li AI4TS 29 51 0 19 Feb 2024
Where It Really Matters: Few-Shot Environmental Conservation Media Monitoring for Low-Resource Languages Sameer Jain Sedrick Scott Keh Shova Chettri Karun Dewan Pablo R. Izquierdo ... Pooja Shreshtha Cesar Suarez Zheyuan Ryan Shi Lei Li Fei Fang 40 0 0 19 Feb 2024
Uncovering Latent Human Wellbeing in Language Model Embeddings Pedro Freire ChengCheng Tan Adam Gleave Dan Hendrycks Scott Emmons 36 1 0 19 Feb 2024
In-Context Learning Demonstration Selection via Influence Analysis Vinay M.S. Minh-Hao Van Xintao Wu 37 4 0 19 Feb 2024
An Empirical Categorization of Prompting Techniques for Large Language Models: A Practitioner's Guide Oluwole Fagbohun Rachel M. Harrison Anton Dereventsov 52 6 0 18 Feb 2024
Ain't Misbehavin' -- Using LLMs to Generate Expressive Robot Behavior in Conversations with the Tabletop Robot Haru Zining Wang Paul Reisert Eric Nichols Randy Gomez 12 5 0 18 Feb 2024