Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
Evolutionary Verbalizer Search for Prompt-based Few Shot Text Classification Tongtao Ling Lei Chen Yutao Lai Haiyan Liu VLM 55 4 0 18 Jun 2023
Parameter-efficient is not sufficient: Exploring Parameter, Memory, and Time Efficient Adapter Tuning for Dense Predictions Dongshuo Yin Xueting Han Bin Li Hao Feng Jinghua Bai VPVLM 78 19 0 16 Jun 2023
Clickbait Detection via Large Language Models H. Wang Yi Zhu Ye Wang Yun Li Yunhao Yuan Jipeng Qiang 112 3 0 16 Jun 2023
Investigating Prompting Techniques for Zero- and Few-Shot Visual Question Answering Rabiul Awal Le Zhang Aishwarya Agrawal LRM 149 13 0 16 Jun 2023
Tell Me Where to Go: A Composable Framework for Context-Aware Embodied Robot Navigation Harel Biggie Ajay Narasimha Mopidevi Dusty Woods Christoffer Heckman LM&Ro 67 11 0 15 Jun 2023
MetricPrompt: Prompting Model as a Relevance Metric for Few-shot Text Classification Hongyuan Dong Weinan Zhang Wanxiang Che VLM 64 3 0 15 Jun 2023
Efficient Backdoor Attacks for Deep Neural Networks in Real-world Scenarios Ziqiang Li Hong Sun Pengfei Xia Heng Li Beihao Xia Yi Wu Bin Li AAML 110 10 0 14 Jun 2023
Generate to Understand for Representation Changshan Xue Xiande Zhong Xiaoqing Liu VLM 102 0 0 14 Jun 2023
Waffling around for Performance: Visual Classification with Random Words and Broad Concepts Karsten Roth Jae Myung Kim A. Sophia Koepke Oriol Vinyals Cordelia Schmid Zeynep Akata VLM 95 76 0 12 Jun 2023
TrojLLM: A Black-box Trojan Prompt Attack on Large Language Models Jiaqi Xue Mengxin Zheng Ting Hua Yilin Shen Ye Liu Ladislau Bölöni Qian Lou 118 36 0 12 Jun 2023
Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive Question Answering Hai Ye Qizhe Xie Hwee Tou Ng 90 8 0 11 Jun 2023
Mimicking the Thinking Process for Emotion Recognition in Conversation with Prompts and Paraphrasing Tingyu Zhang Zhuang Chen Ming Zhong T. Qian 69 15 0 11 Jun 2023
Boosting Language Models Reasoning with Chain-of-Knowledge Prompting Jiadong Wang Qiushi Sun Xiang Li Ming Gao ReLM LRM 84 75 0 10 Jun 2023
Virtual Node Tuning for Few-shot Node Classification Zhen Tan Ruocheng Guo Kaize Ding Huan Liu 98 43 0 09 Jun 2023
Exploring the Responses of Large Language Models to Beginner Programmers' Help Requests Arto Hellas Juho Leinonen Sami Sarsa Charles Koutcheme Lilja Kujanpää Juha Sorva AI4Ed 69 114 0 09 Jun 2023
COVER: A Heuristic Greedy Adversarial Attack on Prompt-based Learning in Language Models Zihao Tan Qingliang Chen Wenbin Zhu Yongjian Huang AAML SILM 93 3 0 09 Jun 2023
Customizing General-Purpose Foundation Models for Medical Report Generation Bang-ju Yang Asif Raza Yuexian Zou Tong Zhang MedIm 87 11 0 09 Jun 2023
Artificial General Intelligence for Medical Imaging Xiang Li Lu Zhang Zihao Wu Zheng Liu Lin Zhao ... Pingkuan Yan Quanzheng Li Wen Liu Tianming Liu Dinggang Shen LM&MA AI4CE 144 42 0 08 Jun 2023
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memories Shizhe Diao Tianyang Xu Ruijia Xu Jiawei Wang Tong Zhang MoE AI4CE 55 41 0 08 Jun 2023
The ADAIO System at the BEA-2023 Shared Task on Generating AI Teacher Responses in Educational Dialogues Adaeze Adigwe Zheng Yuan ELM 52 5 0 08 Jun 2023
RE-Matching: A Fine-Grained Semantic Matching Method for Zero-Shot Relation Extraction Jun Zhao Wenyu Zhan Xin Zhao Qi Zhang Tao Gui Zhongyu Wei Junzhe Wang Minlong Peng Mingming Sun 84 24 0 08 Jun 2023
In-Context Learning through the Bayesian Prism Madhuri Panwar Kabir Ahuja Navin Goyal BDL 93 48 0 08 Jun 2023
Soft-prompt Tuning for Large Language Models to Evaluate Bias Jacob-Junqi Tian David B. Emerson Sevil Zanjani Miyandoab D. Pandya Laleh Seyyed-Kalantari Faiza Khan Khattak VLM 81 11 0 07 Jun 2023
PromptAttack: Probing Dialogue State Trackers with Adversarial Prompts Xiangjue Dong Yun He Ziwei Zhu James Caverlee AAML 64 7 0 07 Jun 2023
Enhancing In-Context Learning with Answer Feedback for Multi-Span Question Answering Zixian Huang Jiaying Zhou Gengyang Xiao Gong Cheng KELM 53 10 0 07 Jun 2023
Revisiting Conversation Discourse for Dialogue Disentanglement Bobo Li Hao Fei Fei Li Shengqiong Wu Lizi Liao Yin-wei Wei Tat-Seng Chua Donghong Ji 60 1 0 06 Jun 2023
CL-UZH at SemEval-2023 Task 10: Sexism Detection through Incremental Fine-Tuning and Multi-Task Learning with Label Descriptions Janis Goldzycher 60 1 0 06 Jun 2023
Deductive Verification of Chain-of-Thought Reasoning Z. Ling Yunhao Fang Xuanlin Li Zhiao Huang Mingu Lee Roland Memisevic Hao Su ReLM LRM 121 136 0 06 Jun 2023
Evaluating the Effectiveness of Natural Language Inference for Hate Speech Detection in Languages with Limited Labeled Data Janis Goldzycher Moritz Preisig Chantal Amrhein Gerold Schneider 66 3 0 06 Jun 2023
On the Role of Attention in Prompt-tuning Samet Oymak A. S. Rawat Mahdi Soltanolkotabi Christos Thrampoulidis MLT LRM 88 47 0 06 Jun 2023
InstructZero: Efficient Instruction Optimization for Black-Box Large Language Models Lichang Chen Jiuhai Chen Tom Goldstein Heng-Chiao Huang Dinesh Manocha 102 45 0 05 Jun 2023
Exploring and Verbalizing Academic Ideas by Concept Co-occurrence Yi Xu Shuqian Sheng Bo Xue Luoyi Fu Xinbing Wang Cheng Zhou 65 9 0 04 Jun 2023
SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts Haibin Wu Kai-Wei Chang Yuan-Kuei Wu Hung-yi Lee 128 23 0 03 Jun 2023
Unsupervised Human Activity Recognition through Two-stage Prompting with ChatGPT Qingxin Xia T. Maekawa Takahiro Hara 39 11 0 03 Jun 2023
Utilizing ChatGPT to Enhance Clinical Trial Enrollment Georgios Peikos S. Symeonidis Pranav Kasela G. Pasi LM&MA 52 13 0 03 Jun 2023
Probabilistic Adaptation of Text-to-Video Models Mengjiao Yang Yilun Du Bo Dai Dale Schuurmans J. Tenenbaum Pieter Abbeel VGen DiffM 137 26 0 02 Jun 2023
Log Parsing: How Far Can ChatGPT Go? Van-Hoang Le Hongyu Zhang 67 38 0 02 Jun 2023
Prompt Tuning Large Language Models on Personalized Aspect Extraction for Recommendations Pan Li Yuyan Wang Ed H. Chi Minmin Chen 90 14 0 02 Jun 2023
DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection Rui Shao Tianxing Wu Liqiang Nie Ziwei Liu 78 14 0 01 Jun 2023
Interpretable Math Word Problem Solution Generation Via Step-by-step Planning Mengxue Zhang Zichao Wang Zhichao Yang Weiqi Feng Andrew Lan LRM 69 18 0 01 Jun 2023
Exploring EFL students' prompt engineering in human-AI story writing: an Activity Theory perspective David James Woo Kai Guo Hengky Susanto 59 10 0 01 Jun 2023
Applying language models to algebraic topology: generating simplicial cycles using multi-labeling in Wu's formula Kirill Brilliantov Fedor Pavutnitskiy D. Pasechnyuk German Magai 69 0 0 01 Jun 2023
Adapting Pre-trained Language Models to Vision-Language Tasks via Dynamic Visual Prompting Shubin Huang Qiong Wu Yiyi Zhou Weijie Chen Rongsheng Zhang Xiaoshuai Sun Rongrong Ji VLM VPVLM LRM 45 0 0 01 Jun 2023
Preference-grounded Token-level Guidance for Language Model Fine-tuning Shentao Yang Shujian Zhang Congying Xia Yihao Feng Caiming Xiong Mi Zhou 146 28 0 01 Jun 2023
Prompt Algebra for Task Composition Pramuditha Perera Matthew Trager Luca Zancato Alessandro Achille Stefano Soatto VLM 77 8 0 01 Jun 2023
Cooperative Hardware-Prompt Learning for Snapshot Compressive Imaging Jiamian Wang Zong-Jhe Wu Yulun Zhang Xin Yuan Tao R. Lin Zhiqiang Tao FedML 154 4 0 01 Jun 2023
MuseCoco: Generating Symbolic Music from Text Peiling Lu Xin Xu C. Kang Botao Yu Chengyi Xing Xuejiao Tan Jiang Bian 105 44 0 31 May 2023
Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learning Xiaoxin He Xavier Bresson T. Laurent Adam Perold Yann LeCun Bryan Hooi 142 86 0 31 May 2023
Learning Task-preferred Inference Routes for Gradient De-conflict in Multi-output DNNs Yi Sun Xin Xu Jiaqiang Li Xiaochang Hu Yifei Shi L. Zeng 221 2 0 31 May 2023
ScoNe: Benchmarking Negation Reasoning in Language Models With Fine-Tuning and In-Context Learning Jingyuan Selena She Christopher Potts Sam Bowman Atticus Geiger 94 15 0 30 May 2023