Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,811 papers shown

Title
Knowledge Graph Prompting for Multi-Document Question Answering Yu-Chiang Frank Wang Nedim Lipka Ryan A. Rossi Alexa F. Siu Ruiyi Zhang Tyler Derr RALM 34 114 0 22 Aug 2023
MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation Jinpeng Wang Ziyun Zeng Yunxiao Wang Yuting Wang Xingyu Lu Tianxiang Li Jun Yuan Rui Zhang Haitao Zheng Shutao Xia 44 43 0 22 Aug 2023
Large Language Models for Software Engineering: A Systematic Literature Review Xinying Hou Yanjie Zhao Yue Liu Zhou Yang Kailong Wang Li Li Xiapu Luo David Lo John C. Grundy Haoyu Wang 39 332 0 21 Aug 2023
Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models Martin Weyssow Xin Zhou Kisub Kim David Lo H. Sahraoui 45 27 0 21 Aug 2023
When Prompt-based Incremental Learning Does Not Meet Strong Pretraining Yuyao Tang Yifan Peng Weiwen Zheng CLL VLM 33 32 0 21 Aug 2023
ExpeL: LLM Agents Are Experiential Learners Andrew Zhao Daniel Huang Quentin Xu Matthieu Lin Yong-Jin Liu Gao Huang LLMAG 27 196 0 20 Aug 2023
The Snowflake Hypothesis: Training Deep GNN with One Node One Receptive field Kun Wang Guohao Li Shilong Wang Guibin Zhang Kaidi Wang Yang You Xiaojiang Peng Keli Zhang Yang Wang 42 8 0 19 Aug 2023
Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training Xiaoyang Wu Zhuotao Tian Xin Wen Bohao Peng Xihui Liu Kaicheng Yu Hengshuang Zhao 31 46 0 18 Aug 2023
ChatHaruhi: Reviving Anime Character in Reality via Large Language Model Cheng Li Ziang Leng Chenxi Yan Junyi Shen Hao Wang ... HaoSheng Wang Linkang Zhan Yaokai Jia Pingyu Wu Haozhen Sun 28 33 0 18 Aug 2023
ChatGPT-HealthPrompt. Harnessing the Power of XAI in Prompt-Based Healthcare Decision Support using ChatGPT Fatemeh Nazary Yashar Deldjoo Tommaso Di Noia LM&MA AI4MH 46 15 0 17 Aug 2023
MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models Yilin Wen Zifeng Wang Jimeng Sun ReLM 49 67 0 17 Aug 2023
Event-Guided Procedure Planning from Instructional Videos with Text Supervision Ante Wang Kun-Li Channing Lin Jiachen Du Jingke Meng Wei-Shi Zheng 27 15 0 17 Aug 2023
Tem-adapter: Adapting Image-Text Pretraining for Video Question Answer Guangyi Chen Xiao Liu Guangrun Wang Kun Zhang Philip H.S.Torr Xiaoping Zhang Yansong Tang 27 18 0 16 Aug 2023
Challenges and Opportunities of Using Transformer-Based Multi-Task Learning in NLP Through ML Lifecycle: A Survey Lovre Torbarina Tin Ferkovic Lukasz Roguski Velimir Mihelčić Bruno Šarlija Z. Kraljevic 31 5 0 16 Aug 2023
Forward-Backward Reasoning in Large Language Models for Mathematical Verification Weisen Jiang Han Shi L. Yu Zheng Liu Yu Zhang Zhenguo Li James T. Kwok LRM 48 26 0 15 Aug 2023
Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies Yilun Liu Shimin Tao Weibin Meng Jingyu Wang Wenbing Ma Yanqing Zhao Yuhang Chen Hao Yang Yanfei Jiang Xun Chen 48 25 0 15 Aug 2023
The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation Patrick Fernandes Daniel Deutsch M. Finkelstein Parker Riley André F. T. Martins Graham Neubig Ankush Garg J. Clark Markus Freitag Orhan Firat LRM 41 69 0 14 Aug 2023
Position: Key Claims in LLM Research Have a Long Tail of Footnotes Anna Rogers A. Luccioni 60 19 0 14 Aug 2023
Large Language Models for Information Retrieval: A Survey Yutao Zhu Huaying Yuan Shuting Wang Jiongnan Liu Wenhan Liu Chenlong Deng Haonan Chen Zhicheng Dou Ji-Rong Wen KELM 57 290 0 14 Aug 2023
ICPC: Instance-Conditioned Prompting with Contrastive Learning for Semantic Segmentation Chaohui Yu Qiang-feng Zhou Zhibin Wang Fan Wang VLM 30 1 0 14 Aug 2023
Approximating Human-Like Few-shot Learning with GPT-based Compression C.-Y. Huang Yuqing Xie Zhiying Jiang Jimmy J. Lin Ming Li 35 9 0 14 Aug 2023
FoodSAM: Any Food Segmentation Xing Lan Jiayi Lyu Han Jiang Kunkun Dong Zehai Niu Yi Zhang Jian Xue VLM 31 25 0 11 Aug 2023
You Only Prompt Once: On the Capabilities of Prompt Learning on Large Language Models to Tackle Toxic Content Xinlei He Savvas Zannettou Yun Shen Yang Zhang CLL 29 37 0 10 Aug 2023
C5: Towards Better Conversation Comprehension and Contextual Continuity for ChatGPT Pan Liang Danwei Ye Zihao Zhu Yunchao Wang Wang Xia Ronghua Liang Guodao Sun 31 3 0 10 Aug 2023
Metacognitive Prompting Improves Understanding in Large Language Models Yuqing Wang Yun Zhao ReLM LRM 44 26 0 10 Aug 2023
An Empirical Study on Using Large Language Models to Analyze Software Supply Chain Security Failures Tanmay Singla Dharun Anandayuvaraj Kelechi G. Kalu Taylor R. Schorlemmer James C. Davis 26 13 0 09 Aug 2023
SLPT: Selective Labeling Meets Prompt Tuning on Label-Limited Lesion Segmentation Fan Bai K. Yan Xiaoyu Bai Xinyu Mao Xiaoli Yin Jingren Zhou Yu Shi Le Lu Max Q.-H. Meng VLM 25 2 0 09 Aug 2023
Fuzz4All: Universal Fuzzing with Large Language Models Chun Xia Matteo Paltenghi Jia Le Tian Michael Pradel Lingming Zhang ELM 18 104 0 09 Aug 2023
Adapting Foundation Models for Information Synthesis of Wireless Communication Specifications Manikanta Kotaru 90 9 0 08 Aug 2023
Revisiting Prompt Engineering via Declarative Crowdsourcing Aditya G. Parameswaran Shreya Shankar Parth Asawa Naman Jain Yujie Wang 41 21 0 07 Aug 2023
"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models Xinyue Shen Zhenpeng Chen Michael Backes Yun Shen Yang Zhang SILM 45 250 0 07 Aug 2023
From Ambiguity to Explicitness: NLP-Assisted 5G Specification Abstraction for Formal Analysis Shiyu Yuan Jing-Bing Yang Sudhanshu Arya Carlo Lipizzi Ying Wang 33 4 0 07 Aug 2023
PromptSum: Parameter-Efficient Controllable Abstractive Summarization Mathieu Ravaut Hailin Chen Ruochen Zhao Chengwei Qin Shafiq Joty Nancy Chen 34 2 0 06 Aug 2023
LARCH: Large Language Model-based Automatic Readme Creation with Heuristics Yuta Koreeda Terufumi Morishita Osamu Imaichi Yasuhiro Sogawa VLM 37 2 0 06 Aug 2023
System-Initiated Transitions from Chit-Chat to Task-Oriented Dialogues with Transition Info Extractor and Transition Sentence Generator Ye Liu Stefan Ultes Wolfgang Minker Wolfgang Maier 27 3 0 06 Aug 2023
Prompt2Gaussia: Uncertain Prompt-learning for Script Event Prediction Shiyao Cui Xin Cong Shuaiyi Nie Xuebin Wang Tingwen Liu Jinqiao Shi 22 0 0 04 Aug 2023
Reasoning in Large Language Models Through Symbolic Math Word Problems Vedant Gaur Nikunj Saunshi ReLM LRM 37 26 0 03 Aug 2023
ChatMOF: An Autonomous AI System for Predicting and Generating Metal-Organic Frameworks Y. Kang Jihan Kim AI4CE LLMAG 32 12 0 01 Aug 2023
Generative Models as a Complex Systems Science: How can we make sense of large language model behavior? Ari Holtzman Peter West Luke Zettlemoyer AI4CE 50 14 0 31 Jul 2023
Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment Saizhuo Wang Hang Yuan Leon Zhou L. Ni H. Shum Jian Guo 39 20 0 31 Jul 2023
On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook Mingyuan Fan Chengyu Wang Cen Chen Yang Liu Jun Huang HILM 41 3 0 31 Jul 2023
LLMs4OL: Large Language Models for Ontology Learning Hamed Babaei Giglou Jennifer D'Souza Sören Auer 30 68 0 31 Jul 2023
Scaling Sentence Embeddings with Large Language Models Ting Jiang Shaohan Huang Zhongzhi Luan Deqing Wang Fuzhen Zhuang LRM 49 40 0 31 Jul 2023
Anatomy of an AI-powered malicious social botnet Kai-Cheng Yang Filippo Menczer DeLMO 43 67 0 30 Jul 2023
A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extraction Zefa Hu Ziyi Ni Jing Shi Shuang Xu Bo Xu MedIm 43 1 0 30 Jul 2023
Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support Zilin Ma Yiyang Mei Zhaoyuan Su LLMAG AI4MH 29 88 0 28 Jul 2023
Prompt Guided Transformer for Multi-Task Dense Prediction Yuxiang Lu Shalayiding Sirejiding Yue Ding Chunlin Wang Hongtao Lu 49 18 0 28 Jul 2023
CliniDigest: A Case Study in Large Language Model Based Large-Scale Summarization of Clinical Trial Descriptions Renee D. White Tristan Peng Pann Sripitak Alexander Rosenberg Johansen M. Snyder LM&MA ELM 36 16 0 26 Jul 2023
Controllable Generation of Dialogue Acts for Dialogue Systems via Few-Shot Response Generation and Ranking Angela Ramirez Karik Agarwal Juraj Juraska Utkarsh Garg M. Walker 42 5 0 26 Jul 2023
Evaluating the Ripple Effects of Knowledge Editing in Language Models Roi Cohen Eden Biran Ori Yoran Amir Globerson Mor Geva KELM 42 157 0 24 Jul 2023