Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
Forward-Backward Reasoning in Large Language Models for Mathematical Verification Weisen Jiang Han Shi L. Yu Zheng Liu Yu Zhang Zhenguo Li James T. Kwok LRM 132 31 0 15 Aug 2023
Interpretable Online Log Analysis Using Large Language Models with Prompt Strategies Yilun Liu Shimin Tao Weibin Meng Jingyu Wang Wenbing Ma Yanqing Zhao Yuhang Chen Hao Yang Yanfei Jiang Xun Chen 79 30 0 15 Aug 2023
The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation Patrick Fernandes Daniel Deutsch M. Finkelstein Parker Riley André F. T. Martins Graham Neubig Ankush Garg J. Clark Markus Freitag Orhan Firat LRM 108 72 0 14 Aug 2023
Position: Key Claims in LLM Research Have a Long Tail of Footnotes Anna Rogers A. Luccioni 162 21 0 14 Aug 2023
Large Language Models for Information Retrieval: A Survey Yutao Zhu Huaying Yuan Shuting Wang Jiongnan Liu Wenhan Liu Chenlong Deng Haonan Chen Zhicheng Dou Ji-Rong Wen KELM 183 317 0 14 Aug 2023
ICPC: Instance-Conditioned Prompting with Contrastive Learning for Semantic Segmentation Chaohui Yu Qiang-feng Zhou Zhibin Wang Fan Wang VLM 30 1 0 14 Aug 2023
Approximating Human-Like Few-shot Learning with GPT-based Compression C.-Y. Huang Yuqing Xie Zhiying Jiang Jimmy J. Lin Ming Li 63 9 0 14 Aug 2023
FoodSAM: Any Food Segmentation Xing Lan Jiayi Lyu Han Jiang Kunkun Dong Zehai Niu Yi Zhang Jian Xue VLM 92 28 0 11 Aug 2023
You Only Prompt Once: On the Capabilities of Prompt Learning on Large Language Models to Tackle Toxic Content Xinlei He Savvas Zannettou Yun Shen Yang Zhang CLL 53 43 0 10 Aug 2023
C5: Towards Better Conversation Comprehension and Contextual Continuity for ChatGPT Pan Liang Danwei Ye Zihao Zhu Yunchao Wang Wang Xia Ronghua Liang Guodao Sun 67 4 0 10 Aug 2023
Metacognitive Prompting Improves Understanding in Large Language Models Yuqing Wang Yun Zhao ReLM LRM 95 34 0 10 Aug 2023
An Empirical Study on Using Large Language Models to Analyze Software Supply Chain Security Failures Tanmay Singla Dharun Anandayuvaraj Kelechi G. Kalu Taylor R. Schorlemmer James C. Davis 133 14 0 09 Aug 2023
SLPT: Selective Labeling Meets Prompt Tuning on Label-Limited Lesion Segmentation Fan Bai K. Yan Xiaoyu Bai Xinyu Mao Xiaoli Yin Jingren Zhou Yu Shi Le Lu Max Q.-H. Meng VLM 56 2 0 09 Aug 2023
Fuzz4All: Universal Fuzzing with Large Language Models Chun Xia Matteo Paltenghi Jia Le Tian Michael Pradel Lingming Zhang ELM 94 135 0 09 Aug 2023
Adapting Foundation Models for Information Synthesis of Wireless Communication Specifications Manikanta Kotaru 134 10 0 08 Aug 2023
Revisiting Prompt Engineering via Declarative Crowdsourcing Aditya G. Parameswaran Shreya Shankar Parth Asawa Naman Jain Yujie Wang 84 21 0 07 Aug 2023
"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models Xinyue Shen Zhenpeng Chen Michael Backes Yun Shen Yang Zhang SILM 165 302 0 07 Aug 2023
From Ambiguity to Explicitness: NLP-Assisted 5G Specification Abstraction for Formal Analysis Shiyu Yuan Jing-Bing Yang Sudhanshu Arya Carlo Lipizzi Ying Wang 70 4 0 07 Aug 2023
PromptSum: Parameter-Efficient Controllable Abstractive Summarization Mathieu Ravaut Hailin Chen Ruochen Zhao Chengwei Qin Shafiq Joty Nancy Chen 54 2 0 06 Aug 2023
LARCH: Large Language Model-based Automatic Readme Creation with Heuristics Yuta Koreeda Terufumi Morishita Osamu Imaichi Yasuhiro Sogawa VLM 63 3 0 06 Aug 2023
System-Initiated Transitions from Chit-Chat to Task-Oriented Dialogues with Transition Info Extractor and Transition Sentence Generator Ye Liu Stefan Ultes Wolfgang Minker Wolfgang Maier 86 4 0 06 Aug 2023
Prompt2Gaussia: Uncertain Prompt-learning for Script Event Prediction Shiyao Cui Xin Cong Shuaiyi Nie Xuebin Wang Tingwen Liu Jinqiao Shi 55 0 0 04 Aug 2023
Reasoning in Large Language Models Through Symbolic Math Word Problems Vedant Gaur Nikunj Saunshi ReLM LRM 88 27 0 03 Aug 2023
ChatMOF: An Autonomous AI System for Predicting and Generating Metal-Organic Frameworks Y. Kang Jihan Kim AI4CE LLMAG 91 13 0 01 Aug 2023
Generative Models as a Complex Systems Science: How can we make sense of large language model behavior? Ari Holtzman Peter West Luke Zettlemoyer AI4CE 94 15 0 31 Jul 2023
Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment Saizhuo Wang Hang Yuan Leon Zhou L. Ni H. Shum Jian Guo 67 25 0 31 Jul 2023
On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook Mingyuan Fan Chengyu Wang Cen Chen Yang Liu Jun Huang HILM 96 3 0 31 Jul 2023
LLMs4OL: Large Language Models for Ontology Learning Hamed Babaei Giglou Jennifer D'Souza Sören Auer 73 79 0 31 Jul 2023
Scaling Sentence Embeddings with Large Language Models Ting Jiang Shaohan Huang Zhongzhi Luan Deqing Wang Fuzhen Zhuang LRM 115 47 0 31 Jul 2023
Anatomy of an AI-powered malicious social botnet Kai-Cheng Yang Filippo Menczer DeLMO 84 74 0 30 Jul 2023
A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extraction Zefa Hu Ziyi Ni Jing Shi Shuang Xu Bo Xu MedIm 88 2 0 30 Jul 2023
Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support Zilin Ma Yiyang Mei Zhaoyuan Su LLMAG AI4MH 79 93 0 28 Jul 2023
Prompt Guided Transformer for Multi-Task Dense Prediction Yuxiang Lu Shalayiding Sirejiding Yue Ding Chunlin Wang Hongtao Lu 104 20 0 28 Jul 2023
CliniDigest: A Case Study in Large Language Model Based Large-Scale Summarization of Clinical Trial Descriptions Renee D. White Tristan Peng Pann Sripitak Alexander Rosenberg Johansen M. Snyder LM&MA ELM 43 17 0 26 Jul 2023
Controllable Generation of Dialogue Acts for Dialogue Systems via Few-Shot Response Generation and Ranking Angela Ramirez Karik Agarwal Juraj Juraska Utkarsh Garg M. Walker 78 6 0 26 Jul 2023
Evaluating the Ripple Effects of Knowledge Editing in Language Models Roi Cohen Eden Biran Ori Yoran Amir Globerson Mor Geva KELM 105 180 0 24 Jul 2023
Tachikuma: Understading Complex Interactions with Multi-Character and Novel Objects by Large Language Models Yuanzhi Liang Linchao Zhu Yezhou Yang LLMAG 58 4 0 24 Jul 2023
LAMP: Leveraging Language Prompts for Multi-person Pose Estimation Shengnan Hu Ce Zheng Zixiang Zhou Chong Chen G. Sukthankar 86 3 0 21 Jul 2023
Selective Perception: Optimizing State Descriptions with Reinforcement Learning for Language Model Actors Kolby Nottingham Yasaman Razeghi Kyungmin Kim JB Lanier Pierre Baldi Roy Fox Sameer Singh 92 10 0 21 Jul 2023
Enhancing CLIP with GPT-4: Harnessing Visual Descriptions as Prompts Mayug Maniparambil Chris Vorster D. Molloy N. Murphy Kevin McGuinness Noel E. O'Connor CLIP VLM MLLM 106 54 0 21 Jul 2023
Robust Visual Question Answering: Datasets, Methods, and Future Challenges Jie Ma Pinghui Wang Dechen Kong Zewei Wang Jun Liu Hongbin Pei Junzhou Zhao OOD 126 23 0 21 Jul 2023
Making Pre-trained Language Models both Task-solvers and Self-calibrators Yangyi Chen Xingyao Wang Heng Ji 54 0 0 21 Jul 2023
Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification Neel Guha Mayee F. Chen Kush S. Bhatia Azalia Mirhoseini Frederic Sala Christopher Ré 78 4 0 20 Jul 2023
FinGPT: Democratizing Internet-scale Data for Financial Large Language Models Xiao-Yang Liu Guoxuan Wang Hongyang Yang Daochen Zha AIFin 116 50 0 19 Jul 2023
Integrating a Heterogeneous Graph with Entity-aware Self-attention using Relative Position Labels for Reading Comprehension Model Shima Foolad Kourosh Kiani 56 1 0 19 Jul 2023
DAPrompt: Deterministic Assumption Prompt Learning for Event Causality Identification Wei Xiang Chuanhong Zhan Bang Wang 43 2 0 19 Jul 2023
Revisiting the Robustness of the Minimum Error Entropy Criterion: A Transfer Learning Case Study Luis P. Silvestrin Shujian Yu Mark Hoogendoorn OOD 114 1 0 17 Jul 2023
Legal Syllogism Prompting: Teaching Large Language Models for Legal Judgment Prediction Cong Jiang Xiaolei Yang ELM LRM AILaw 115 46 0 17 Jul 2023
SINC: Self-Supervised In-Context Learning for Vision-Language Tasks Yi-Syuan Chen Yun-Zhu Song Cheng Yu Yeo Bei Liu Jianlong Fu Hong-Han Shuai VLM LRM 92 4 0 15 Jul 2023
Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text Zhun Yang Adam Ishay Joohyung Lee LRM ELM 84 59 0 15 Jul 2023