Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
Fine-tuned vs. Prompt-tuned Supervised Representations: Which Better Account for Brain Language Representations? Jingyuan Sun Marie-Francine Moens AAML 72 13 0 03 Oct 2023
LoFT: Local Proxy Fine-tuning For Improving Transferability Of Adversarial Attacks Against Large Language Model Muhammad Ahmed Shah Roshan S. Sharma Hira Dhamyal R. Olivier Ankit Shah ... Massa Baali Soham Deshmukh Michael Kuhlmann Bhiksha Raj Rita Singh AAML 67 21 0 02 Oct 2023
Co-audit: tools to help humans double-check AI-generated content Andrew D. Gordon Carina Negreanu J. Cambronero Rasika Chakravarthy Ian Drosos ... Hannah Richardson Advait Sarkar Stephanie Simmons Jack Williams Ben Zorn 88 14 0 02 Oct 2023
GraphText: Graph Reasoning in Text Space Jianan Zhao Le Zhuo Yikang Shen Meng Qu Kai Liu Michael M. Bronstein Zhaocheng Zhu Jian Tang 194 80 0 02 Oct 2023
Resolving Knowledge Conflicts in Large Language Models Yike Wang Shangbin Feng Heng Wang Weijia Shi Vidhisha Balachandran Tianxing He Yulia Tsvetkov 108 20 0 02 Oct 2023
Use Your INSTINCT: INSTruction optimization for LLMs usIng Neural bandits Coupled with Transformers Xiaoqiang Lin Zhaoxuan Wu Zhongxiang Dai Wenyang Hu Yao Shu See-Kiong Ng Patrick Jaillet Bryan Kian Hsiang Low 99 11 0 02 Oct 2023
Knowledge Engineering using Large Language Models Bradley Paul Allen Lise Stork Paul T. Groth 91 25 0 01 Oct 2023
UPAR: A Kantian-Inspired Prompting Framework for Enhancing Large Language Model Capabilities Hejia Geng Boxun Xu Peng Li ELM LRM ReLM 69 1 0 30 Sep 2023
NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation Minh-Tuan Tran Trung Le Xuan-May Le Mehrtash Harandi Quan Hung Tran Dinh Q. Phung 84 13 0 30 Sep 2023
One for All: Towards Training One Graph Model for All Classification Tasks Hao Liu Jiarui Feng Lecheng Kong Ningyue Liang Dacheng Tao Yixin Chen Muhan Zhang AI4CE 109 132 0 29 Sep 2023
Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering Han Zhou Xingchen Wan Lev Proleev Diana Mincu Jilin Chen Katherine A. Heller Subhrajit Roy UQLM 87 61 0 29 Sep 2023
Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection Jiaying Wu Xinyu Chen Haobin Yang Qi Zhao Yuhui Shi AAML 85 12 0 28 Sep 2023
A Comprehensive Survey of Document-level Relation Extraction (2016-2023) Lea Demelius Hanh Thi Hong Tran Roman Kern Georgeta Bordea Andreas Trügler Antoine Doucet 75 3 0 28 Sep 2023
ModuLoRA: Finetuning 2-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers Junjie Yin Jiahao Dong Yingheng Wang Christopher De Sa Volodymyr Kuleshov MQ 68 6 0 28 Sep 2023
Enabling Resource-efficient AIoT System with Cross-level Optimization: A survey Sicong Liu Bin Guo Cheng Fang Ziqi Wang Shiyan Luo Zimu Zhou Zhiwen Yu AI4CE 97 23 0 27 Sep 2023
Graph Neural Prompting with Large Language Models Yijun Tian Huan Song Zichen Wang Haozhu Wang Ziqing Hu Fang Wang Nitesh Chawla Panpan Xu AI4CE 107 49 0 27 Sep 2023
VPA: Fully Test-Time Visual Prompt Adaptation Jiachen Sun Mark Ibrahim Melissa Hall Ivan Evtimov Z. Morley Mao Cristian Canton Ferrer C. Hazirbas VLM 94 7 0 26 Sep 2023
Exploring Small Language Models with Prompt-Learning Paradigm for Efficient Domain-Specific Text Classification Hengyu Luo Peng Liu Stefan Esping 64 4 0 26 Sep 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning Jiadong Wang Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 100 6 0 26 Sep 2023
KERMIT: Knowledge Graph Completion of Enhanced Relation Modeling with Inverse Transformation Haotian Li Lingzhi Wang Yuliang Wei Richard Y. D. Xu Bailing Wang Bailing Wang 129 3 0 26 Sep 2023
Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces Hariharan Subramonyam Roy Pea Christopher Pondoc Maneesh Agrawala Colleen M. Seifert 82 58 0 25 Sep 2023
Self-Recovery Prompting: Promptable General Purpose Service Robot System with Foundation Models and Self-Recovery Mimo Shirasaka T. Matsushima S. Tsunashima Yuya Ikeda Aoi Horo ... Chikaha Tsuji Hikaru Wada Tsunekazu Omija Dai Komukai Yusuke Iwasawa LRM 74 13 0 25 Sep 2023
Tuning Multi-mode Token-level Prompt Alignment across Modalities Dongsheng Wang Miaoge Li Xinyang Liu Mingsheng Xu Bo Chen Hanwang Zhang VLM 108 19 0 25 Sep 2023
TouchUp-G: Improving Feature Representation through Graph-Centric Finetuning Jing Zhu Xiang Song V. Ioannidis Danai Koutra Christos Faloutsos 178 15 0 25 Sep 2023
EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria Tae Soo Kim Yoonjoo Lee Jamin Shin Young-Ho Kim Juho Kim 103 72 0 24 Sep 2023
GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graph Xin Li Dongze Lian Zhihe Lu Jiawang Bai Zhibo Chen Xinchao Wang VLM 108 66 0 24 Sep 2023
Natural Language based Context Modeling and Reasoning for Ubiquitous Computing with Large Language Models: A Tutorial Haoyi Xiong Jiang Bian Sijia Yang Xiaofei Zhang Linghe Kong Daqing Zhang LRM LLMAG 107 5 0 24 Sep 2023
Defending Pre-trained Language Models as Few-shot Learners against Backdoor Attacks Zhaohan Xi Tianyu Du Changjiang Li Ren Pang S. Ji Jinghui Chen Fenglong Ma Ting Wang AAML 70 34 0 23 Sep 2023
Frustrated with Code Quality Issues? LLMs can Help! Nalin Wadhwa Jui Pradhan Atharv Sonwane Surya Prakash Sahu Nagarajan Natarajan Aditya Kanade Suresh Parthasarathy S. Rajamani 78 6 0 22 Sep 2023
Transformer-based Image Compression with Variable Image Quality Objectives Chia-Hao Kao Yi-Hsin Chen Cheng Chien Wei-Chen Chiu Wen-Hsiao Peng 65 2 0 22 Sep 2023
HRoT: Hybrid prompt strategy and Retrieval of Thought for Table-Text Hybrid Question Answering Tongxu Luo Fangyu Lei Jiahe Lei Weihao Liu Shihu He Jun Zhao Kang Liu 49 3 0 22 Sep 2023
Construction contract risk identification based on knowledge-augmented language model Saika Wong Chunmo Zheng Xing Su Yinqiu Tang 56 17 0 22 Sep 2023
Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writers Tuhin Chakrabarty Vishakh Padmakumar Faeze Brahman Smaranda Muresan 132 41 0 22 Sep 2023
Foundation Metrics for Evaluating Effectiveness of Healthcare Conversations Powered by Generative AI Mahyar Abbasian Elahe Khatibi Iman Azimi David Oniani Zahra Shakeri Hossein Abad ... Bryant Lin Olivier Gevaert Li-Jia Li Ramesh C. Jain Amir M. Rahmani LM&MA ELM AI4MH 139 78 0 21 Sep 2023
ChaCha: Leveraging Large Language Models to Prompt Children to Share Their Emotions about Personal Events Woosuk Seo Chanmo Yang Young-Ho Kim 104 46 0 21 Sep 2023
Towards Answering Health-related Questions from Medical Videos: Datasets and Approaches Deepak Gupta Kush Attal Dina Demner-Fushman LM&MA 54 1 0 21 Sep 2023
SLHCat: Mapping Wikipedia Categories and Lists to DBpedia by Leveraging Semantic, Lexical, and Hierarchical Features Zhaoyi Wang Zhenyang Zhang Jiaxin Qin M. Iwaihara 59 0 0 21 Sep 2023
LLM Guided Inductive Inference for Solving Compositional Problems Abhigya Sodani Lauren Moos Matthew Mirman LRM 98 1 0 20 Sep 2023
The Languini Kitchen: Enabling Language Modelling Research at Different Scales of Compute Aleksandar Stanić Dylan R. Ashley Oleg Serikov Louis Kirsch Francesco Faccio Jürgen Schmidhuber Thomas Hofmann Imanol Schlag MoE 91 9 0 20 Sep 2023
MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation Xinda Wu Zhijie Huang Kejun Zhang Jiaxing Yu Xu Tan Tieyao Zhang Zihao Wang Lingyun Sun 82 5 0 19 Sep 2023
Human-AI Interactions and Societal Pitfalls Francisco Castro Jian Gao Sébastien Martin 81 3 0 19 Sep 2023
PromptST: Prompt-Enhanced Spatio-Temporal Multi-Attribute Prediction Zijian Zhang Xiangyu Zhao Qidong Liu Chunxu Zhang Qian Ma Wanyu Wang Hongwei Zhao Yiqi Wang Zitao Liu AI4TS 140 21 0 18 Sep 2023
A Statistical Turing Test for Generative Models Hayden Helm Carey E. Priebe Weiwei Yang DeLMO 67 8 0 16 Sep 2023
Using Large Language Models for Knowledge Engineering (LLMKE): A Case Study on Wikidata Bohui Zhang Ioannis Reklos Nitisha Jain Albert Meroño-Peñuela Elena Simperl 73 9 0 15 Sep 2023
How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Study Andreas Waldis Yufang Hou Iryna Gurevych 70 4 0 15 Sep 2023
Self-Consistent Narrative Prompts on Abductive Natural Language Inference Chunkit Chan Xin Liu Tszho Chan Cheng Jiayang Yangqiu Song Ginny Wong Simon See LRM 70 8 0 15 Sep 2023
An Empirical Evaluation of Prompting Strategies for Large Language Models in Zero-Shot Clinical Natural Language Processing Sonish Sivarajkumar Mark Kelley Alyssa Samolyk-Mazzanti Shyam Visweswaran Yanshan Wang LM&MA 88 28 0 14 Sep 2023
Pop Quiz! Do Pre-trained Code Models Possess Knowledge of Correct API Names? Terry Yue Zhuo Xiaoning Du Zhenchang Xing Jiamou Sun Haowei Quan Li Li Liming Zhu 61 2 0 14 Sep 2023
Generative AI Stefan Feuerriegel Jochen Hartmann Christian Janiesch Patrick Zschech 121 658 0 13 Sep 2023
Prompting Segmentation with Sound Is Generalizable Audio-Visual Source Localizer Yaoting Wang Weisong Liu Guangyao Li Jian Ding Di Hu Xi Li VLM 93 21 0 13 Sep 2023