Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,811 papers shown

Title
Thought Propagation: An Analogical Approach to Complex Reasoning with Large Language Models Junchi Yu Ran He Rex Ying LRM 63 26 0 06 Oct 2023
Understanding prompt engineering may not require rethinking generalization Victor Akinwande Yiding Jiang Dylan Sam J. Zico Kolter VLM VPVLM 123 7 0 06 Oct 2023
DirectGPT: A Direct Manipulation Interface to Interact with Large Language Models Damien Masson Sylvain Malacria Géry Casiez Daniel Vogel AI4CE KELM MLLM 36 34 0 05 Oct 2023
Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Language Jingyuan Sun Xiaohan Zhang Marie-Francine Moens 51 4 0 05 Oct 2023
Fine-tune Language Models to Approximate Unbiased In-context Learning Timothy Chu Zhao Song Chiwun Yang 41 15 0 05 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models Zihao Lin Yan Sun Yifan Shi Xueqian Wang Lifu Huang Li Shen Dacheng Tao 49 11 0 04 Oct 2023
Discovering Knowledge-Critical Subnetworks in Pretrained Language Models Deniz Bayazit Negar Foroutan Zeming Chen Gail Weiss Antoine Bosselut KELM 32 14 0 04 Oct 2023
Prompting and Adapter Tuning for Self-supervised Encoder-Decoder Speech Model Kai-Wei Chang Ming-Hsin Chen Yun-Ping Lin Jing Neng Hsu Paul Kuo-Ming Huang Chien-yu Huang Shang-Wen Li Hung-yi Lee 25 6 0 04 Oct 2023
On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study Liben Chen Long Chen Tian Ellison-Chen Zhuoyuan Xu LRM 27 0 0 04 Oct 2023
Prompting-based Temporal Domain Generalization Sepidehsadat Hosseini Mengyao Zhai Hossein Hajimirsadegh Frederick Tung AI4TS AI4CE OOD 30 0 0 03 Oct 2023
Automated Bug Generation in the era of Large Language Models Reyhaneh Jabbarvand Yang Chen Ryan Rong Reyhaneh Jabbarvand 35 3 0 03 Oct 2023
Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation Benjamin Steenhoek Michele Tufano Neel Sundaresan Alexey Svyatkovskiy OffRL ALM 60 18 0 03 Oct 2023
Ask Again, Then Fail: Large Language Models' Vacillations in Judgment Qiming Xie Zengzhi Wang Yi Feng Rui Xia AAML HILM 35 9 0 03 Oct 2023
Language Models as Knowledge Bases for Visual Word Sense Disambiguation Anastasia Kritharoula Maria Lymperaiou Giorgos Stamou 29 2 0 03 Oct 2023
Fine-tuned vs. Prompt-tuned Supervised Representations: Which Better Account for Brain Language Representations? Jingyuan Sun Marie-Francine Moens AAML 24 9 0 03 Oct 2023
LoFT: Local Proxy Fine-tuning For Improving Transferability Of Adversarial Attacks Against Large Language Model Muhammad Ahmed Shah Roshan S. Sharma Hira Dhamyal R. Olivier Ankit Shah ... Massa Baali Soham Deshmukh Michael Kuhlmann Bhiksha Raj Rita Singh AAML 30 19 0 02 Oct 2023
Co-audit: tools to help humans double-check AI-generated content Andrew D. Gordon Carina Negreanu J. Cambronero Rasika Chakravarthy Ian Drosos ... Hannah Richardson Advait Sarkar Stephanie Simmons Jack Williams Ben Zorn 46 13 0 02 Oct 2023
GraphText: Graph Reasoning in Text Space Jianan Zhao Le Zhuo Yikang Shen Meng Qu Kai Liu Michael M. Bronstein Zhaocheng Zhu Jian Tang 115 72 0 02 Oct 2023
Resolving Knowledge Conflicts in Large Language Models Yike Wang Shangbin Feng Heng Wang Weijia Shi Vidhisha Balachandran Tianxing He Yulia Tsvetkov 66 12 0 02 Oct 2023
Use Your INSTINCT: INSTruction optimization for LLMs usIng Neural bandits Coupled with Transformers Xiaoqiang Lin Zhaoxuan Wu Zhongxiang Dai Wenyang Hu Yao Shu See-Kiong Ng Patrick Jaillet Bryan Kian Hsiang Low 32 10 0 02 Oct 2023
Knowledge Engineering using Large Language Models Bradley Paul Allen Lise Stork Paul T. Groth 30 24 0 01 Oct 2023
UPAR: A Kantian-Inspired Prompting Framework for Enhancing Large Language Model Capabilities Hejia Geng Boxun Xu Peng Li ELM LRM ReLM 41 1 0 30 Sep 2023
NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation Minh-Tuan Tran Trung Le Xuan-May Le Mehrtash Harandi Quan Hung Tran Dinh Q. Phung 23 11 0 30 Sep 2023
One for All: Towards Training One Graph Model for All Classification Tasks Hao Liu Jiarui Feng Lecheng Kong Ningyue Liang Dacheng Tao Yixin Chen Muhan Zhang AI4CE 17 113 0 29 Sep 2023
Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering Han Zhou Xingchen Wan Lev Proleev Diana Mincu Jilin Chen Katherine A. Heller Subhrajit Roy UQLM 33 54 0 29 Sep 2023
Prompt-and-Align: Prompt-Based Social Alignment for Few-Shot Fake News Detection Jiaying Wu Xinyu Chen Haobin Yang Qi Zhao Yuhui Shi AAML 27 11 0 28 Sep 2023
A Comprehensive Survey of Document-level Relation Extraction (2016-2023) Lea Demelius Hanh Thi Hong Tran Roman Kern Georgeta Bordea Andreas Trügler Antoine Doucet 26 3 0 28 Sep 2023
ModuLoRA: Finetuning 2-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers Junjie Yin Jiahao Dong Yingheng Wang Christopher De Sa Volodymyr Kuleshov MQ 38 4 0 28 Sep 2023
Enabling Resource-efficient AIoT System with Cross-level Optimization: A survey Sicong Liu Bin Guo Cheng Fang Ziqi Wang Shiyan Luo Zimu Zhou Zhiwen Yu AI4CE 46 22 0 27 Sep 2023
Graph Neural Prompting with Large Language Models Yijun Tian Huan Song Zichen Wang Haozhu Wang Ziqing Hu Fang Wang Nitesh Chawla Panpan Xu AI4CE 44 44 0 27 Sep 2023
VPA: Fully Test-Time Visual Prompt Adaptation Jiachen Sun Mark Ibrahim Melissa Hall Ivan Evtimov Z. Morley Mao Cristian Canton Ferrer C. Hazirbas VLM 43 6 0 26 Sep 2023
Exploring Small Language Models with Prompt-Learning Paradigm for Efficient Domain-Specific Text Classification Hengyu Luo Peng Liu Stefan Esping 30 4 0 26 Sep 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning Rongxiang Weng Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 34 4 0 26 Sep 2023
KERMIT: Knowledge Graph Completion of Enhanced Relation Modeling with Inverse Transformation Haotian Li Lingzhi Wang Yuliang Wei Richard Y. D. Xu Bailing Wang Bailing Wang 56 2 0 26 Sep 2023
Bridging the Gulf of Envisioning: Cognitive Design Challenges in LLM Interfaces Hariharan Subramonyam Roy Pea Christopher Pondoc Maneesh Agrawala Colleen M. Seifert 45 47 0 25 Sep 2023
Self-Recovery Prompting: Promptable General Purpose Service Robot System with Foundation Models and Self-Recovery Mimo Shirasaka T. Matsushima S. Tsunashima Yuya Ikeda Aoi Horo ... Chikaha Tsuji Hikaru Wada Tsunekazu Omija Dai Komukai Yusuke Iwasawa LRM 11 11 0 25 Sep 2023
Tuning Multi-mode Token-level Prompt Alignment across Modalities Dongsheng Wang Miaoge Li Xinyang Liu Mingsheng Xu Bo Chen Hanwang Zhang VLM 39 16 0 25 Sep 2023
TouchUp-G: Improving Feature Representation through Graph-Centric Finetuning Jing Zhu Xiang Song V. Ioannidis Danai Koutra Christos Faloutsos 62 13 0 25 Sep 2023
EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria Tae Soo Kim Yoonjoo Lee Jamin Shin Young-Ho Kim Juho Kim 36 69 0 24 Sep 2023
GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graph Xin Li Dongze Lian Zhihe Lu Jiawang Bai Zhibo Chen Xinchao Wang VLM 45 61 0 24 Sep 2023
Natural Language based Context Modeling and Reasoning for Ubiquitous Computing with Large Language Models: A Tutorial Haoyi Xiong Jiang Bian Sijia Yang Xiaofei Zhang Linghe Kong Daqing Zhang LRM LLMAG 40 5 0 24 Sep 2023
Defending Pre-trained Language Models as Few-shot Learners against Backdoor Attacks Zhaohan Xi Tianyu Du Changjiang Li Ren Pang S. Ji Jinghui Chen Fenglong Ma Ting Wang AAML 16 29 0 23 Sep 2023
Frustrated with Code Quality Issues? LLMs can Help! Nalin Wadhwa Jui Pradhan Atharv Sonwane Surya Prakash Sahu Nagarajan Natarajan Aditya Kanade Suresh Parthasarathy S. Rajamani 43 3 0 22 Sep 2023
Transformer-based Image Compression with Variable Image Quality Objectives Chia-Hao Kao Yi-Hsin Chen Cheng Chien Wei-Chen Chiu Wen-Hsiao Peng 36 2 0 22 Sep 2023
HRoT: Hybrid prompt strategy and Retrieval of Thought for Table-Text Hybrid Question Answering Tongxu Luo Fangyu Lei Jiahe Lei Weihao Liu Shihu He Jun Zhao Kang Liu 29 3 0 22 Sep 2023
Construction contract risk identification based on knowledge-augmented language model Saika Wong Chunmo Zheng Xing Su Yinqiu Tang 20 14 0 22 Sep 2023
Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writers Tuhin Chakrabarty Vishakh Padmakumar Faeze Brahman Smaranda Muresan 60 37 0 22 Sep 2023
Foundation Metrics for Evaluating Effectiveness of Healthcare Conversations Powered by Generative AI Mahyar Abbasian Elahe Khatibi Iman Azimi David Oniani Zahra Shakeri Hossein Abad ... Bryant Lin Olivier Gevaert Li-Jia Li Ramesh C. Jain Amir M. Rahmani LM&MA ELM AI4MH 47 66 0 21 Sep 2023
ChaCha: Leveraging Large Language Models to Prompt Children to Share Their Emotions about Personal Events Woosuk Seo Chanmo Yang Young-Ho Kim 23 40 0 21 Sep 2023
Towards Answering Health-related Questions from Medical Videos: Datasets and Approaches Deepak Gupta Kush Attal Dina Demner-Fushman LM&MA 27 1 0 21 Sep 2023