Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,808 papers shown

Title
Dyn-Adapter: Towards Disentangled Representation for Efficient Visual Recognition Yurong Zhang Honghao Chen Xinyu Zhang Xiangxiang Chu Li Song 47 1 0 19 Jul 2024
EarthMarker: Visual Prompt Learning for Region-level and Point-level Remote Sensing Imagery Comprehension Wei Zhang Miaoxin Cai Tong Zhang Jun Li Zhuang Yin Xuerui Mao 66 5 0 18 Jul 2024
Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning Qifan Zhang Yunhui Guo Yu Xiang CLL VLM 56 0 0 18 Jul 2024
Application of Prompt Learning Models in Identifying the Collaborative Problem Solving Skills in an Online Task Mengxiao Zhu Xin Wang Xiantao Wang Zihang Chen Wei Huang 32 1 0 17 Jul 2024
Do LLMs have Consistent Values? Naama Rozen G. Elidan Amir Globerson Ella Daniel 72 3 0 16 Jul 2024
Graph Structure Prompt Learning: A Novel Methodology to Improve Performance of Graph Neural Networks Zhenhua Huang Kunhao Li Shaojie Wang Zhaohong Jia Wentao Zhu Sharad Mehrotra GNN 39 0 0 16 Jul 2024
Quantized Prompt for Efficient Generalization of Vision-Language Models Tianxiang Hao Xiaohan Ding Juexiao Feng Yuhong Yang Hui Chen Guiguang Ding VLM MQ 32 5 0 15 Jul 2024
MetaLLM: A High-performant and Cost-efficient Dynamic Framework for Wrapping LLMs Quang H. Nguyen Duy C. Hoang Juliette Decugis Saurav Manchanda Nitesh V. Chawla Khoa D. Doan Khoa D. Doan 45 6 0 15 Jul 2024
Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond Yingcong Li A. S. Rawat Samet Oymak 25 6 0 13 Jul 2024
Image Compression for Machine and Human Vision with Spatial-Frequency Adaptation Han Li Shaohui Li Shuangrui Ding Wenrui Dai Maida Cao Chenglin Li Junni Zou Hongkai Xiong VLM 43 5 0 13 Jul 2024
Benchmarking Language Model Creativity: A Case Study on Code Generation Yining Lu Dixuan Wang Tianjian Li Dongwei Jiang Daniel Khashabi Meng Jiang Daniel Khashabi LRM 59 10 0 12 Jul 2024
Enhancing Robustness of Vision-Language Models through Orthogonality Learning and Cross-Regularization Jinlong Li Zequn Jie Elisa Ricci Lin Ma N. Sebe VLM 39 1 0 11 Jul 2024
Parameter-Efficient and Memory-Efficient Tuning for Vision Transformer: A Disentangled Approach Taolin Zhang Jiawang Bai Zhihe Lu Dongze Lian Genping Wang Xinchao Wang Shu-Tao Xia 41 4 0 09 Jul 2024
Learn and Don't Forget: Adding a New Language to ASR Foundation Models Mengjie Qian Siyuan Tang Rao Ma Kate Knill Mark J. F. Gales CLL 39 3 0 09 Jul 2024
An Empirical Comparison of Vocabulary Expansion and Initialization Approaches for Language Models Nandini Mundra Aditya Nanda Kishore Raj Dabre Ratish Puduppully Anoop Kunchukuttan Mitesh Khapra 30 3 0 08 Jul 2024
Sub-SA: Strengthen In-context Learning via Submodular Selective Annotation Jian Qian Miao Sun Sifan Zhou Ziyu Zhao Ruizhi Hun Patrick Chiang 41 1 0 08 Jul 2024
Enhancing Computer Programming Education with LLMs: A Study on Effective Prompt Engineering for Python Code Generation Tianyu Wang Nianjun Zhou Zhixiong Chen 31 9 0 07 Jul 2024
See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition Chongjie Si Xiaokang Yang Wei Shen 42 5 0 07 Jul 2024
Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models Longxiang Tang Zhuotao Tian Kai Li Chunming He Hantao Zhou Hengshuang Zhao Xiu Li Jiaya Jia CLL VLM 39 20 0 07 Jul 2024
LoRA-GA: Low-Rank Adaptation with Gradient Approximation Shaowen Wang Linxi Yu Jian Li ALM AI4CE 26 29 0 06 Jul 2024
Conditional Semi-Supervised Data Augmentation for Spam Message Detection with Low Resource Data U. Nuha Chih-Hsueh Lin 40 0 0 06 Jul 2024
EventChat: Implementation and user-centric evaluation of a large language model-driven conversational recommender system for exploring leisure events in an SME context Hannes Kunstmann J. Ollier Joel Persson F. Wangenheim 37 0 0 05 Jul 2024
Towards Automating Text Annotation: A Case Study on Semantic Proximity Annotation using GPT-4 Sachin Yadav Tejaswi Choppa Dominik Schlechtweg VLM 45 4 0 04 Jul 2024
Fully Fine-tuned CLIP Models are Efficient Few-Shot Learners Mushui Liu Bozheng Li Yunlong Yu VLM CLIP 31 3 0 04 Jul 2024
Meta-prompting Optimized Retrieval-augmented Generation João Rodrigues António Branco RALM 41 0 0 04 Jul 2024
HYBRINFOX at CheckThat! 2024 -- Task 1: Enhancing Language Models with Structured Information for Check-Worthiness Estimation Géraud Faye Morgane Casanova B. Icard Julien Chanson Guillaume Gadek Guillaume Gravier Paul Égré 20 2 0 04 Jul 2024
A Survey on Trustworthiness in Foundation Models for Medical Image Analysis Congzhen Shi Ryan Rezai Jiaxi Yang Qi Dou Xiaoxiao Li MedIm 34 4 0 03 Jul 2024
Towards More Realistic Extraction Attacks: An Adversarial Perspective Yash More Prakhar Ganesh G. Farnadi AAML 74 6 0 02 Jul 2024
Enhancing the Capability and Robustness of Large Language Models through Reinforcement Learning-Driven Query Refinement Zisu Huang Xiaohua Wang Feiran Zhang Zhibo Xu Cenyuan Zhang Xiaoqing Zheng Xuanjing Huang AAML LRM 40 4 0 01 Jul 2024
Learning Visual Conditioning Tokens to Correct Domain Shift for Fully Test-time Adaptation Yushun Tang Shuoshuo Chen Zhehan Kan Yi Zhang Qinghai Guo Zhihai He 51 2 0 27 Jun 2024
The Rise of Artificial Intelligence in Educational Measurement: Opportunities and Ethical Challenges Okan Bulut Maggie Beiting-Parrish J. Casabianca Sharon C. Slater Hong Jiao ... S. Yildirim-Erbasli Tarid Wongvorachan Joyce Xinle Liu Bin Tan Polina Morilova 40 10 0 27 Jun 2024
Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation Guanting Dong Yutao Zhu Chenghao Zhang Zechen Wang Zhicheng Dou Ji-Rong Wen RALM 44 10 0 26 Jun 2024
Role-Play Zero-Shot Prompting with Large Language Models for Open-Domain Human-Machine Conversation Ahmed Njifenjou Virgile Sucal Bassam Jabaian Fabrice Lefèvre AI4CE ALM 28 3 0 26 Jun 2024
HGTDP-DTA: Hybrid Graph-Transformer with Dynamic Prompt for Drug-Target Binding Affinity Prediction Xi Xiao Wentao Wang Jiacheng Xie Lijing Zhu Gaofei Chen Zhengji Li Tianyang Wang Min Xu 30 4 0 25 Jun 2024
DKPROMPT: Domain Knowledge Prompting Vision-Language Models for Open-World Planning Xiaohan Zhang Zainab Altaweel Yohei Hayamizu Yan Ding S. Amiri Hao Yang Andy Kaminski Chad Esselink Shiqi Zhang VLM LM&Ro 41 6 0 25 Jun 2024
Enhancing LLM-Based Human-Robot Interaction with Nuances for Diversity Awareness Lucrezia Grassi Carmine Tommaso Recchiuto A. Sgorbissa 12 2 0 25 Jun 2024
The ALCHEmist: Automated Labeling 500x CHEaper Than LLM Data Annotators Tzu-Heng Huang Catherine Cao Vaishnavi Bhargava Frederic Sala 33 3 0 25 Jun 2024
CogExplore: Contextual Exploration with Language-Encoded Environment Representations Harel Biggie Patrick Cooper Doncey Albin Kristen Such Christoffer Heckman LM&Ro 40 0 0 24 Jun 2024
It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension Sagi Shaier Lawrence E Hunter K. Wense 44 3 0 24 Jun 2024
Evaluation of Language Models in the Medical Context Under Resource-Constrained Settings Andrea Posada Daniel Rueckert Felix Meissen Philip Muller LM&MA ELM 37 0 0 24 Jun 2024
Distributed Rule Vectors is A Key Mechanism in Large Language Models' In-Context Learning Bowen Zheng Ming Ma Zhongqiao Lin Tianming Yang 36 1 0 23 Jun 2024
Large Language Models for Link Stealing Attacks Against Graph Neural Networks Faqian Guan Tianqing Zhu Hui Sun Wanlei Zhou Philip S. Yu AAML 37 0 0 22 Jun 2024
Open-Vocabulary Temporal Action Localization using Multimodal Guidance Akshita Gupta Aditya Arora Sanath Narayan Salman Khan Fahad Shahbaz Khan Graham W. Taylor 41 3 0 21 Jun 2024
How Effective is GPT-4 Turbo in Generating School-Level Questions from Textbooks Based on Bloom's Revised Taxonomy? Subhankar Maity Aniket Deroy Sudeshna Sarkar 32 7 0 21 Jun 2024
TemPrompt: Multi-Task Prompt Learning for Temporal Relation Extraction in RAG-based Crowdsourcing Systems Jing Yang Yu Zhao Linyao Yang Xiao Wang Long Chen Fei-Yue Wang LRM 28 2 0 21 Jun 2024
Exploring Spatial Representations in the Historical Lake District Texts with LLM-based Relation Extraction Erum Haris Anthony G. Cohn John G. Stell 38 1 0 20 Jun 2024
VGA: Vision GUI Assistant -- Minimizing Hallucinations through Image-Centric Fine-Tuning Ziyang Meng Yu Dai Zezheng Gong Shaoxiong Guo Minglong Tang Tongquan Wei VLM 37 3 0 20 Jun 2024
SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal Tinghao Xie Xiangyu Qi Yi Zeng Yangsibo Huang Udari Madhushani Sehwag ... Bo Li Kai Li Danqi Chen Peter Henderson Prateek Mittal ALM ELM 58 52 0 20 Jun 2024
BeHonest: Benchmarking Honesty in Large Language Models Steffi Chern Zhulin Hu Yuqing Yang Ethan Chern Yuan Guo Jiahe Jin Binjie Wang Pengfei Liu HILM ALM 86 3 0 19 Jun 2024
Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Devichand Budagam Sankalp KJ Ashutosh Kumar Vinija Jain Aman Chadha 51 0 0 18 Jun 2024