Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
Learn and Don't Forget: Adding a New Language to ASR Foundation Models Mengjie Qian Siyuan Tang Rao Ma Kate Knill Mark Gales CLL 81 7 0 09 Jul 2024
An Empirical Comparison of Vocabulary Expansion and Initialization Approaches for Language Models Nandini Mundra Aditya Nanda Kishore Raj Dabre Ratish Puduppully Anoop Kunchukuttan Mitesh Khapra 70 7 0 08 Jul 2024
Sub-SA: Strengthen In-context Learning via Submodular Selective Annotation Jian Qian Miao Sun Sifan Zhou Ziyu Zhao Ruizhi Hun Patrick Chiang 99 1 0 08 Jul 2024
Enhancing Computer Programming Education with LLMs: A Study on Effective Prompt Engineering for Python Code Generation Tianyu Wang Nianjun Zhou Zhixiong Chen 106 11 0 07 Jul 2024
See Further for Parameter Efficient Fine-tuning by Standing on the Shoulders of Decomposition Chongjie Si Xiaokang Yang Wei Shen 82 8 0 07 Jul 2024
Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models Longxiang Tang Zhuotao Tian Kai Li Chunming He Hantao Zhou Hengshuang Zhao Xiu Li Jiaya Jia CLL VLM 105 24 0 07 Jul 2024
LoRA-GA: Low-Rank Adaptation with Gradient Approximation Shaowen Wang Linxi Yu Jian Li ALM AI4CE 115 47 0 06 Jul 2024
Conditional Semi-Supervised Data Augmentation for Spam Message Detection with Low Resource Data U. Nuha Chih-Hsueh Lin 104 0 0 06 Jul 2024
EventChat: Implementation and user-centric evaluation of a large language model-driven conversational recommender system for exploring leisure events in an SME context Hannes Kunstmann J. Ollier Joel Persson F. Wangenheim 87 0 0 05 Jul 2024
Towards Automating Text Annotation: A Case Study on Semantic Proximity Annotation using GPT-4 Sachin Yadav Tejaswi Choppa Dominik Schlechtweg VLM 104 7 0 04 Jul 2024
Fully Fine-tuned CLIP Models are Efficient Few-Shot Learners Mushui Liu Bozheng Li Yunlong Yu VLM CLIP 43 3 0 04 Jul 2024
Meta-prompting Optimized Retrieval-augmented Generation João Rodrigues António Branco RALM 87 0 0 04 Jul 2024
HYBRINFOX at CheckThat! 2024 -- Task 1: Enhancing Language Models with Structured Information for Check-Worthiness Estimation Géraud Faye Morgane Casanova B. Icard Julien Chanson Guillaume Gadek Guillaume Gravier Paul Égré 29 2 0 04 Jul 2024
A Survey on Trustworthiness in Foundation Models for Medical Image Analysis Congzhen Shi Ryan Rezai Jiaxi Yang Qi Dou Xiaoxiao Li MedIm 76 6 0 03 Jul 2024
Towards More Realistic Extraction Attacks: An Adversarial Perspective Yash More Prakhar Ganesh G. Farnadi AAML 124 7 0 02 Jul 2024
Enhancing the Capability and Robustness of Large Language Models through Reinforcement Learning-Driven Query Refinement Zisu Huang Xiaohua Wang Feiran Zhang Zhibo Xu Cenyuan Zhang Qi Qian Xiaoqing Zheng Xuanjing Huang AAML LRM 111 4 0 01 Jul 2024
Learning Visual Conditioning Tokens to Correct Domain Shift for Fully Test-time Adaptation Yushun Tang Shuoshuo Chen Zhehan Kan Yi Zhang Qinghai Guo Zhihai He 96 2 0 27 Jun 2024
The Rise of Artificial Intelligence in Educational Measurement: Opportunities and Ethical Challenges Okan Bulut Maggie Beiting-Parrish J. Casabianca Sharon C. Slater Hong Jiao ... S. Yildirim-Erbasli Tarid Wongvorachan Joyce Xinle Liu Bin Tan Polina Morilova 78 11 0 27 Jun 2024
Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation Guanting Dong Yutao Zhu Chenghao Zhang Zechen Wang Zhicheng Dou Ji-Rong Wen RALM 107 13 0 26 Jun 2024
Role-Play Zero-Shot Prompting with Large Language Models for Open-Domain Human-Machine Conversation Ahmed Njifenjou Virgile Sucal Bassam Jabaian Fabrice Lefèvre AI4CE ALM 63 3 0 26 Jun 2024
HGTDP-DTA: Hybrid Graph-Transformer with Dynamic Prompt for Drug-Target Binding Affinity Prediction Xi Xiao Wentao Wang Jiacheng Xie Lijing Zhu Gaofei Chen Zhengji Li Tianyang Wang Min Xu 53 6 0 25 Jun 2024
DKPROMPT: Domain Knowledge Prompting Vision-Language Models for Open-World Planning Xiaohan Zhang Zainab Altaweel Yohei Hayamizu Yan Ding S. Amiri Hao Yang Andy Kaminski Chad Esselink Shiqi Zhang VLM LM&Ro 88 8 0 25 Jun 2024
Enhancing LLM-Based Human-Robot Interaction with Nuances for Diversity Awareness Lucrezia Grassi Carmine Tommaso Recchiuto A. Sgorbissa 86 2 0 25 Jun 2024
The ALCHEmist: Automated Labeling 500x CHEaper Than LLM Data Annotators Tzu-Heng Huang Catherine Cao Vaishnavi Bhargava Frederic Sala 106 5 0 25 Jun 2024
CogExplore: Contextual Exploration with Language-Encoded Environment Representations Harel Biggie Patrick Cooper Doncey Albin Kristen Such Christoffer Heckman LM&Ro 62 0 0 24 Jun 2024
It Is Not About What You Say, It Is About How You Say It: A Surprisingly Simple Approach for Improving Reading Comprehension Sagi Shaier Lawrence E Hunter Katharina von der Wense 106 4 0 24 Jun 2024
Evaluation of Language Models in the Medical Context Under Resource-Constrained Settings Andrea Posada Daniel Rueckert Felix Meissen Philip Muller LM&MA ELM 58 0 0 24 Jun 2024
Distributed Rule Vectors is A Key Mechanism in Large Language Models' In-Context Learning Bowen Zheng Ming Ma Zhongqiao Lin Tianming Yang 71 2 0 23 Jun 2024
Large Language Models for Link Stealing Attacks Against Graph Neural Networks Faqian Guan Tianqing Zhu Hui Sun Wanlei Zhou Philip S. Yu AAML 116 0 0 22 Jun 2024
Open-Vocabulary Temporal Action Localization using Multimodal Guidance Akshita Gupta Aditya Arora Sanath Narayan Salman Khan Fahad Shahbaz Khan Graham W. Taylor 95 4 0 21 Jun 2024
How Effective is GPT-4 Turbo in Generating School-Level Questions from Textbooks Based on Bloom's Revised Taxonomy? Subhankar Maity Aniket Deroy Sudeshna Sarkar 60 7 0 21 Jun 2024
TemPrompt: Multi-Task Prompt Learning for Temporal Relation Extraction in RAG-based Crowdsourcing Systems Jing Yang Yu Zhao Linyao Yang Xiao Wang Long Chen Fei-Yue Wang LRM 52 2 0 21 Jun 2024
Exploring Spatial Representations in the Historical Lake District Texts with LLM-based Relation Extraction Erum Haris Anthony G. Cohn John G. Stell 67 4 0 20 Jun 2024
VGA: Vision GUI Assistant -- Minimizing Hallucinations through Image-Centric Fine-Tuning Ziyang Meng Yu Dai Zezheng Gong Shaoxiong Guo Minglong Tang Tongquan Wei VLM 75 3 0 20 Jun 2024
SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal Tinghao Xie Xiangyu Qi Yi Zeng Yangsibo Huang Udari Madhushani Sehwag ... Bo Li Kai Li Danqi Chen Peter Henderson Prateek Mittal ALM ELM 189 79 0 20 Jun 2024
BeHonest: Benchmarking Honesty in Large Language Models Steffi Chern Zhulin Hu Yuqing Yang Ethan Chern Yuan Guo Jiahe Jin Binjie Wang Pengfei Liu HILM ALM 143 5 0 19 Jun 2024
Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Devichand Budagam Sankalp KJ Ashutosh Kumar Vinija Jain Aman Chadha 80 1 0 18 Jun 2024
UrbanLLM: Autonomous Urban Activity Planning and Management with Large Language Models Yue Jiang Qin Chao Yile Chen Xiucheng Li Shuai Liu Gao Cong 65 7 0 18 Jun 2024
A Complete Survey on LLM-based AI Chatbots Sumit Kumar Dam Choong Seon Hong Yu Qiao Chaoning Zhang 104 62 0 17 Jun 2024
Are Large Language Models a Good Replacement of Taxonomies? Yushi Sun Hao Xin Kai Sun Yongjun Xu Xiao Yang Xin Luna Dong Nan Tang Lei Chen AI4MH 67 11 0 17 Jun 2024
Improving Large Models with Small models: Lower Costs and Better Performance Dong Chen Shuo Zhang Yueting Zhuang Siliang Tang Qidong Liu Hua Wang Mingliang Xu 96 6 0 15 Jun 2024
LLM-Mediated Domain-Specific Voice Agents: The Case of TextileBot Shu Zhong Elia Gatti James Hardwick Miriam Ribul Youngjun Cho Marianna Obrist 74 4 0 15 Jun 2024
Concentrate Attention: Towards Domain-Generalizable Prompt Optimization for Language Models Chengzhengxu Li Xiaoming Liu Zhaohan Zhang Yichen Wang Chen Liu Y. Lan Chao Shen 142 4 0 15 Jun 2024
CroPrompt: Cross-task Interactive Prompting for Zero-shot Spoken Language Understanding Libo Qin Fuxuan Wei Qiguang Chen Jingxuan Zhou Shijue Huang Jiasheng Si Wenpeng Lu Wanxiang Che LRM VLM 77 1 0 15 Jun 2024
Task Facet Learning: A Structured Approach to Prompt Optimization Gurusha Juneja Gautam Jajoo Nagarajan Natarajan Hua Li Jian Jiao Amit Sharma 105 10 0 15 Jun 2024
Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applications Irene Weber 101 9 0 13 Jun 2024
Talking Heads: Understanding Inter-layer Communication in Transformer Language Models Jack Merullo Carsten Eickhoff Ellie Pavlick 150 16 0 13 Jun 2024
Prompt-Based Length Controlled Generation with Multiple Control Types Renlong Jie Xiaojun Meng Lifeng Shang Xin Jiang Qun Liu 89 8 0 12 Jun 2024
TextGrad: Automatic "Differentiation" via Text Mert Yuksekgonul Federico Bianchi Joseph Boen Sheng Liu Zhi Huang Carlos Guestrin James Zou LLMAG OOD AI4CE 104 48 0 11 Jun 2024
Advancing Annotation of Stance in Social Media Posts: A Comparative Analysis of Large Language Models and Crowd Sourcing Mao Li Frederick Conrad 80 1 0 11 Jun 2024