Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,810 papers shown

Title
Traces of Memorisation in Large Language Models for Code Ali Al-Kaswan Maliheh Izadi Arie van Deursen ELM 39 15 0 18 Dec 2023
Pedestrian Attribute Recognition via CLIP based Prompt Vision-Language Fusion Tianlin Li Jiandong Jin Chenglong Li Jin Tang Cheng Zhang Wei Wang VLM 22 13 0 17 Dec 2023
Gradient-based Parameter Selection for Efficient Fine-Tuning Zhi Zhang Qizhe Zhang Zijun Gao Renrui Zhang Ekaterina Shutova Shiji Zhou Shanghang Zhang 33 15 0 15 Dec 2023
3DAxiesPrompts: Unleashing the 3D Spatial Task Capabilities of GPT-4V Dingning Liu Xiaomeng Dong Renrui Zhang Xu Luo Peng Gao Xiaoshui Huang Yongshun Gong Zhihui Wang 34 10 0 15 Dec 2023
Silent Guardian: Protecting Text from Malicious Exploitation by Large Language Models Jiawei Zhao Kejiang Chen Xianjian Yuan Yuang Qi Weiming Zhang Neng H. Yu 67 8 0 15 Dec 2023
Binary Code Summarization: Benchmarking ChatGPT/GPT-4 and Other Large Language Models Xin Jin Jonathan Larson Weiwei Yang Zhiqiang Lin ELM 23 23 0 15 Dec 2023
Training-free Zero-shot Composed Image Retrieval with Local Concept Reranking Shitong Sun Fanghua Ye Shaogang Gong 34 13 0 14 Dec 2023
Data and Model Poisoning Backdoor Attacks on Wireless Federated Learning, and the Defense Mechanisms: A Comprehensive Survey Yichen Wan Youyang Qu Wei Ni Yong Xiang Longxiang Gao Ekram Hossain AAML 60 33 0 14 Dec 2023
LAMM: Label Alignment for Multi-Modal Prompt Learning Jingsheng Gao Jiacheng Ruan Suncheng Xiang Zefang Yu Ke Ji Mingye Xie Ting Liu Yuzhuo Fu MLLM VLM VPVLM 32 15 0 13 Dec 2023
Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models Kyra Ahrens Hans Hergen Lehmann Jae Hee Lee Stefan Wermter CLL 35 7 0 13 Dec 2023
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 37 143 0 13 Dec 2023
Comparable Demonstrations are Important in In-Context Learning: A Novel Perspective on Demonstration Selection Caoyun Fan Jidong Tian Yitian Li Hao He Yaohui Jin 37 4 0 12 Dec 2023
ICL Markup: Structuring In-Context Learning using Soft-Token Tags Marc-Etienne Brunet Ashton Anderson R. Zemel 38 4 0 12 Dec 2023
Domain Prompt Learning with Quaternion Networks Qinglong Cao Zhengqin Xu Yuntian Chen Chao Ma Xiaokang Yang VLM 48 10 0 12 Dec 2023
Adaptive Human Trajectory Prediction via Latent Corridors Neerja Thakkar K. Mangalam Andrea V. Bajcsy Jitendra Malik 30 4 0 11 Dec 2023
KnowGPT: Knowledge Graph based Prompting for Large Language Models Qinggang Zhang Junnan Dong Hao Chen Daochen Zha Zailiang Yu Xiao Huang KELM RALM 24 5 0 11 Dec 2023
Generative Large Language Models Are All-purpose Text Analytics Engines: Text-to-text Learning Is All Your Need C.A.I. Peng Xi Yang Aokun Chen Zehao Yu Kaleb E. Smith Anthony B Costa Mona G. Flores Jiang Bian Yonghui Wu LM&MA 27 7 0 11 Dec 2023
DevBots can co-design APIs Vinicius Soares Silva Marques 35 0 0 10 Dec 2023
VRPTEST: Evaluating Visual Referring Prompting in Large Multimodal Models Zongjie Li Chaozheng Wang Chaowei Liu Pingchuan Ma Daoyuan Wu Shuai Wang Cuiyun Gao VLM 34 6 0 07 Dec 2023
An unsupervised approach towards promptable defect segmentation in laser-based additive manufacturing by Segment Anything Israt Zarin Era Imtiaz Ahmed Zhichao Liu Srinjoy Das 24 2 0 07 Dec 2023
SYNC-CLIP: Synthetic Data Make CLIP Generalize Better in Data-Limited Scenarios Mushui Liu Weijie He Ziqian Lu Yunlong Yu VLM 30 1 0 06 Dec 2023
Prompt Optimization via Adversarial In-Context Learning Do Xuan Long Yiran Zhao Hannah Brown Yuxi Xie James Xu Zhao Nancy F. Chen Kenji Kawaguchi Michael Qizhe Xie Junxian He 85 12 0 05 Dec 2023
MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following Renze Lou Kai Zhang Jian Xie Yuxuan Sun Janice Ahn Hanzi Xu Yu Su Wenpeng Yin 37 26 0 05 Dec 2023
PEFA: Parameter-Free Adapters for Large-scale Embedding-based Retrieval Models Wei-Cheng Chang Jyun-Yu Jiang Jiong Zhang Mutasem Al-Darabsah C. Teo Cho-Jui Hsieh Hsiang-Fu Yu S. Vishwanathan RALM 33 2 0 05 Dec 2023
Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Model Yuxia Geng Jiaoyan Chen Yuhang Zeng Zhuo Chen Wen Zhang Jeff Z. Pan Yuxiang Wang Xiaoliang Xu 42 2 0 04 Dec 2023
Regressor-Segmenter Mutual Prompt Learning for Crowd Counting Mingyue Guo Li Yuan Zhaoyi Yan Binghui Chen Yaowei Wang QiXiang Ye 38 6 0 04 Dec 2023
How to Configure Good In-Context Sequence for Visual Question Answering Li Li Jiawei Peng Huiyi Chen Chongyang Gao Xu Yang MLLM 25 20 0 04 Dec 2023
Towards Mitigating Perceived Unfairness in Contracts from a Non-Legal Stakeholder's Perspective Anmol Singhal Preethu Rose Anish Shirish S. Karande S. Ghaisas AILaw 16 2 0 03 Dec 2023
Visual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspective Can Jin Tianjin Huang Yihua Zhang Mykola Pechenizkiy Sijia Liu Shiwei Liu Tianlong Chen VLM 36 26 0 03 Dec 2023
NLEBench+NorGLM: A Comprehensive Empirical Analysis and Benchmark Dataset for Generative Language Models in Norwegian Peng Liu Lemei Zhang Terje Nissen Farup Even W. Lauvrak Jon Espen Ingvaldsen Simen Eide J. Gulla Zhirong Yang ELM 35 6 0 03 Dec 2023
Large Language Models Are Zero-Shot Text Classifiers Zhiqiang Wang Yiran Pang Yanbin Lin 21 30 0 02 Dec 2023
A Bayesian approach for prompt optimization in pre-trained language models Antonio Sabbatella Andrea Ponti Antonio Candelieri I. Giordani Francesco Archetti 36 1 0 01 Dec 2023
Towards a Psychological Generalist AI: A Survey of Current Applications of Large Language Models and Future Prospects Tianyu He Guanghui Fu Y. Yu Fan Wang Jianqiang Li ... Changwei Song Hongzhi Qi Dan Luo Huijing Zou Bing Xiang Yang AI4MH AI4CE LM&MA 24 10 0 01 Dec 2023
Conceptual Engineering Using Large Language Models Bradley Paul Allen 37 0 0 01 Dec 2023
Applying Large Language Models and Chain-of-Thought for Automatic Scoring Gyeong-Geon Lee Ehsan Latif Xuansheng Wu Ninghao Liu Xiaoming Zhai 42 89 0 30 Nov 2023
MV-CLIP: Multi-View CLIP for Zero-shot 3D Shape Recognition Dan Song Xinwei Fu Weizhi Nie Wenhui Li Lanjun Wang You Yang Anan Liu VLM 34 6 0 30 Nov 2023
Each Test Image Deserves A Specific Prompt: Continual Test-Time Adaptation for 2D Medical Image Segmentation Ziyang Chen Yongsheng Pan Yiwen Ye Mengkang Lu Yong-quan Xia OOD VLM MedIm 45 6 0 30 Nov 2023
Quantification of cardiac capillarization in single-immunostained myocardial slices using weakly supervised instance segmentation Zhao Zhang Xiwen Chen William Richardson Bruce Z. Gao Abolfazl Razi Tong Ye 25 1 0 30 Nov 2023
MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learning Chaoyi Zhang K. Lin Zhengyuan Yang Jianfeng Wang Linjie Li Chung-Ching Lin Zicheng Liu Lijuan Wang VGen 39 28 0 29 Nov 2023
TARGET: Template-Transferable Backdoor Attack Against Prompt-based NLP Models via GPT4 Zihao Tan Qingliang Chen Yongjian Huang Chen Liang SILM AAML 42 3 0 29 Nov 2023
Improving the Robustness of Transformer-based Large Language Models with Dynamic Attention Lujia Shen Yuwen Pu Shouling Ji Changjiang Li Xuhong Zhang Chunpeng Ge Ting Wang AAML 34 4 0 29 Nov 2023
Efficient Stitchable Task Adaptation Haoyu He Zizheng Pan Jing Liu Jianfei Cai Bohan Zhuang 34 3 0 29 Nov 2023
Unified-modal Salient Object Detection via Adaptive Prompt Learning Kunpeng Wang Chenglong Li Zhengzheng Tu Zhengyi Liu Bin Luo 15 2 0 28 Nov 2023
A Survey of the Evolution of Language Model-Based Dialogue Systems Hongru Wang Lingzhi Wang Yiming Du Liang Chen Jing Zhou Yufei Wang Kam-Fai Wong LRM 72 21 0 28 Nov 2023
Graph Prompt Learning: A Comprehensive Survey and Beyond Xiangguo Sun Jiawen Zhang Xixi Wu Hong Cheng Yun Xiong Jia Li 44 52 0 28 Nov 2023
MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphs Xingtong Yu Chang Zhou Yuan Fang Xinming Zhang 25 29 0 28 Nov 2023
Visual cognition in multimodal large language models Luca M. Schulze Buschoff Elif Akata Matthias Bethge Eric Schulz LRM 56 14 0 27 Nov 2023
ArGue: Attribute-Guided Prompt Tuning for Vision-Language Models Xinyu Tian Shu Zou Zhaoyuan Yang Jing Zhang VLM 34 22 0 27 Nov 2023
Interpretation modeling: Social grounding of sentences by reasoning over their implicit moral judgments Liesbeth Allein Maria Mihaela Trucscva Marie-Francine Moens 50 1 0 27 Nov 2023
Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphs Xingtong Yu Zhenghao Liu Yuan Fang Zemin Liu Sihong Chen Xinming Zhang 48 24 0 26 Nov 2023