MaPLe: Multi-modal Prompt Learning

6 October 2022

Muhammad Uzair Khattak

Salman Khan

Papers citing "MaPLe: Multi-modal Prompt Learning"

50 / 384 papers shown

Title
Follow-Up Differential Descriptions: Language Models Resolve Ambiguities for Image Classification Reza Esfandiarpoor Stephen H. Bach VLM 32 13 0 10 Nov 2023
Cross-modal Prompts: Adapting Large Pre-trained Models for Audio-Visual Downstream Tasks Haoyi Duan Yan Xia Mingze Zhou Li Tang Jieming Zhu Zhou Zhao VLM 21 17 0 09 Nov 2023
HIPTrack: Visual Tracking with Historical Prompts Wenrui Cai Qingjie Liu Yunhong Wang VLM 20 30 0 03 Nov 2023
Align Your Prompts: Test-Time Prompting with Distribution Alignment for Zero-Shot Generalization Jameel Hassan Hanan Gani Noor Hussein Muhammad Uzair Khattak Muzammal Naseer Fahad Shahbaz Khan Salman Khan VLM OOD 55 61 0 02 Nov 2023
ZEETAD: Adapting Pretrained Vision-Language Model for Zero-Shot End-to-End Temporal Action Detection Thinh Phan Khoa T. Vo Duy Le Gianfranco Doretto Don Adjeroh Ngan Le VLM 21 9 0 01 Nov 2023
AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection Qihang Zhou Guansong Pang Yu Tian Shibo He Jiming Chen VLM 31 123 0 29 Oct 2023
Unlocking the Potential of Prompt-Tuning in Bridging Generalized and Personalized Federated Learning Wenlong Deng Christos Thrampoulidis Xiaoxiao Li 29 12 0 27 Oct 2023
SD4Match: Learning to Prompt Stable Diffusion Model for Semantic Matching Xinghui Li Jingyi Lu Kai Han V. Prisacariu DiffM 30 19 0 26 Oct 2023
Prototypical Contrastive Learning-based CLIP Fine-tuning for Object Re-identification Jiachen Li Xiaojin Gong VLM 19 3 0 26 Oct 2023
DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models Ge Zheng Bin Yang Jiajin Tang Hong-Yu Zhou Sibei Yang LRM MLLM 29 93 0 25 Oct 2023
Text-driven Prompt Generation for Vision-Language Models in Federated Learning Chen Qiu Xingyu Li Chaithanya Kumar Mummadi Madan Ravi Ganesh Zhenzhen Li Lu Peng Wan-Yi Lin VLM FedML 42 11 0 09 Oct 2023
Rephrase, Augment, Reason: Visual Grounding of Questions for Vision-Language Models Archiki Prasad Elias Stengel-Eskin Mohit Bansal ReLM LRM 28 8 0 09 Oct 2023
Sentence-level Prompts Benefit Composed Image Retrieval Yang Bai Xinxing Xu Yong-Jin Liu Salman Khan Fahad Khan Wangmeng Zuo Rick Siow Mong Goh Chun-Mei Feng 36 26 0 09 Oct 2023
MedPrompt: Cross-Modal Prompting for Multi-Task Medical Image Translation Xuhang Chen Chi-Man Pun Shuqiang Wang MedIm 29 22 0 04 Oct 2023
Domain-Controlled Prompt Learning Qinglong Cao Zhengqin Xu Yuantian Chen Chao Ma Xiaokang Yang VLM 31 16 0 30 Sep 2023
Zero-Shot and Few-Shot Video Question Answering with Multi-Modal Prompts Bipin Rajendran Bashir M. Al-Hashimi MLLM VLM 30 2 0 27 Sep 2023
Noise-Tolerant Unsupervised Adapter for Vision-Language Models Eman Ali Dayan Guan Muhammad Haris Khan Abdulmotaleb Elsaddik VLM 24 0 0 26 Sep 2023
Tuning Multi-mode Token-level Prompt Alignment across Modalities Dongsheng Wang Miaoge Li Xinyang Liu Mingsheng Xu Bo Chen Hanwang Zhang VLM 39 16 0 25 Sep 2023
Fill the K-Space and Refine the Image: Prompting for Dynamic and Multi-Contrast MRI Reconstruction Bingyu Xin Meng Ye L. Axel Dimitris N. Metaxas 33 14 0 25 Sep 2023
GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graph Xin Li Dongze Lian Zhihe Lu Jiawang Bai Zhibo Chen Xinchao Wang VLM 43 60 0 24 Sep 2023
CLIP-based Synergistic Knowledge Transfer for Text-based Person Retrieval Yating Liu Yaowei Li Zimo Liu Wenming Yang Yaowei Wang Qingmin Liao VLM 26 11 0 18 Sep 2023
Audio-free Prompt Tuning for Language-Audio Models Yiming Li Xiangdong Wang Hong Liu CLIP VLM 19 9 0 15 Sep 2023
Gradient constrained sharpness-aware prompt learning for vision-language models Liangchen Liu Nannan Wang Dawei Zhou Xinbo Gao Decheng Liu Xi Yang Tongliang Liu VLM 33 2 0 14 Sep 2023
DePT: Decoupled Prompt Tuning Ji Zhang Shihan Wu Lianli Gao Hengtao Shen Jingkuan Song VLM 29 27 0 14 Sep 2023
TAP: Targeted Prompting for Task Adaptive Generation of Textual Training Instances for Visual Classification M. Jehanzeb Mirza Leonid Karlinsky Wei Lin Horst Possegger Rogerio Feris Horst Bischof VLM 37 6 0 13 Sep 2023
Distribution-Aware Prompt Tuning for Vision-Language Models Eulrang Cho Jooyeon Kim Hyunwoo J. Kim VPVLM VLM 30 20 0 06 Sep 2023
UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory Haiwen Diao Bo Wan Yuhang Zhang Xuecong Jia Huchuan Lu Long Chen VLM 31 18 0 28 Aug 2023
Parameter-Efficient Transfer Learning for Remote Sensing Image-Text Retrieval Yuan. Yuan Yangfan Zhan Zhitong Xiong VLM 28 39 0 24 Aug 2023
GOPro: Generate and Optimize Prompts in CLIP using Self-Supervised Learning Mainak Singha Ankit Jha Biplab Banerjee VLM 36 4 0 22 Aug 2023
DPL: Decoupled Prompt Learning for Vision-Language Models C. Xu Yuhan Zhu Guozhen Zhang Haocheng Shen Yixuan Liao Xiaoxin Chen Gangshan Wu Limin Wang VLM 21 4 0 19 Aug 2023
VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control Zi-Yuan Hu Yanyang Li M. Lyu Liwei Wang VLM 27 15 0 18 Aug 2023
AD-CLIP: Adapting Domains in Prompt Space Using CLIP Mainak Singha Harsh Pal Ankit Jha Biplab Banerjee VLM 27 49 0 10 Aug 2023
Improving Generalization of Image Captioning with Unsupervised Prompt Learning Hongchen Wei Zhenzhong Chen VLM 33 3 0 05 Aug 2023
ECO: Ensembling Context Optimization for Vision-Language Models Lorenzo Agnolucci Alberto Baldrati Francesco Todino Federico Becattini Marco Bertini A. Bimbo VLM 26 5 0 26 Jul 2023
Self-regulating Prompts: Foundational Model Adaptation without Forgetting Muhammad Uzair Khattak Syed Talal Wasim Muzammal Naseer Salman Khan Ming Yang F. Khan VLM 23 166 0 13 Jul 2023
Review of Large Vision Models and Visual Prompt Engineering Jiaqi Wang Zheng Liu Lin Zhao Zihao Wu Chong Ma ... Bao Ge Yixuan Yuan Dinggang Shen Tianming Liu Shu Zhang VLM LRM 55 146 0 03 Jul 2023
Understanding Prompt Tuning for V-L Models Through the Lens of Neural Collapse Didi Zhu Zexi Li Min Zhang Junkun Yuan Yunfeng Shao Jiashuo Liu Kun Kuang Yinchuan Li Chao Wu VLM 26 1 0 28 Jun 2023
PromptIR: Prompting for All-in-One Blind Image Restoration Vaishnav Potlapalli Syed Waqas Zamir Salman Khan F. Khan VLM 37 91 0 22 Jun 2023
UniBoost: Unsupervised Unimodal Pre-training for Boosting Zero-shot Vision-Language Tasks Yanan Sun Zi-Qi Zhong Qi Fan Chi-Keung Tang Yu-Wing Tai VLM 30 4 0 07 Jun 2023
Retrieval-Enhanced Visual Prompt Learning for Few-shot Classification Jintao Rong Hao Chen Tianrun Chen Linlin Ou Xinyi Yu Yifan Liu VLM VPVLM 15 6 0 04 Jun 2023
ProTeCt: Prompt Tuning for Taxonomic Open Set Classification Tz-Ying Wu Chih-Hui Ho Nuno Vasconcelos VLM 8 5 0 04 Jun 2023
Enhancing CLIP with CLIP: Exploring Pseudolabeling for Limited-Label Prompt Tuning Cristina Menghini Andrew T. Delworth Stephen H. Bach VLM 13 20 0 02 Jun 2023
Consistency-guided Prompt Learning for Vision-Language Models Shuvendu Roy Ali Etemad VLM VPVLM 22 52 0 01 Jun 2023
Deeply Coupled Cross-Modal Prompt Learning Xuejing Liu Wei Tang Jinghui Lu Rui Zhao Zhaojun Guo Fei Tan VLM 20 17 0 29 May 2023
CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers Dachuan Shi Chaofan Tao Anyi Rao Zhendong Yang Chun Yuan Jiaqi Wang VLM 30 22 0 27 May 2023
Prompting Language-Informed Distribution for Compositional Zero-Shot Learning Wentao Bao Lichang Chen Heng-Chiao Huang Yu Kong CoGe VLM 29 12 0 23 May 2023
Enhance Reasoning Ability of Visual-Language Models via Large Language Models Yueting Yang Xintong Zhang Wenjuan Han VLM ReLM LRM 28 1 0 22 May 2023
Parameter-efficient Tuning of Large-scale Multimodal Foundation Model Haixin Wang Xinlong Yang Jianlong Chang Di Jin Jinan Sun Shikun Zhang Xiao Luo Qi Tian 25 23 0 15 May 2023
Multi-Prompt with Depth Partitioned Cross-Modal Learning Yingjie Tian Yiqi Wang Xianda Guo Zheng Hua Zhu Long Chen VLM 18 0 0 10 May 2023
Visual Tuning Bruce X. B. Yu Jianlong Chang Haixin Wang Lin Liu Shijie Wang ... Lingxi Xie Haojie Li Zhouchen Lin Qi Tian Chang Wen Chen VLM 46 38 0 10 May 2023