MaPLe: Multi-modal Prompt Learning

6 October 2022

Muhammad Uzair Khattak

Salman Khan

Papers citing "MaPLe: Multi-modal Prompt Learning"

50 / 384 papers shown

Title
Scene Graph Generation with Role-Playing Large Language Models Guikun Chen Jin Li Wenguan Wang VLM 48 5 0 20 Oct 2024
A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trends Junjun Jiang Zengyuan Zuo Gang Wu Kui Jiang Xianming Liu 48 10 0 19 Oct 2024
Sensitivity of Generative VLMs to Semantically and Lexically Altered Prompts Sri Harsha Dumpala Aman Jaiswal Chandramouli Shama Sastry E. Milios Sageev Oore Hassan Sajjad VLM 26 2 0 16 Oct 2024
Dual Prototype Evolving for Test-Time Generalization of Vision-Language Models Ce Zhang Simon Stepputtis Katia P. Sycara Yaqi Xie VLM 35 5 0 16 Oct 2024
TransAgent: Transfer Vision-Language Foundation Models with Heterogeneous Agent Collaboration Yiwei Guo Shaobin Zhuang Kunchang Li Yu Qiao Yali Wang VLM CLIP 32 0 0 16 Oct 2024
A Survey of Low-shot Vision-Language Model Adaptation via Representer Theorem Kun Ding Ying Wang Gaofeng Meng Shiming Xiang VLM 29 0 0 15 Oct 2024
Tree of Attributes Prompt Learning for Vision-Language Models Tong Ding Wanhua Li Zhongqi Miao Hanspeter Pfister VLM 54 1 0 15 Oct 2024
Fine-grained Abnormality Prompt Learning for Zero-shot Anomaly Detection Jiawen Zhu Yew-Soon Ong Chunhua Shen Guansong Pang 34 1 0 14 Oct 2024
LOBG:Less Overfitting for Better Generalization in Vision-Language Model Chenhao Ding Xinyuan Gao Songlin Dong Yuhang He Qiang Wang Alex C. Kot Yihong Gong VLM 34 1 0 14 Oct 2024
Mixture of Experts Made Personalized: Federated Prompt Learning for Vision-Language Models Jun Luo Cheng Chen Shandong Wu FedML VLM MoE 52 3 0 14 Oct 2024
Understanding Robustness of Parameter-Efficient Tuning for Image Classification Jiacheng Ruan Xian Gao Suncheng Xiang Mingye Xie Ting Liu Yuzhuo Fu AAML VLM 26 0 0 13 Oct 2024
DFIMat: Decoupled Flexible Interactive Matting in Multi-Person Scenarios Siyi Jiao Wenzheng Zeng Changxin Gao Nong Sang 28 1 0 13 Oct 2024
HeGraphAdapter: Tuning Multi-Modal Vision-Language Models with Heterogeneous Graph Adapter Yumiao Zhao Bo Jiang Xiao Wang Qin Xu Jin Tang VLM 30 0 0 10 Oct 2024
Deep Correlated Prompting for Visual Recognition with Missing Modalities Lianyu Hu Tongkai Shi Wei Feng Fanhua Shang Liang Wan VLM 31 1 0 09 Oct 2024
TuneVLSeg: Prompt Tuning Benchmark for Vision-Language Segmentation Models Rabin Adhikari Safal Thapaliya Manish Dhakal Bishesh Khanal MLLM VLM 35 0 0 07 Oct 2024
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey Dianzhi Yu Xinni Zhang Yankai Chen Aiwei Liu Yifei Zhang Philip S. Yu Irwin King VLM CLL 44 9 0 07 Oct 2024
Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models Shuoyuan Wang Yixuan Li Hongxin Wei VLM 51 2 0 03 Oct 2024
Rethinking Misalignment in Vision-Language Model Adaptation from a Causal Perspective Yanan Zhang Jiangmeng Li Lixiang Liu Jingyao Wang VLM 29 1 0 01 Oct 2024
PointAD: Comprehending 3D Anomalies from Points and Pixels for Zero-shot 3D Anomaly Detection Qihang Zhou Jiangtao Yan Shibo He Wenchao Meng Jiming Chen 3DPC 47 6 0 01 Oct 2024
Vision-Language Models are Strong Noisy Label Detectors Tong Wei Hao Li Chun-Shu Li Jiang-Xin Shi Yu-Feng Li Min-Ling Zhang VLM 29 3 0 29 Sep 2024
DOTA: Distributional Test-Time Adaptation of Vision-Language Models Zongbo Han Jialong Yang Junfan Li Qinghua Hu Qianli Xu Mike Zheng Shou Changqing Zhang TTA VLM 51 2 0 28 Sep 2024
Cascade Prompt Learning for Vision-Language Model Adaptation Ge Wu Xin Zhang Zheng Li Zhaowei Chen Jiajun Liang Jian Yang Xiang Li VLM 32 7 0 26 Sep 2024
Exploring Information-Theoretic Metrics Associated with Neural Collapse in Supervised Training Kun Song Zhiquan Tan Bochao Zou Jiansheng Chen Huimin Ma Weiran Huang 39 0 0 25 Sep 2024
Patch Ranking: Efficient CLIP by Learning to Rank Local Patches Cheng-En Wu Jinhong Lin Yu Hen Hu Pedro Morgado VLM 25 0 0 22 Sep 2024
PromptTA: Prompt-driven Text Adapter for Source-free Domain Generalization Haoran Zhang Shuanghao Bai Wanqi Zhou Jingwen Fu Badong Chen VLM OOD TTA 23 2 0 21 Sep 2024
Towards Zero-shot Point Cloud Anomaly Detection: A Multi-View Projection Framework Yuqi Cheng Yunkang Cao Guoyang Xie Zhichao Lu Nong Sang 3DPC 31 2 0 20 Sep 2024
End-to-end Open-vocabulary Video Visual Relationship Detection using Multi-modal Prompting Yongqi Wang Xinxiao Wu Shuo Yang Jiebo Luo 134 1 0 19 Sep 2024
Benchmarking VLMs' Reasoning About Persuasive Atypical Images Sina Malakouti Aysan Aghazadeh Ashmit Khandelwal Adriana Kovashka VLM 45 2 0 16 Sep 2024
Anytime Continual Learning for Open Vocabulary Classification Zhen Zhu Yiming Gong Derek Hoiem VLM 39 1 0 13 Sep 2024
Revisiting Prompt Pretraining of Vision-Language Models Zhenyuan Chen Lingfeng Yang Shuo Chen Zhaowei Chen Jiajun Liang Xiang Li MLLM VPVLM VLM 43 1 0 10 Sep 2024
CustomContrast: A Multilevel Contrastive Perspective For Subject-Driven Text-to-Image Customization Nan Chen Mengqi Huang Zhuowei Chen Yang Zheng Lei Zhang Zhendong Mao DiffM 49 5 0 09 Sep 2024
TempMe: Video Temporal Token Merging for Efficient Text-Video Retrieval Leqi Shen Tianxiang Hao Tao He Sicheng Zhao Pengzhang Liu Yongjun Bao Guiguang Ding Guiguang Ding 135 7 0 02 Sep 2024
COSMo: CLIP Talks on Open-Set Multi-Target Domain Adaptation Munish Monga Sachin Kumar Giroh Ankit Jha Mainak Singha Biplab Banerjee Jocelyn Chanussot 42 2 0 31 Aug 2024
Aligning Medical Images with General Knowledge from Large Language Models X. B. Fang Yi Lin Dong Zhang Kwang-Ting Cheng Hao Chen LM&MA VLM 32 4 0 31 Aug 2024
Adapting Vision-Language Models to Open Classes via Test-Time Prompt Tuning Zhengqing Gao Xiang Ao Xu-Yao Zhang Cheng-Lin Liu VLM VPVLM 34 0 0 29 Aug 2024
Leveraging Hallucinations to Reduce Manual Prompt Dependency in Promptable Segmentation Jian Hu Jiayi Lin Junchi Yan Shaogang Gong VLM 44 7 0 27 Aug 2024
HPT++: Hierarchically Prompting Vision-Language Models with Multi-Granularity Knowledge Generation and Improved Structure Modeling Yubin Wang Xinyang Jiang De Cheng Wenli Sun Dongsheng Li Cairong Zhao VLM 48 0 0 27 Aug 2024
AnoPLe: Few-Shot Anomaly Detection via Bi-directional Prompt Learning with Only Normal Samples Yujin Lee Seoyoon Jang Hyunsoo Yoon 32 0 0 24 Aug 2024
XDT-CXR: Investigating Cross-Disease Transferability in Zero-Shot Binary Classification of Chest X-Rays Umaima Rahman Abhishek Basu Muhammad Uzair Khattak Aniq Ur Rahman MedIm 38 0 0 21 Aug 2024
NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models Cheng Lin Lujun Li Dezhi Li Jie Zou Wei Xue Yike Guo AI4TS 40 4 0 18 Aug 2024
DPA: Dual Prototypes Alignment for Unsupervised Adaptation of Vision-Language Models Eman Ali Sathira Silva Muhammad Haris Khan VLM 37 0 0 16 Aug 2024
Efficient Test-Time Prompt Tuning for Vision-Language Models Yuhan Zhu Guozhen Zhang Chen Xu Haocheng Shen Xiaoxin Chen Gangshan Wu Limin Wang VLM 37 2 0 11 Aug 2024
Efficient and Versatile Robust Fine-Tuning of Zero-shot Models Sungyeon Kim Boseung Jeong Donghyun Kim Suha Kwak VLM 31 2 0 11 Aug 2024
Exploring Conditional Multi-Modal Prompts for Zero-shot HOI Detection Ting Lei Shaofeng Yin Yuxin Peng Yang Liu VLM 32 5 0 05 Aug 2024
Contribution-based Low-Rank Adaptation with Pre-training Model for Real Image Restoration Donwon Park Leixian Shen Se Young Chun 24 2 0 02 Aug 2024
Exploiting the Semantic Knowledge of Pre-trained Text-Encoders for Continual Learning Lu Yu Hesong Li Ying Fu J. Weijer Changsheng Xu CLL 55 1 0 02 Aug 2024
MTA-CLIP: Language-Guided Semantic Segmentation with Mask-Text Alignment Anurag Das Xinting Hu Li Jiang Bernt Schiele VLM 46 3 0 31 Jul 2024
SSPA: Split-and-Synthesize Prompting with Gated Alignments for Multi-Label Image Recognition Hao Tan Zichang Tan Jun Li Jun Wan Zhen Lei Stan Z. Li VLM 37 1 0 30 Jul 2024
Test-Time Low Rank Adaptation via Confidence Maximization for Zero-Shot Generalization of Vision-Language Models Raza Imam Hanan Gani Muhammad Huzaifa Karthik Nandakumar VLM 40 2 0 22 Jul 2024
AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detection Yunkang Cao Jiangning Zhang Luca Frittoli Yuqi Cheng Nong Sang Giacomo Boracchi VLM 48 29 0 22 Jul 2024