Multimodal Prompting with Missing Modalities for Visual Recognition

6 March 2023

Chen-Yu Lee

Papers citing "Multimodal Prompting with Missing Modalities for Visual Recognition"

50 / 63 papers shown

Title
UniMoCo: Unified Modality Completion for Robust Multi-Modal Embeddings Jiajun Qin Yuan Pu Zhuolun He S. Kim David Z. Pan Bei Yu 0 0 0 17 May 2025
Decoupled Multimodal Prototypes for Visual Recognition with Missing Modalities Jueqing Lu Yuanyuan Qi Xiaohao Yang Shujie Zhou Lan Du 31 0 0 13 May 2025
Reducing Unimodal Bias in Multi-Modal Semantic Segmentation with Multi-Scale Functional Entropy Regularization Xu Zheng Yuanhuiyi Lyu Lutao Jiang Danda Pani Paudel Luc Van Gool Xuming Hu 31 1 0 10 May 2025
Are you SURE? Enhancing Multimodal Pretraining with Missing Modalities through Uncertainty Estimation Duy Nguyen Quan Huu Do Khoa D. Doan Minh N. Do 32 0 0 18 Apr 2025
See-Saw Modality Balance: See Gradient, and Sew Impaired Vision-Language Balance to Mitigate Dominant Modality Bias Junehyoung Kwon Mihyeon Kim Eunju Lee Juhwan Choi Youngbin Kim 60 0 0 18 Mar 2025
Robust Multimodal Survival Prediction with the Latent Differentiation Conditional Variational AutoEncoder Junjie Zhou Jiao Tang Yingli Zuo Peng Wan Daoqiang Zhang Wei Shao 60 1 0 12 Mar 2025
Distilled Prompt Learning for Incomplete Multimodal Survival Prediction Yingxue Xu Fengtao Zhou Chenyu Zhao Yihui Wang Can Yang Hao Chen VLM OffRL 52 0 0 03 Mar 2025
Efficient Prompting for Continual Adaptation to Missing Modalities Zirun Guo Shulei Wang Wang Lin Weicai Yan Yangyang Wu Tao Jin CLL VLM 66 2 0 01 Mar 2025
Knowledge Bridger: Towards Training-free Missing Multi-modality Completion Guanzhou Ke Shengfeng He Xinyu Wang Bo Wang Guoqing Chao Yuyao Zhang Yi Xie HeXing Su 68 0 0 27 Feb 2025
Modality-missing RGBT Tracking: Invertible Prompt Learning and High-quality Benchmarks Andong Lu Jiacong Zhao Chenglong Li Jin Tang Bin Luo VLM 63 5 0 31 Dec 2024
Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Data Zhiqiang Tang Zihan Zhong Tong He Gerald Friedland 83 0 0 19 Dec 2024
CLIP meets DINO for Tuning Zero-Shot Classifier using Unlabeled Image Collections Mohamed Fazli Mohamed Imam Rufael Fedaku Marew Jameel Hassan M. Fiaz Alham Fikri Aji Hisham Cholakkal VLM 187 0 0 28 Nov 2024
IMAN: An Adaptive Network for Robust NPC Mortality Prediction with Missing Modalities Yejing Huo Guoheng Huang Lianglun Cheng Jianbin He Xuhang Chen Xiaochen Yuan Guo Zhong Chi-Man Pun 29 1 0 24 Oct 2024
packetLSTM: Dynamic LSTM Framework for Streaming Data with Varying Feature Space Rohit Agarwal Karaka Prasanth Naidu Alexander Horsch Krishna Agarwal D. Prasad 22 1 0 22 Oct 2024
Deep Correlated Prompting for Visual Recognition with Missing Modalities Lianyu Hu Tongkai Shi Wei Feng Fanhua Shang Liang Wan VLM 31 1 0 09 Oct 2024
MMP: Towards Robust Multi-Modal Learning with Masked Modality Projection Niki Nezakati Md Kaykobad Reza Ameya Patil Mashhour Solh M. Salman Asif 32 1 0 03 Oct 2024
A Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarios Christian Ganhor Marta Moscati Anna Hausberger Shah Nawaz Markus Schedl 40 2 0 26 Sep 2024
Proactive Schemes: A Survey of Adversarial Attacks for Social Good Vishal Asnani Xi Yin Xiaoming Liu AAML 39 1 0 24 Sep 2024
MuAP: Multi-step Adaptive Prompt Learning for Vision-Language Model with Missing Modality Ruiting Dai Yuqiao Tan Lisi Mo Tao He Ke Qin Shuang Liang VLM 28 2 0 07 Sep 2024
Surprisingly Fragile: Assessing and Addressing Prompt Instability in Multimodal Foundation Models Ian Stewart Sameera Horawalavithana Brendan Kennedy Sai Munikoti Karl Pazdernik AAML 40 2 0 26 Aug 2024
Modality Invariant Multimodal Learning to Handle Missing Modalities: A Single-Branch Approach Muhammad Saad Saeed Shah Nawaz Muhammad Zaigham Zaheer Muhammad Haris Khan Karthik Nandakumar Muhammad Haroon Yousaf Hassan Sajjad Tom De Schepper Markus Schedl 30 0 0 14 Aug 2024
Depth Helps: Improving Pre-trained RGB-based Policy with Depth Information Injection Xincheng Pang Wenke Xia Zhigang Wang Bin Zhao Di Hu Dong Wang Xuelong Li 42 3 0 09 Aug 2024
Multi-modal Crowd Counting via Modal Emulation Chenhao Wang Xiaopeng Hong Zhiheng Ma Yupeng Wei Yabin Wang Xiaopeng Fan 37 1 0 28 Jul 2024
Chameleon: Images Are What You Need For Multimodal Learning Robust To Missing Modalities Muhammad Irzam Liaqat Shah Nawaz Muhammad Zaigham Zaheer M. S. Saeed Hassan Sajjad Tom De Schepper Karthik Nandakumar Muhammad Haris Khan 21 1 0 23 Jul 2024
Learning Trimodal Relation for AVQA with Missing Modality Kyu Ri Park Hong Joo Lee Jung Uk Kim 39 1 0 23 Jul 2024
Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Models Donggeun Kim Taesup Kim 31 4 0 17 Jul 2024
GTP-4o: Modality-prompted Heterogeneous Graph Learning for Omni-modal Biomedical Representation Chenxin Li Xinyu Liu Cheng Wang Yifan Liu Weihao Yu Jing Shao Yixuan Yuan 42 13 0 08 Jul 2024
Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition Zirun Guo Tao Jin Zhou Zhao 29 9 0 07 Jul 2024
Efficient Multi-View Fusion and Flexible Adaptation to View Missing in Cardiovascular System Signals Qihan Hu Daomiao Wang Hong Wu Jian Liu Cuiwei Yang 40 0 0 13 Jun 2024
Towards Precision Healthcare: Robust Fusion of Time Series and Image Data Ali Rasekh Reza Heidari Amir Hosein Haji Mohammad Rezaie Parsa Sharifi Sedeh Zahra Ahmadi Prasenjit Mitra Wolfgang Nejdl AI4TS 31 2 0 24 May 2024
All in One Framework for Multimodal Re-identification in the Wild He Li Mang Ye Ming Zhang Bo Du 35 9 0 08 May 2024
TI-ASU: Toward Robust Automatic Speech Understanding through Text-to-speech Imputation Against Missing Speech Modality Tiantian Feng Xuan Shi Rahul Gupta Shrikanth S. Narayanan 49 0 0 27 Apr 2024
Foundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directions Yuting He Fuxiang Huang Xinrui Jiang Yuxiang Nie Minghao Wang Jiguang Wang Hao Chen LM&MA AI4CE 71 27 0 04 Apr 2024
Towards Multimodal Video Paragraph Captioning Models Robust to Missing Modality Sishuo Chen Lei Li Shuhuai Ren Rundong Gao Yuanxin Liu Xiaohan Bi Xu Sun Lu Hou 42 3 0 28 Mar 2024
Reconstruct before Query: Continual Missing Modality Learning with Decomposed Prompt Collaboration Shu Zhao Xiaohan Zou Tan Yu Huijuan Xu 37 1 0 17 Mar 2024
Borrowing Treasures from Neighbors: In-Context Learning for Multimodal Learning with Missing Modalities and Data Scarcity Zhuo Zhi Ziquan Liu M. Elbadawi Adam Daneshmend Mine Orlu Abdul Basit Andreas Demosthenous Miguel R. D. Rodrigues 36 2 0 14 Mar 2024
Recurrent Aligned Network for Generalized Pedestrian Trajectory Prediction Yonghao Dong Le Wang Sanpin Zhou Gang Hua Changyin Sun 37 5 0 09 Mar 2024
An Empirical Categorization of Prompting Techniques for Large Language Models: A Practitioner's Guide Oluwole Fagbohun Rachel M. Harrison Anton Dereventsov 49 6 0 18 Feb 2024
Can Text-to-image Model Assist Multi-modal Learning for Visual Recognition with Visual Modality Missing? Tiantian Feng Daniel Yang Digbalay Bose Shrikanth Narayanan 37 4 0 14 Feb 2024
Quantifying and Enhancing Multi-modal Robustness with Modality Preference Zequn Yang Yake Wei Ce Liang Di Hu AAML 32 9 0 09 Feb 2024
Fourier Prompt Tuning for Modality-Incomplete Scene Segmentation Ruiping Liu Jiaming Zhang Kunyu Peng Yufan Chen Ke Cao Junwei Zheng M. Sarfraz Kailun Yang Rainer Stiefelhagen VLM 42 8 0 30 Jan 2024
AM^2-EmoJE: Adaptive Missing-Modality Emotion Recognition in Conversation via Joint Embedding Learning Naresh Kumar Devulapally Sidharth Anand S. Bhattacharjee Junsong Yuan 30 1 0 26 Jan 2024
Exploring Missing Modality in Multimodal Egocentric Datasets Merey Ramazanova Alejandro Pardo Humam Alwassel Guohao Li EgoV 35 4 0 21 Jan 2024
Toward Robust Multimodal Learning using Multimodal Foundational Models Xianbing Zhao Soujanya Poria Xuejiao Li Yixin Chen Buzhou Tang VLM 37 2 0 20 Jan 2024
Bootstrapping OTS-Funcimg Pre-training Model (Botfip) -- A Comprehensive Symbolic Regression Framework Tianhao Chen Pengbo Xu Haibiao Zheng AI4CE 26 4 0 18 Jan 2024
Multimodal Informative ViT: Information Aggregation and Distribution for Hyperspectral and LiDAR Classification Jiaqing Zhang Jie Lei Weiying Xie Geng Yang Daixun Li Yunsong Li 32 12 0 06 Jan 2024
Towards Robust Multimodal Prompting With Missing Modalities Jaehyuk Jang Yooseung Wang Changick Kim VLM 30 10 0 26 Dec 2023
Unified-modal Salient Object Detection via Adaptive Prompt Learning Kunpeng Wang Chenglong Li Zhengzheng Tu Zhengyi Liu Bin Luo 13 2 0 28 Nov 2023
Single-Model and Any-Modality for Video Object Tracking Zongwei Wu Jilai Zheng Xiangxuan Ren Florin-Alexandru Vasluianu Chao Ma D. Paudel Luc Van Gool Radu Timofte 55 35 0 27 Nov 2023
Robust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation Md Kaykobad Reza Ashley Prater-Bennette M. Salman Asif 28 5 0 06 Oct 2023