Title
Can Large Language Models Help Multimodal Language Analysis? MMLA: A Comprehensive Benchmark Hanlei Zhang Zhuohang Li Yeshuang Zhu Hua Xu Peiwu Wang Haige Zhu Jie Zhou Jinchao Zhang 32 0 0 23 Apr 2025
Multimodal Machine Learning for Real Estate Appraisal: A Comprehensive Survey Chenya Huang Zhidong Li Fang Chen Bin Liang 35 0 0 28 Mar 2025
Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition Chengxiang Huang Yake Wei Zequn Yang D. Hu 44 0 0 24 Mar 2025
Understanding the Emergence of Multimodal Representation Alignment Megan Tjandrasuwita Chanakya Ekbote Liu Ziyin Paul Pu Liang 52 1 0 22 Feb 2025
Free-Knots Kolmogorov-Arnold Network: On the Analysis of Spline Knots and Advancing Stability L. Zheng W. Zhang Lin Yue Miao Xu Olaf Maennel Weitong Chen 54 1 0 17 Jan 2025
AlzheimerRAG: Multimodal Retrieval Augmented Generation for PubMed articles A. Lahiri Qinmin Vivian Hu 69 5 0 21 Dec 2024
Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Data Zhiqiang Tang Zihan Zhong Tong He Gerald Friedland 83 0 0 19 Dec 2024
Multimodal Fusion Balancing Through Game-Theoretic Regularization Konstantinos Kontras Thomas Strypsteen Christos Chatzichristos Paul P. Liang Matthew Blaschko M. D. Vos 31 0 0 11 Nov 2024
MEANT: Multimodal Encoder for Antecedent Information Benjamin Iyoya Irving Annika Marie Schoene AIFin 26 0 0 10 Nov 2024
HourVideo: 1-Hour Video-Language Understanding Keshigeyan Chandrasegaran Agrim Gupta Lea M. Hadzic Taran Kota Jimming He Cristobal Eyzaguirre Zane Durante Manling Li Jiajun Wu L. Fei-Fei VLM 41 31 0 07 Nov 2024
An Information Criterion for Controlled Disentanglement of Multimodal Data Chenyu Wang Sharut Gupta Xinyi Zhang Sana Tonekaboni Stefanie Jegelka Tommi Jaakkola Caroline Uhler DRL 37 1 0 31 Oct 2024
Multimodal Information Bottleneck for Deep Reinforcement Learning with Multiple Sensors Bang You Huaping Liu SSL 25 5 0 23 Oct 2024
Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts Sukwon Yun Inyoung Choi Jie Peng Yangfan Wu J. Bao Qiyiwen Zhang Jiayi Xin Qi Long Tianlong Chen MoE 50 4 0 10 Oct 2024
DocKD: Knowledge Distillation from LLMs for Open-World Document Understanding Models Sungnyun Kim Haofu Liao Srikar Appalaraju Peng Tang Zhuowen Tu R. Satzoda R. Manmatha Vijay Mahadevan Stefano Soatto 38 0 0 04 Oct 2024
DreamStruct: Understanding Slides and User Interfaces via Synthetic Data Generation Yi-Hao Peng Faria Huq Yue Jiang Jason Wu Amanda Li Jeffrey P. Bigham Amy Pavel DiffM 25 4 0 30 Sep 2024
What to align in multimodal contrastive learning? Benoit Dufumier J. Castillo-Navarro D. Tuia Jean-Philippe Thiran 27 3 0 11 Sep 2024
MultiMed: Massively Multimodal and Multitask Medical Understanding Shentong Mo Paul Pu Liang LM&MA 24 0 0 22 Aug 2024
Enhance Modality Robustness in Text-Centric Multimodal Alignment with Adversarial Prompting Yun-Da Tsai Ting-Yu Yen Keng-Te Liao Shou-De Lin 31 1 0 19 Aug 2024
IoT-LM: Large Multisensory Language Models for the Internet of Things Shentong Mo Russ Salakhutdinov Louis-Philippe Morency Paul Pu Liang MLLM 26 7 0 13 Jul 2024
Diagnosing and Re-learning for Balanced Multimodal Learning Yake Wei Siwei Li Ruoxuan Feng Di Hu 33 3 0 12 Jul 2024
Enhance the Robustness of Text-Centric Multimodal Alignments Ting-Yu Yen Yun-Da Tsai Keng-Te Liao Shou-De Lin 36 2 0 06 Jul 2024
ADAPT: Multimodal Learning for Detecting Physiological Changes under Missing Modalities Julie Mordacq Léo Milecki Maria Vakalopoulou Steve Oudot Vicky Kalogeiton OffRL MedIm 37 3 0 04 Jul 2024
HEMM: Holistic Evaluation of Multimodal Foundation Models Paul Pu Liang Akshay Goindani Talha Chafekar Leena Mathur Haofei Yu Ruslan Salakhutdinov Louis-Philippe Morency 41 10 0 03 Jul 2024
Fairness and Bias in Multimodal AI: A Survey Tosin P. Adewumi Lama Alkhaled Namrata Gurung G. V. Boven Irene Pagliai 52 9 0 27 Jun 2024
DevBench: A multimodal developmental benchmark for language learning A. W. M. Tan Sunny Yu Bria Long Wanjing Anya Ma Tonya Murray Rebecca D. Silverman Jason D. Yeatman Michael C. Frank 36 3 0 14 Jun 2024
Generalist Multimodal AI: A Review of Architectures, Challenges and Opportunities Sai Munikoti Ian Stewart Sameera Horawalavithana Henry Kvinge Tegan H. Emerson Sandra E Thompson Karl Pazdernik 38 2 0 08 Jun 2024
Multimodal Approach for Harmonized System Code Prediction Otmane Amel Sédrick Stassin S. Mahmoudi Xavier Siebert 16 1 0 08 May 2024
Interpretable Tensor Fusion Saurabh Varshneya Antoine Ledent Philipp Liznerski Andriy Balinskyy Purvanshi Mehta Waleed Mustafa Marius Kloft 21 1 0 07 May 2024
3D object quality prediction for Metal Jet Printer with Multimodal thermal encoder R. Chen Chen Wenjia Zheng Sandeep Jalui Pavan Suri Jun Zeng AI4CE 20 0 0 17 Apr 2024
Enhancing ID and Text Fusion via Alternative Training in Session-based Recommendation Juanhui Li Haoyu Han Zhikai Chen Harry Shomer Wei Jin Amin Javari Jiliang Tang 33 1 0 14 Feb 2024
Quantifying and Enhancing Multi-modal Robustness with Modality Preference Zequn Yang Yake Wei Ce Liang Di Hu AAML 21 9 0 09 Feb 2024
Memory-Inspired Temporal Prompt Interaction for Text-Image Classification Xinyao Yu Hao Sun Ziwei Niu Rui Qin Zhenjia Bai Yen-Wei Chen Lanfen Lin VLM 28 2 0 26 Jan 2024
From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape Timothy R. McIntosh Teo Susnjak Tong Liu Paul Watters Malka N. Halgamuge 83 46 0 18 Dec 2023
BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Models Rizhao Cai Zirui Song Dayan Guan Zhenhao Chen Xing Luo Chenyu Yi Alex C. Kot MLLM VLM 27 31 0 05 Dec 2023
Understanding the Vulnerability of CLIP to Image Compression Cangxiong Chen Vinay P. Namboodiri Julian Padget 26 2 0 23 Nov 2023
MultiIoT: Benchmarking Machine Learning for the Internet of Things Shentong Mo Louis-Philippe Morency Russ Salakhutdinov Paul Pu Liang 24 1 0 10 Nov 2023
SimMMDG: A Simple and Effective Framework for Multi-modal Domain Generalization Hao Dong Ismail Nejjar Han Sun Eleni Chatzi Olga Fink 24 18 0 30 Oct 2023
What Makes for Robust Multi-Modal Models in the Face of Missing Modalities? Siting Li Chenzhuang Du Yue Zhao Yu Huang Hang Zhao 19 4 0 10 Oct 2023
RegBN: Batch Normalization of Multimodal Data with Regularization Morteza Ghahremani Christian Wachinger 28 6 0 01 Oct 2023
Sarcasm in Sight and Sound: Benchmarking and Expansion to Improve Multimodal Sarcasm Detection Swapnil Bhosale Abhra Chaudhuri Alex Lee Robert Williams Divyank Tiwari Anjan Dutta Xiatian Zhu Pushpak Bhattacharyya Diptesh Kanojia 30 2 0 29 Sep 2023
Learning Noise-Robust Joint Representation for Multimodal Emotion Recognition under Incomplete Data Scenarios Qi Fan Haolin Zuo Rui Liu Zheng Lian Beijing 13 2 0 21 Sep 2023
AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models Yuan Tseng Layne Berry Yi-Ting Chen I-Hsiang Chiu Hsuan-Hao Lin ... Yu Tsao Shinji Watanabe Abdel-rahman Mohamed Chi-Luen Feng Hung-yi Lee VLM SSL 50 14 0 19 Sep 2023
Harmonic-NAS: Hardware-Aware Multimodal Neural Architecture Search on Resource-constrained Devices Mohamed Imed Eddine Ghebriout Halima Bouzidi Smail Niar Hamza Ouarnoughi 19 3 0 12 Sep 2023
Boosting Multi-modal Model Performance with Adaptive Gradient Modulation Hong Li Xingyu Li Pengbo Hu Yinuo Lei Chunxiao Li Yi Zhou 30 20 0 15 Aug 2023
Deep Equilibrium Multimodal Fusion Jinhong Ni Yalong Bai Wei Zhang Ting Yao Tao Mei 28 1 0 29 Jun 2023
MultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep Learning Paul Pu Liang Yiwei Lyu Xiang Fan Arav Agarwal Yun Cheng Louis-Philippe Morency Ruslan Salakhutdinov VLM 31 6 0 28 Jun 2023
FedMultimodal: A Benchmark For Multimodal Federated Learning Tiantian Feng Digbalay Bose Tuo Zhang Rajat Hebbar Anil Ramakrishna Rahul Gupta Mi Zhang Salman Avestimehr Shrikanth Narayanan 32 48 0 15 Jun 2023
Factorized Contrastive Learning: Going Beyond Multi-view Redundancy Paul Pu Liang Zihao Deng Martin Q. Ma James Y. Zou Louis-Philippe Morency Ruslan Salakhutdinov SSL 24 49 0 08 Jun 2023
Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications Paul Pu Liang Chun Kai Ling Yun Cheng A. Obolenskiy Yudong Liu Rohan Pandey Alex Wilf Louis-Philippe Morency Ruslan Salakhutdinov OffRL 28 11 0 07 Jun 2023
Training Transitive and Commutative Multimodal Transformers with LoReTTa Manuel Tran Yashin Dicente Cid Amal Lahiani Fabian J. Theis Tingying Peng Eldad Klaiman 20 2 0 23 May 2023