Multi-modal Deep Learning

6 March 2024

Papers citing "Multi-modal Deep Learning"

23 / 23 papers shown

Title
PREMISE: Matching-based Prediction for Accurate Review Recommendation Wei Han Hui Chen Soujanya Poria 47 0 0 02 May 2025
Automatic Detection of Intro and Credits in Video using CLIP and Multihead Attention Vasilii Korolkov Andrey Yanchenko VLM 40 0 0 13 Apr 2025
Learning Musical Representations for Music Performance Question Answering Xingjian Diao Chunhui Zhang Tingxuan Wu Ming Cheng Z. Ouyang Weiyi Wu Jiang Gui 73 7 0 10 Feb 2025
Longitudinal Abuse and Sentiment Analysis of Hollywood Movie Dialogues using LLMs Rohitash Chandra Guoxiang Ren G. Houseman 46 0 0 20 Jan 2025
What to align in multimodal contrastive learning? Benoit Dufumier J. Castillo-Navarro D. Tuia Jean-Philippe Thiran 29 3 0 11 Sep 2024
Hybrid Quantum-inspired Resnet and Densenet for Pattern Recognition with Completeness Analysis Andi Chen Hua‐Lei Yin Zeng-Bing Chen Shengjun Wu 34 0 0 09 Mar 2024
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion Xing Han Huy Nguyen Carl Harris Nhat Ho S. Saria MoE 77 16 0 05 Feb 2024
Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift Yihao Xue Siddharth Joshi Dang Nguyen Baharan Mirzasoleiman VLM 31 4 0 08 Oct 2023
Understanding Transferable Representation Learning and Zero-shot Transfer in CLIP Zixiang Chen Yihe Deng Yuanzhi Li Quanquan Gu VLM 25 10 0 02 Oct 2023
On the Computational Benefit of Multimodal Learning Zhou Lu 27 0 0 25 Sep 2023
Learning to Taste: A Multimodal Wine Dataset Thoranna Bender Simon Moe Sorensen A. Kashani K. E. Hjorleifsson Grethe Hyldig Søren Hauberg Serge J. Belongie Frederik Warburg CoGe 27 2 0 31 Aug 2023
Multimodal Deep Learning for Personalized Renal Cell Carcinoma Prognosis: Integrating CT Imaging and Clinical Data Maryamalsadat Mahootiha H. Qadir Jacob Bergsland I. Balasingham 21 7 0 07 Jul 2023
UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning Heqing Zou Meng Shen Chen Chen Yuchen Hu D. Rajan Chng Eng Siong SSL 37 15 0 16 May 2023
On Uni-Modal Feature Learning in Supervised Multi-Modal Learning Chenzhuang Du Jiaye Teng Tingle Li Yichen Liu Tianyuan Yuan Yue Wang Yang Yuan Hang Zhao 86 38 0 02 May 2023
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition Guimin Hu Ting-En Lin Yi Zhao Guangming Lu Yuchuan Wu Yongbin Li 31 110 0 21 Nov 2022
Contrastive Audio-Visual Masked Autoencoder Yuan Gong Andrew Rouditchenko Alexander H. Liu David Harwath Leonid Karlinsky Hilde Kuehne James R. Glass 35 120 0 02 Oct 2022
A survey of multimodal deep generative models Masahiro Suzuki Y. Matsuo SyDa DRL 57 76 0 05 Jul 2022
Deep Class Incremental Learning from Decentralized Data Xiaohan Zhang Songlin Dong Jinjie Chen Qiaoling Tian Yihong Gong Xiaopeng Hong CLL 23 11 0 11 Mar 2022
Memory-augmented Deep Unfolding Network for Guided Image Super-resolution Man Zhou Keyu Yan Jin-shan Pan Wenqi Ren Qiaokang Xie Xiangyong Cao GAN SupR 25 60 0 12 Feb 2022
DeepStroke: An Efficient Stroke Screening Framework for Emergency Rooms with Multimodal Adversarial Deep Learning Tongan Cai Haomiao Ni Ming-Chieh Yu Xiaolei Huang K. Wong John Volpi J. Z. Wang Stephen T. C. Wong 13 14 0 24 Sep 2021
Perceiver IO: A General Architecture for Structured Inputs & Outputs Andrew Jaegle Sebastian Borgeaud Jean-Baptiste Alayrac Carl Doersch Catalin Ionescu ... Olivier J. Hénaff M. Botvinick Andrew Zisserman Oriol Vinyals João Carreira MLLM VLM GNN 20 565 0 30 Jul 2021
TabTransformer: Tabular Data Modeling Using Contextual Embeddings Xin Huang A. Khetan Milan Cvitkovic Zohar Karnin ViT LMTD 157 417 0 11 Dec 2020
StageNet: Stage-Aware Neural Networks for Health Risk Prediction Junyi Gao Cao Xiao Yasha Wang Wen Tang Lucas Glass Jimeng Sun 37 92 0 24 Jan 2020