A Closer Look at Multimodal Representation Collapse

A Closer Look at Multimodal Representation Collapse

28 May 2025

Abhra Chaudhuri

Serban Georgescu

Papers citing "A Closer Look at Multimodal Representation Collapse"

16 / 16 papers shown

Title
DeNetDM: Debiasing by Network Depth Modulation Silpa Vadakkeeveetil Sreelatha Adarsh Kappiyath Anjan Dutta 52 4 1 28 Mar 2024
Learning Missing Modal Electronic Health Records with Unified Multi-modal Data Embedding and Modality-Aware Attention Kwanhyung Lee Soojeong Lee Sangchul Hahn Heejung Hyun Edward Choi Byungeun Ahn Joohyung Lee 63 18 0 04 May 2023
Multimodal Deep Learning Cem Akkus Jiquan Ngiam Vladana Djakovic Steffen Jauch-Walser A. Khosla ... Jann Goschenhofer Honglak Lee A. Ng Daniel Schalk Matthias Aßenmacher 99 3,166 0 12 Jan 2023
Polysemanticity and Capacity in Neural Networks Adam Scherlis Kshitij Sachan Adam Jermyn Joe Benton Buck Shlegeris MILM 167 29 0 04 Oct 2022
Toy Models of Superposition Nelson Elhage Tristan Hume Catherine Olsson Nicholas Schiefer T. Henighan ... Sam McCandlish Jared Kaplan Dario Amodei Martin Wattenberg C. Olah AAML MILM 172 363 0 21 Sep 2022
Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization Adrián Javaloy Maryam Meghdadi Isabel Valera 60 29 0 09 Jun 2022
Are Multimodal Transformers Robust to Missing Modality? Mengmeng Ma Jian Ren Long Zhao Davide Testuggine Xi Peng ViT 88 151 0 12 Apr 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 239 30,108 0 01 Mar 2022
Attention Bottlenecks for Multimodal Fusion Arsha Nagrani Shan Yang Anurag Arnab A. Jansen Cordelia Schmid Chen Sun 94 560 0 30 Jun 2021
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision Wonjae Kim Bokyung Son Ildoo Kim VLM CLIP 112 1,739 0 05 Feb 2021
Handling Missing Data with Graph Representation Learning Jiaxuan You Xiaobai Ma D. Ding Mykel Kochenderfer J. Leskovec 52 178 0 30 Oct 2020
Unpaired Multi-modal Segmentation via Knowledge Distillation Qi Dou Quande Liu Pheng Ann Heng Ben Glocker 55 175 0 06 Jan 2020
Self-training with Noisy Student improves ImageNet classification Qizhe Xie Minh-Thang Luong Eduard H. Hovy Quoc V. Le NoLa 296 2,387 0 11 Nov 2019
Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models Yuge Shi Siddharth Narayanaswamy Brooks Paige Philip Torr DRL 67 270 0 08 Nov 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 141 1,045 0 23 Oct 2019
CentralNet: a Multilayer Approach for Multimodal Fusion Valentin Vielzeuf Alexis Lechervy S. Pateux F. Jurie 63 169 0 22 Aug 2018