Improving Multimodal Learning with Multi-Loss Gradient Modulation

Improving Multimodal Learning with Multi-Loss Gradient Modulation

13 May 2024

Konstantinos Kontras

Christos Chatzichristos

Matthew Blaschko

Papers citing "Improving Multimodal Learning with Multi-Loss Gradient Modulation"

10 / 10 papers shown

Title
Multimodal Distillation for Egocentric Action Recognition Gorjan Radevski Dusan Grujicic Marie-Francine Moens Matthew Blaschko Tinne Tuytelaars EgoV 39 23 0 14 Jul 2023
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks Wenhui Wang Hangbo Bao Li Dong Johan Bjorck Zhiliang Peng ... Kriti Aggarwal O. Mohammed Saksham Singhal Subhojit Som Furu Wei MLLM VLM ViT 112 636 0 22 Aug 2022
Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably) Yu Huang Junyang Lin Chang Zhou Hongxia Yang Longbo Huang 46 91 0 23 Mar 2022
Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies Itai Gat Idan Schwartz Alex Schwing Tamir Hazan 79 92 0 21 Oct 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 162 5,734 0 20 Jun 2020
Conformer: Convolution-augmented Transformer for Speech Recognition Anmol Gulati James Qin Chung-Cheng Chiu Niki Parmar Yu Zhang ... Wei Han Shibo Wang Zhengdong Zhang Yonghui Wu Ruoming Pang 188 3,082 0 16 May 2020
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 87 17,950 0 28 May 2019
CentralNet: a Multilayer Approach for Multimodal Fusion Valentin Vielzeuf Alexis Lechervy S. Pateux F. Jurie 51 166 0 22 Aug 2018
Efficient Large-Scale Multi-Modal Classification D. Kiela Edouard Grave Armand Joulin Tomas Mikolov 62 143 0 06 Feb 2018
A Unified Approach to Interpreting Model Predictions Scott M. Lundberg Su-In Lee FAtt 524 21,613 0 22 May 2017