Balanced Multimodal Learning via On-the-fly Gradient Modulation

29 March 2022

Papers citing "Balanced Multimodal Learning via On-the-fly Gradient Modulation"

22 / 22 papers shown

Title
DynCIM: Dynamic Curriculum for Imbalanced Multimodal Learning Chengxuan Qian Kai Han J. Wang Zhenlong Yuan Rui Qian Chongwen Lyu Jun Chen 51 1 0 09 Mar 2025
Advancing Precision Oncology Through Modeling of Longitudinal and Multimodal Data Luoting Zhuang Stephen H. Park Steven J. Skates Ashley E. Prosper Denise R. Aberle William Hsu 119 0 0 11 Feb 2025
Balanced Multi-view Clustering Zhenglai Li Jun Wang Chang-Fu Tang Xinzhong Zhu Wei Zhang Xinwang Liu 76 0 0 05 Jan 2025
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey Dianzhi Yu Xinni Zhang Yankai Chen Aiwei Liu Yifei Zhang Philip S. Yu Irwin King VLM CLL 44 9 0 07 Oct 2024
Anchors Aweigh! Sail for Optimal Unified Multi-Modal Representations Minoh Jeong Min Namgung Zae Myung Kim Dongyeop Kang Yao-Yi Chiang Alfred Hero 25 0 0 02 Oct 2024
Unleashing Network Potentials for Semantic Scene Completion Fengyun Wang Qianru Sun Dong-Ming Zhang Jinhui Tang 29 4 0 12 Mar 2024
Improving Discriminative Multi-Modal Learning with Large-Scale Pre-Trained Models Chenzhuang Du Yue Zhao Chonghua Liao Jiacheng You Jie Fu Hang Zhao 39 2 0 08 Oct 2023
Boosting Multi-modal Model Performance with Adaptive Gradient Modulation Hong Li Xingyu Li Pengbo Hu Yinuo Lei Chunxiao Li Yi Zhou 39 20 0 15 Aug 2023
Variational Probabilistic Fusion Network for RGB-T Semantic Segmentation Baihong Lin Zengrong Lin Yulan Guo Yulan Zhang Jianxiao Zou Shicai Fan 39 5 0 17 Jul 2023
Continual Multimodal Knowledge Graph Construction Xiang Chen Jintian Zhang Xiaohan Wang Ningyu Zhang Tongtong Wu Luo Si Yongheng Wang Huajun Chen KELM CLL 27 14 0 15 May 2023
Instance-Variant Loss with Gaussian RBF Kernel for 3D Cross-modal Retriveal Zhitao Liu Zengyu Liu Jiwei Wei Guan Wang Zhenjiang Du Ning Xie H. Shen 23 2 0 07 May 2023
Robust Cross-Modal Knowledge Distillation for Unconstrained Videos Wenke Xia Xingjian Li Andong Deng Haoyi Xiong Dejing Dou Di Hu 11 4 0 16 Apr 2023
Looking Similar, Sounding Different: Leveraging Counterfactual Cross-Modal Pairs for Audiovisual Representation Learning Nikhil Singh Chih-Wei Wu Iroro Orife Mahdi M. Kalayeh 25 2 0 12 Apr 2023
Balanced Audiovisual Dataset for Imbalance Analysis Wenke Xia Xu Zhao Xincheng Pang Changqing Zhang Di Hu 37 1 0 14 Feb 2023
Revisiting Pre-training in Audio-Visual Learning Ruoxuan Feng Wenke Xia Di Hu 30 1 0 07 Feb 2023
PMR: Prototypical Modal Rebalance for Multimodal Learning Yunfeng Fan Wenchao Xu Yining Qi Junxiao Wang Song Guo 25 60 0 14 Nov 2022
Play It Back: Iterative Attention for Audio Recognition Alexandros Stergiou Dima Damen 37 4 0 20 Oct 2022
Multimodal Analogical Reasoning over Knowledge Graphs Ningyu Zhang Lei Li Xiang Chen Xiaozhuan Liang Shumin Deng Huajun Chen 54 26 0 01 Oct 2022
Video-based Cross-modal Auxiliary Network for Multimodal Sentiment Analysis Rongfei Chen Wenju Zhou Yang Li Huiyu Zhou 19 19 0 30 Aug 2022
Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module Yih-Ling Liu Ziqi Yuan Huisheng Mao Zhiyun Liang Wanqiuyue Yang Yuanzhe Qiu Tie Cheng Xiaoteng Li Hua Xu Kai Gao 29 44 0 22 Aug 2022
Learning in Audio-visual Context: A Review, Analysis, and New Perspective Yake Wei Di Hu Yapeng Tian Xuelong Li 46 55 0 20 Aug 2022
Audiovisual SlowFast Networks for Video Recognition Fanyi Xiao Yong Jae Lee Kristen Grauman Jitendra Malik Christoph Feichtenhofer 197 206 0 23 Jan 2020