Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis

1 September 2021

Papers citing "Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis"

30 / 80 papers shown

Title
Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis Haoyu Zhang Yu Wang Guanghao Yin Kejun Liu Yuanyuan Liu Tianshu Yu 13 31 0 09 Oct 2023
Multimodal Prompt Transformer with Hybrid Contrastive Learning for Emotion Recognition in Conversation Shihao Zou Xianying Huang Xudong Shen 19 8 0 04 Oct 2023
VideoAdviser: Video Knowledge Distillation for Multimodal Transfer Learning Yanan Wang Donghuo Zeng Shinya Wada Satoshi Kurihara 32 6 0 27 Sep 2023
Neuro-Inspired Hierarchical Multimodal Learning Xiongye Xiao Gengshuo Liu Gaurav Gupta Benjamin Cho Shixuan Li Yaxing Li Tianqing Fang M. Erez Michael Orshansky 26 1 0 27 Sep 2023
Hierarchical Audio-Visual Information Fusion with Multi-label Joint Decoding for MER 2023 Haotian Wang Yuxuan Xi Hang Chen Jun Du Yan Song ... Pengfei Hu Ya Jiang Shi Cheng Jie Zhang Yuzhe Weng 45 4 0 11 Sep 2023
Exchanging-based Multimodal Fusion with Transformer Renyu Zhu Chengcheng Han Yong Qian Qiushi Sun Xiang Li Ming Gao Xuezhi Cao Yunsen Xian 38 2 0 05 Sep 2023
Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition Bobo Li Hao Fei Lizi Liao Yu Zhao Chong Teng Tat-Seng Chua Donghong Ji Fei Li 22 30 0 08 Aug 2023
Multimodal Multi-loss Fusion Network for Sentiment Analysis Zehui Wu Ziwei Gong Jaywon Koo Julia Hirschberg 31 21 0 01 Aug 2023
ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis Yu Mingjun Zhao Shiguang Qi Feiran Sun Baoxun Wang Weidong Guo Xiaoli Wang Lei Yang Di Niu 11 10 0 27 Jun 2023
Enhanced Multimodal Representation Learning with Cross-modal KD Mengxi Chen Linyu Xing Yu Wang Ya-Qin Zhang 26 11 0 13 Jun 2023
Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion Shao-Yu Wu Damai Dai Ziwei Qin Tianyu Liu Binghuai Lin Yunbo Cao Zhifang Sui 26 6 0 24 May 2023
TextMI: Textualize Multimodal Information for Integrating Non-verbal Cues in Pre-trained Language Models M. Hasan Md. Saiful Islam Sangwu Lee Wasifur Rahman Iftekhar Naim Mohammed Ibrahim Khan E. Hoque VLM 18 2 0 27 Mar 2023
InterMulti:Multi-view Multimodal Interactions with Text-dominated Hierarchical High-order Fusion for Emotion Analysis Feng Qiu Wanzeng Kong Yu-qiong Ding 34 2 0 20 Dec 2022
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition Guimin Hu Ting-En Lin Yi Zhao Guangming Lu Yuchuan Wu Yongbin Li 31 110 0 21 Nov 2022
Multimodal Contrastive Learning via Uni-Modal Coding and Cross-Modal Prediction for Multimodal Sentiment Analysis Ronghao Lin Haifeng Hu SSL 23 15 0 26 Oct 2022
MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences Wei Han Hui Chen MingSung Kan Soujanya Poria 27 10 0 23 Oct 2022
Missing Modality meets Meta Sampling (M3S): An Efficient Universal Approach for Multimodal Sentiment Analysis with Missing Modality Haozhe Chi Minghua Yang Junhao Zhu Guanhong Wang Gaoang Wang 33 3 0 07 Oct 2022
SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning Wei Han Hui Chen Zhen Hai Soujanya Poria Lidong Bing 58 16 0 12 Sep 2022
Progressive Fusion for Multimodal Integration Shiv Shankar Laure Thompson M. Fiterau 31 3 0 01 Sep 2022
Video-based Cross-modal Auxiliary Network for Multimodal Sentiment Analysis Rongfei Chen Wenju Zhou Yang Li Huiyu Zhou 19 19 0 30 Aug 2022
Flexible Vertical Federated Learning with Heterogeneous Parties Timothy Castiglia Shiqiang Wang S. Patterson FedML 31 34 0 26 Aug 2022
Interpretable Multimodal Emotion Recognition using Hybrid Fusion of Speech and Image Data Puneet Kumar Sarthak Malik Balasubramanian Raman CVBM 25 22 0 25 Aug 2022
Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module Yih-Ling Liu Ziqi Yuan Huisheng Mao Zhiyun Liang Wanqiuyue Yang Yuanzhe Qiu Tie Cheng Xiaoteng Li Hua Xu Kai Gao 29 44 0 22 Aug 2022
Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis Guoying Zhao Zheng Lian B. Liu Jianhua Tao 30 47 0 16 Aug 2022
Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Data Timothy Castiglia Anirban Das Shiqiang Wang S. Patterson FedML 19 48 0 16 Jun 2022
Analyzing Modality Robustness in Multimodal Sentiment Analysis Devamanyu Hazarika Yingting Li Bo Cheng Shuai Zhao Roger Zimmermann Soujanya Poria 29 32 0 30 May 2022
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis Huisheng Mao Ziqi Yuan Hua Xu Wenmeng Yu Yihe Liu Kai Gao 22 41 0 23 Mar 2022
Multimodal Representations Learning Based on Mutual Information Maximization and Minimization and Identity Embedding for Multimodal Sentiment Analysis Jiahao Zheng Sen Zhang Xiaoping Wang Zhigang Zeng 14 7 0 10 Jan 2022
StreaMulT: Streaming Multimodal Transformer for Heterogeneous and Arbitrary Long Sequential Data Victor Pellegrain Myriam Tami M. Batteux C´eline Hudelot AI4TS 20 2 0 15 Oct 2021
Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis Wenmeng Yu Hua Xu Ziqi Yuan Jiele Wu SSL 52 440 0 09 Feb 2021