v1v2 (latest)

TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis

7 September 2020

Zilong Wang

Zhaohong Wan

Xiaojun Wan

ArXiv (abs)PDF HTML

Papers citing "TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis"

28 / 28 papers shown

Title
Towards Robust Multimodal Emotion Recognition under Missing Modalities and Distribution Shifts Guowei Zhong Ruohong Huan Mingzhen Wu Ronghua Liang Peng Chen 135 0 0 12 Jun 2025
Toward Robust Incomplete Multimodal Sentiment Analysis via Hierarchical Representation Learning Mingxing Li Jinjie Wei Yongxu Liu Shunli Wang Jiawei Chen ... Xiaolu Hou Mingyang Sun Ziyun Qian Dongliang Kou Li Zhang 87 2 0 05 Nov 2024
Recent Trends of Multimodal Affective Computing: A Survey from NLP Perspective Guimin Hu Yi Xin Weimin Lyu Haojian Huang Chang Sun Zehan Zhu Lin Gui Ruichu Cai Erik Cambria Hasti Seifi 109 6 0 11 Sep 2024
Modality Invariant Multimodal Learning to Handle Missing Modalities: A Single-Branch Approach Muhammad Saad Saeed Shah Nawaz Muhammad Zaigham Zaheer Muhammad Haris Khan Karthik Nandakumar Muhammad Haroon Yousaf Hassan Sajjad Tom De Schepper Markus Schedl 101 0 0 14 Aug 2024
Global Contrastive Training for Multimodal Electronic Health Records with Language Supervision Yingbo Ma Suraj Kolla Zhenhong Hu Dhruv Kaliraman Victoria Nolan ... Jeremy A. Balch Tyler J. Loftus Parisa Rashidi A. Bihorac B. Shickel AI4TS 99 2 0 10 Apr 2024
A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition Yusheng Dai Hang Chen Jun Du Ruoyu Wang Shihao Chen Jie Ma Haotian Wang Chin-Hui Lee 98 4 0 07 Mar 2024
Temporal Cross-Attention for Dynamic Embedding and Tokenization of Multimodal Electronic Health Records Yingbo Ma Suraj Kolla Dhruv Kaliraman Victoria Nolan Zhenhong Hu ... T. Ozrazgat-Baslanti Tyler J. Loftus Parisa Rashidi A. Bihorac B. Shickel AI4TS 87 1 0 06 Mar 2024
Examining Modality Incongruity in Multimodal Federated Learning for Medical Vision and Language-based Disease Detection Pramit Saha Divyanshu Mishra Felix Wagner Konstantinos Kamnitsas J. A. Noble 82 6 0 07 Feb 2024
Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection Liangqi Yuan Dong-Jun Han Su Wang Devesh Upadhyay Christopher G. Brinton 81 11 0 30 Jan 2024
Toward Robust Multimodal Learning using Multimodal Foundational Models Xianbing Zhao Soujanya Poria Xuejiao Li Yixin Chen Buzhou Tang VLM 88 3 0 20 Jan 2024
WisdoM: Improving Multimodal Sentiment Analysis by Fusing Contextual World Knowledge Wenbin Wang Liang Ding Li Shen Yong Luo Han Hu Dacheng Tao 79 12 0 12 Jan 2024
Multimodal Multi-loss Fusion Network for Sentiment Analysis Zehui Wu Ziwei Gong Jaywon Koo Julia Hirschberg 137 27 0 01 Aug 2023
Image Matters: A New Dataset and Empirical Study for Multimodal Hyperbole Detection Huixuan Zhang Xiaojun Wan 61 0 0 01 Jul 2023
Inconsistent Matters: A Knowledge-guided Dual-consistency Network for Multi-modal Rumor Detection Mengzhu Sun Xi Zhang Jianqiang Ma Sihong Xie Yazheng Liu Mohit Bansal 134 33 0 03 Jun 2023
Multimodal Prompting with Missing Modalities for Visual Recognition Yi-Lun Lee Yi-Hsuan Tsai Wei-Chen Chiu Chen-Yu Lee VPVLM 122 104 0 06 Mar 2023
QNet: A Quantum-native Sequence Encoder Architecture Wei-Yen Day Hao-Sheng Chen Min Sun 103 0 0 31 Oct 2022
Multimodal Transformer for Parallel Concatenated Variational Autoencoders Stephen D. Liang J. Mendel ViT 88 5 0 28 Oct 2022
MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences Wei Han Hui Chen MingSung Kan Soujanya Poria 90 10 0 23 Oct 2022
A Multimodal Sensor Fusion Framework Robust to Missing Modalities for Person Recognition Vijay John Yasutomo Kawanishi 80 8 0 20 Oct 2022
Cross-Modality Gated Attention Fusion for Multimodal Sentiment Analysis Ming-Xin Jiang Shaoxiong Ji 59 3 0 25 Aug 2022
CubeMLP: An MLP-based Model for Multimodal Sentiment Analysis and Depression Estimation Hao Sun Hongyi Wang Jiaqing Liu Yen-Wei Chen Lanfen Lin 64 107 0 28 Jul 2022
Counterfactual Reasoning for Out-of-distribution Multimodal Sentiment Analysis Teng Sun Wenjie Wang Liqiang Jing Yiran Cui Xuemeng Song Liqiang Nie OODD 72 37 0 24 Jul 2022
Cross-modal Prototype Driven Network for Radiology Report Generation Jun Wang A. Bhalerao Yulan He MedIm 173 77 0 11 Jul 2022
Tag-assisted Multimodal Sentiment Analysis under Uncertain Missing Modalities Jiandian Zeng Tianyi Liu Jiantao Zhou 151 63 0 28 Apr 2022
Survey of Generative Methods for Social Media Analysis Stan Matwin Aristides Milios P. Prałat Amilcar Soares Franccois Théberge 68 4 0 13 Dec 2021
ScaleVLAD: Improving Multimodal Sentiment Analysis via Multi-Scale Fusion of Locally Descriptors Huaishao Luo Lei Ji Yanyong Huang Bin Wang Shenggong Ji Tianrui Li 71 22 0 02 Dec 2021
CAMul: Calibrated and Accurate Multi-view Time-Series Forecasting Harshavardhan Kamarthi Lingkai Kong Alexander Rodríguez Chao Zhang B. Prakash AI4TS 110 17 0 15 Sep 2021
Video Sentiment Analysis with Bimodal Information-augmented Multi-Head Attention Ting-Wei Wu Jun-jie Peng Wenqiang Zhang Huiran Zhang Chuan Ma Yansong Huang 77 88 0 03 Mar 2021