v1v2 (latest)

M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues

9 November 2019

Papers citing "M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues"

50 / 67 papers shown

Title
Leveraging CLIP Encoder for Multimodal Emotion Recognition Yehun Song Sunyoung Cho VLM 37 0 0 01 Jun 2025
Multimodal Federated Learning: A Survey through the Lens of Different FL Paradigms Yuanzhe Peng Jieming Bian Lei Wang Yin Huang Jie Xu 20 0 0 27 May 2025
Unifying EEG and Speech for Emotion Recognition: A Two-Step Joint Learning Framework for Handling Missing EEG Data During Inference Upasana Tiwari Rupayan Chakraborty Sunil Kumar Kopparapu 48 0 0 20 Mar 2025
RAMer: Reconstruction-based Adversarial Model for Multi-party Multi-modal Multi-label Emotion Recognition Xudong Yang Yizhang Zhu Nan Tang Yuyu Luo 132 0 0 09 Feb 2025
LLM supervised Pre-training for Multimodal Emotion Recognition in Conversations Soumya Dutta Sriram Ganapathy 116 6 0 20 Jan 2025
Towards Robust Multimodal Sentiment Analysis with Incomplete Data Haoyu Zhang Wenbin Wang Tianshu Yu 54 3 0 30 Sep 2024
Multi-Microphone and Multi-Modal Emotion Recognition in Reverberant Environment Ohad Cohen Gershon Hazan Sharon Gannot 45 0 0 14 Sep 2024
Brain-inspired Artificial Intelligence: A Comprehensive Review Jing Ren Xiwei Xu AI4CE 127 4 0 27 Aug 2024
A Simple Attention-Based Mechanism for Bimodal Emotion Classification Mazen Elabd S. Jaf 26 0 0 28 Jun 2024
Speech2UnifiedExpressions: Synchronous Synthesis of Co-Speech Affective Face and Body Expressions from Affordable Inputs Uttaran Bhattacharya Aniket Bera Dinesh Manocha CVBM 70 2 0 26 Jun 2024
AVFF: Audio-Visual Feature Fusion for Video Deepfake Detection Trevine Oorloff Surya Koppisetti Nicolo Bonettini Divyaraj Solanki Ben Colman Yaser Yacoob Ali Shahriyari Gaurav Bharaj 99 26 0 05 Jun 2024
Detail-Enhanced Intra- and Inter-modal Interaction for Audio-Visual Emotion Recognition Tong Shi Xuri Ge Joemon M. Jose Nicolas Pugeault Paul Henderson 93 0 0 26 May 2024
SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversations Fanfan Wang Heqing Ma Jianfei Yu Rui Xia Erik Cambria 99 24 0 19 May 2024
TCAN: Text-oriented Cross Attention Network for Multimodal Sentiment Analysis Ming Zhou Yunfei Feng Ziqi Zhou Kai Wang Tong Wang Dong-ming Yan 82 0 0 06 Apr 2024
Robust Emotion Recognition in Context Debiasing Dingkang Yang Kun Yang Mingcheng Li Shunli Wang Shuai Wang Lihua Zhang 99 18 0 09 Mar 2024
Medical Speech Symptoms Classification via Disentangled Representation Jianzong Wang Pengcheng Li Xulong Zhang Ning Cheng Jing Xiao 47 0 0 08 Mar 2024
Triple Disentangled Representation Learning for Multimodal Affective Analysis Ying Zhou Xuefeng Liang Han Chen Yin Zhao Xin Chen Lida Yu 76 3 0 29 Jan 2024
Accommodating Missing Modalities in Time-Continuous Multimodal Emotion Recognition Juan Vazquez-Rodriguez G. Lefebvre Julien Cumin James L. Crowley 56 2 0 16 Nov 2023
Prompting Visual-Language Models for Dynamic Facial Expression Recognition Zengqun Zhao Ioannis Patras VLM 91 34 0 25 Aug 2023
When Measures are Unreliable: Imperceptible Adversarial Perturbations toward Top- $k$ Multi-Label Learning Yuchen Sun Qianqian Xu Zitai Wang Qingming Huang AAML 107 1 0 27 Jul 2023
EMERSK -- Explainable Multimodal Emotion Recognition with Situational Knowledge M. Palash Bharat K. Bhargava CVBM 85 7 0 14 Jun 2023
UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning Heqing Zou Meng Shen Chen Chen Yuchen Hu D. Rajan Chng Eng Siong SSL 100 17 0 16 May 2023
Noise-Resistant Multimodal Transformer for Emotion Recognition Y. Liu Haoyu Zhang Yibing Zhan Zijing Chen Guanghao Yin Lin Wei Zhe Chen ViT 64 5 0 04 May 2023
HCAM -- Hierarchical Cross Attention Model for Multi-modal Emotion Recognition Soumya Dutta Sriram Ganapathy 113 18 0 14 Apr 2023
Using Auxiliary Tasks In Multimodal Fusion Of Wav2vec 2.0 And BERT For Multimodal Emotion Recognition Dekai Sun Yancheng He Jiqing Han 56 19 0 27 Feb 2023
Ring That Bell: A Corpus and Method for Multimodal Metaphor Detection in Videos Khalid Alnajjar Mika Hämäläinen Shuo Zhang 68 8 0 15 Dec 2022
Leveraging Modality-specific Representations for Audio-visual Speech Recognition via Reinforcement Learning Chen Chen Yuchen Hu Qiang Zhang Heqing Zou Beier Zhu Eng Siong Chng 84 28 0 10 Dec 2022
Deep Insights of Learning based Micro Expression Recognition: A Perspective on Promises, Challenges and Research Needs Monu Verma Santosh Kumar Vipparthi Girdhari Singh HAI 74 7 0 10 Oct 2022
Multimodal Emotion Recognition with Modality-Pairwise Unsupervised Contrastive Loss Riccardo Franceschini Enrico Fini Cigdem Beyan Alessandro Conti F. Arrigoni Elisa Ricci SSL OffRL 71 16 0 23 Jul 2022
NR-DFERNet: Noise-Robust Network for Dynamic Facial Expression Recognition Hanting Li Ming-Fa Sui Zhaoqing Zhu Feng Zhao 67 29 0 10 Jun 2022
Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors Yang Wu Yanyan Zhao Hao Yang Songmin Chen Bing Qin Xiaohuan Cao Wenting Zhao 58 21 0 01 Mar 2022
A Review on Methods and Applications in Multimodal Deep Learning Summaira Jabeen Xi Li Muhammad Shoib Amin Abdul Jabbar VLM HAI 73 101 0 18 Feb 2022
CALM: Contrastive Aligned Audio-Language Multirate and Multimodal Representations Vin Sachidananda Shao-Yen Tseng Erik Marchi S. Kajarekar P. Georgiou 64 9 0 08 Feb 2022
Speech Emotion Recognition using Self-Supervised Features E. Morais R. Hoory Weizhong Zhu Itai Gat Matheus Damasceno Hagai Aronowitz SSL MDE 56 118 0 07 Feb 2022
Interpretability for Multimodal Emotion Recognition using Concept Activation Vectors Ashish Ramayee Asokan Nidarshan Kumar Anirudh Venkata Ragam S. Sharath 91 19 0 02 Feb 2022
Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition Yi Zhang Mingyuan Chen Jundong Shen Chongjun Wang 82 65 0 15 Jan 2022
An empirical user-study of text-based nonverbal annotation systems for human-human conversations Joshua Y. Kim K. Yacef 43 1 0 30 Dec 2021
Transfer Learning in Conversational Analysis through Reusing Preprocessing Data as Supervisors Joshua Y. Kim Tongliang Liu K. Yacef 54 0 0 02 Dec 2021
How Speech is Recognized to Be Emotional - A Study Based on Information Decomposition Haoran Sun Lantian Li Tianshi Zheng Dong Wang CVBM 41 0 0 24 Nov 2021
A Comparative Study of Speaker Role Identification in Air Traffic Communication Using Deep Learning Approaches Dongyue Guo Jianwei Zhang Bo Yang Yi Lin 56 11 0 03 Nov 2021
HighlightMe: Detecting Highlights from Human-Centric Videos Uttaran Bhattacharya Gang Wu Stefano Petrangeli Viswanathan Swaminathan Tianyi Zhou 65 10 0 05 Oct 2021
HetEmotionNet: Two-Stream Heterogeneous Graph Recurrent Neural Network for Multi-modal Emotion Recognition Ziyu Jia Youfang Lin Jing Wang Zhiyang Feng Xiangheng Xie Caijie Chen 83 87 0 07 Aug 2021
Exploiting BERT For Multimodal Target Sentiment Classification Through Input Space Translation Zaid Khan Y. Fu 81 140 0 03 Aug 2021
Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis Wei Han Hui Chen Alexander Gelbukh Amir Zadeh Louis-Philippe Morency Soujanya Poria 70 184 0 28 Jul 2021
Modality Fusion Network and Personalized Attention in Momentary Stress Detection in the Wild Han Yu T. Vaessen I. Myin‐Germeys Akane Sano 47 13 0 19 Jul 2021
Key-Sparse Transformer for Multimodal Speech Emotion Recognition Weidong Chen Xiaofen Xing Xiangmin Xu Jichen Yang Jianxin Pang 72 51 0 22 Jun 2021
Recent Advances and Trends in Multimodal Deep Learning: A Review Jabeen Summaira Xi Li Amin Muhammad Shoib Songyuan Li Abdul Jabbar HAI 229 59 0 24 May 2021
M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers Tianrui Guan Jun Wang Shiyi Lan Rohan Chandra Zuxuan Wu Larry S. Davis Tianyi Zhou ViT 3DPC 88 123 0 24 Apr 2021
SFE-Net: EEG-based Emotion Recognition with Symmetrical Spatial Feature Extraction Xiangwen Deng Ju-xia Zhu Shangming Yang 58 31 0 09 Apr 2021
Privacy-Preserving Video Classification with Convolutional Neural Networks Sikha Pentyala Rafael Dowsley Martine De Cock PICV 95 21 0 06 Feb 2021