Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition

18 November 2023

Papers citing "Joyful: Joint Modality Fusion and Graph Contrastive Learning for Multimodal Emotion Recognition"

33 / 33 papers shown

Title
Summary-Oriented Vision Modeling for Multimodal Abstractive Summarization Yunlong Liang Fandong Meng Jinan Xu Jiaan Wang Jinan Xu Jie Zhou 67 22 0 15 Dec 2022
Multimodal Token Fusion for Vision Transformers Yikai Wang Xinghao Chen Lele Cao Wen-bing Huang Gang Hua Yunhe Wang ViT 87 181 0 19 Apr 2022
MM-DFN: Multimodal Dynamic Fusion Network for Emotion Recognition in Conversations Dou Hu Xiaolong Hou Lingwei Wei Lian-Xin Jiang Yang Mo 80 124 0 04 Mar 2022
Is Cross-Attention Preferable to Self-Attention for Multi-Modal Emotion Recognition? Vandana Rajan Alessio Brutti Andrea Cavallaro 76 35 0 18 Feb 2022
Contrast and Generation Make BART a Good Dialogue Emotion Recognizer Shimin Li Hang Yan Xipeng Qiu 72 86 0 21 Dec 2021
InfoGCL: Information-Aware Graph Contrastive Learning Dongkuan Xu Wei Cheng Dongsheng Luo Haifeng Chen Xiang Zhang 61 200 0 28 Oct 2021
Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis Wei Han Hui Chen Soujanya Poria 72 338 0 01 Sep 2021
N24News: A New Dataset for Multimodal News Classification Zhen Wang Xu Shan Xiangxie Zhang Jie Yang VLM 74 38 0 30 Aug 2021
Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis Wei Han Hui Chen Alexander Gelbukh Amir Zadeh Louis-Philippe Morency Soujanya Poria 54 182 0 28 Jul 2021
Attention Bottlenecks for Multimodal Fusion Arsha Nagrani Shan Yang Anurag Arnab A. Jansen Cordelia Schmid Chen Sun 100 569 0 30 Jun 2021
DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations Dou Hu Lingwei Wei X. Huai 74 197 0 03 Jun 2021
Directed Acyclic Graph Network for Conversational Emotion Recognition Weizhou Shen Siyue Wu Yunyi Yang Xiaojun Quan 77 243 0 27 May 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 274 3,407 0 18 Apr 2021
Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis Wenmeng Yu Hua Xu Ziqi Yuan Jiele Wu SSL 101 464 0 09 Feb 2021
Recognizing Emotion Cause in Conversations Soujanya Poria Navonil Majumder Devamanyu Hazarika Deepanway Ghosal Rishabh Bhardwaj ... Romila Ghosh Abhinaba Roy Niyati Chhaya Alexander Gelbukh Rada Mihalcea 88 129 0 22 Dec 2020
DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognition Weizhou Shen Junqing Chen Xiaojun Quan Zhixiang Xie 80 206 0 16 Dec 2020
COSMIC: COmmonSense knowledge for eMotion Identification in Conversations Deepanway Ghosal Navonil Majumder Alexander Gelbukh Rada Mihalcea Soujanya Poria 102 320 0 06 Oct 2020
A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis Jean-Benoit Delbrouck Noé Tits Mathilde Brousmiche Stéphane Dupont 68 112 0 29 Jun 2020
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis Devamanyu Hazarika Roger Zimmermann Soujanya Poria 73 707 0 07 May 2020
Real-Time Emotion Recognition via Attention Gated Hierarchical Memory Network Wenxiang Jiao Michael R. Lyu Irwin King 68 120 0 20 Nov 2019
DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation Deepanway Ghosal Navonil Majumder Soujanya Poria Niyati Chhaya Alexander Gelbukh 88 513 0 30 Aug 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,295 0 27 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 674 24,528 0 26 Jul 2019
Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advances Soujanya Poria Navonil Majumder Rada Mihalcea Eduard H. Hovy 50 360 0 08 May 2019
Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors Yansen Wang Ying Shen Zhun Liu Paul Pu Liang Amir Zadeh Louis-Philippe Morency 73 402 0 23 Nov 2018
DialogueRNN: An Attentive RNN for Emotion Detection in Conversations Navonil Majumder Soujanya Poria Devamanyu Hazarika Rada Mihalcea Alexander Gelbukh Min Zhang 64 722 0 01 Nov 2018
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations Soujanya Poria Devamanyu Hazarika Navonil Majumder Gautam Naik Min Zhang Rada Mihalcea 109 1,075 0 05 Oct 2018
Adafactor: Adaptive Learning Rates with Sublinear Memory Cost Noam M. Shazeer Mitchell Stern ODL 84 1,051 0 11 Apr 2018
Tensor Fusion Network for Multimodal Sentiment Analysis Amir Zadeh Minghai Chen Soujanya Poria Min Zhang Louis-Philippe Morency 82 1,236 0 23 Jul 2017
Inductive Representation Learning on Large Graphs William L. Hamilton Z. Ying J. Leskovec 509 15,300 0 07 Jun 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 652 29,154 0 09 Sep 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 775 36,861 0 25 Aug 2016
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 635 13,431 0 25 Aug 2014