v1v2 (latest)

Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

28 July 2021

Louis-Philippe Morency

Soujanya Poria

ArXiv (abs)PDF HTML Github (840★)

Papers citing "Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis"

30 / 30 papers shown

Title
Multimodal Emotion Recognition using Audio-Video Transformer Fusion with Cross Attention Joe Dhanith Shravan Venkatraman Modigari Narendra Vigya Sharma Santhosh Malarvannan 137 0 0 20 Feb 2025
TCAN: Text-oriented Cross Attention Network for Multimodal Sentiment Analysis Ming Zhou Yunfei Feng Ziqi Zhou Kai Wang Tong Wang Dong-ming Yan 68 0 0 06 Apr 2024
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion Xing Han Huy Nguyen Carl Harris Nhat Ho Suchi Saria MoE 111 22 0 05 Feb 2024
Multimodal Deep Learning Cem Akkus Jiquan Ngiam Vladana Djakovic Steffen Jauch-Walser A. Khosla ... Jann Goschenhofer Honglak Lee A. Ng Daniel Schalk Matthias Aßenmacher 120 3,176 0 12 Jan 2023
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 670 41,430 0 22 Oct 2020
Visually Grounded Compound PCFGs Yanpeng Zhao Ivan Titov 70 45 0 25 Sep 2020
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis Devamanyu Hazarika Roger Zimmermann Soujanya Poria 80 707 0 07 May 2020
Unsupervised Multimodal Neural Machine Translation with Pseudo Visual Pivoting Po-Yao (Bernie) Huang Junjie Hu Xiaojun Chang Alexander G. Hauptmann 90 52 0 06 May 2020
Learning Relationships between Text, Audio, and Video via Deep Canonical Correlation for Multimodal Language Analysis Zhongkai Sun P. Sarma W. Sethares Yingyu Liang 74 325 0 13 Nov 2019
M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues Trisha Mittal Uttaran Bhattacharya Rohan Chandra Aniket Bera Tianyi Zhou 75 240 0 09 Nov 2019
Multi-modal Sentiment Analysis using Deep Canonical Correlation Analysis Zhongkai Sun P. Sarma W. Sethares E. Bucy 47 23 0 15 Jul 2019
Improving Zero-shot Translation with Language-Independent Constraints Ngoc-Quan Pham Jan Niehues Thanh-Le Ha A. Waibel 70 61 0 20 Jun 2019
Visually Grounded Neural Syntax Acquisition Freda Shi Jiayuan Mao Kevin Gimpel Karen Livescu NAI 69 85 0 07 Jun 2019
Multimodal Transformer for Unaligned Multimodal Language Sequences Yao-Hung Hubert Tsai Shaojie Bai Paul Pu Liang J. Zico Kolter Louis-Philippe Morency Ruslan Salakhutdinov 94 1,307 0 01 Jun 2019
Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis Md. Shad Akhtar Dushyant Singh Chauhan Deepanway Ghosal Soujanya Poria Asif Ekbal P. Bhattacharyya 89 168 0 14 May 2019
Complementary Fusion of Multi-Features and Multi-Modalities in Sentiment Analysis Feiyang Chen Ziqian Luo Yanyan Xu Dengfeng Ke 52 76 0 17 Apr 2019
UR-FUNNY: A Multimodal Language Dataset for Understanding Humor M. Hasan Wasifur Rahman Amir Zadeh Jianyuan Zhong Md. Iftekhar Tanveer Louis-Philippe Morency Mohammed Ehsan Hoque 72 185 0 14 Apr 2019
Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between Modalities Hai Pham Paul Pu Liang Thomas Manzini Louis-Philippe Morency Barnabás Póczós 74 412 0 19 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Learning Visually-Grounded Semantics from Contrastive Adversarial Samples Freda Shi Jiayuan Mao Tete Xiao Yuning Jiang Jian Sun ObjD 78 51 0 27 Jun 2018
Learning Factorized Multimodal Representations Yao-Hung Hubert Tsai Paul Pu Liang Amir Zadeh Louis-Philippe Morency Ruslan Salakhutdinov DRL 110 408 0 16 Jun 2018
Efficient Low-rank Multimodal Fusion with Modality-Specific Factors Zhun Liu Ying Shen V. Lakshminarasimhan Paul Pu Liang Amir Zadeh Louis-Philippe Morency 67 648 0 31 May 2018
Multimodal Affective Analysis Using Hierarchical Attention Strategy with Word-Level Alignment Yue Gu Kangning Yang Shiyu Fu Shuhong Chen Xinyu Li I. Marsic 64 124 0 22 May 2018
Multimodal Named Entity Recognition for Short Social Media Posts Seungwhan Moon Leonardo Neves Vitor R. Carvalho 67 155 0 22 Feb 2018
Multimodal Sentiment Analysis with Word-Level Fusion and Reinforcement Learning Minghai Chen Sen Wang Paul Pu Liang T. Baltrušaitis Amir Zadeh Louis-Philippe Morency 66 281 0 03 Feb 2018
Multi-attention Recurrent Network for Human Communication Comprehension Amir Zadeh Paul Pu Liang Soujanya Poria Prateek Vij Min Zhang Louis-Philippe Morency 77 485 0 03 Feb 2018
Tensor Fusion Network for Multimodal Sentiment Analysis Amir Zadeh Minghai Chen Soujanya Poria Min Zhang Louis-Philippe Morency 85 1,236 0 23 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
Select-Additive Learning: Improving Generalization in Multimodal Sentiment Analysis Haohan Wang Aaksha Meghawat Louis-Philippe Morency Eric Xing 79 154 0 16 Sep 2016
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling Junyoung Chung Çağlar Gülçehre Kyunghyun Cho Yoshua Bengio 601 12,741 0 11 Dec 2014