Efficient Low-rank Multimodal Fusion with Modality-Specific Factors

31 May 2018

Louis-Philippe Morency

ArXiv PDF HTML

Papers citing "Efficient Low-rank Multimodal Fusion with Modality-Specific Factors"

29 / 79 papers shown

Title
Multimodal Driver Referencing: A Comparison of Pointing to Objects Inside and Outside the Vehicle Abdul Rafey Aftab M. V. D. Beeck 12 3 0 15 Feb 2022
MMLatch: Bottom-up Top-down Fusion for Multimodal Sentiment Analysis Georgios Paraskevopoulos Efthymios Georgiou Alexandros Potamianos 19 26 0 24 Jan 2022
Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition Yi Zhang Mingyuan Chen Jundong Shen Chongjun Wang 21 59 0 15 Jan 2022
Which is Making the Contribution: Modulating Unimodal and Cross-modal Dynamics for Multimodal Sentiment Analysis Ying Zeng Sijie Mai Haifeng Hu 24 19 0 10 Nov 2021
A Multimodal Sentiment Dataset for Video Recommendation Hongxuan Tang Hao Liu Xinyan Xiao Hua Wu VGen 13 2 0 17 Sep 2021
TEASEL: A Transformer-Based Speech-Prefixed Language Model Mehdi Arjmand M. Dousti H. Moradi 33 18 0 12 Sep 2021
Hybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysis Sijie Mai Ying Zeng Shuangjia Zheng Haifeng Hu 21 117 0 04 Sep 2021
Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis Wei Han Hui Chen Soujanya Poria 37 316 0 01 Sep 2021
Improving Multimodal fusion via Mutual Dependency Maximisation Pierre Colombo E. Chapuis Matthieu Labeau Chloé Clavel 15 30 0 31 Aug 2021
Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis Wei Han Hui Chen Alexander Gelbukh Amir Zadeh Louis-Philippe Morency Soujanya Poria 24 175 0 28 Jul 2021
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning Paul Pu Liang Yiwei Lyu Xiang Fan Zetian Wu Yun Cheng ... Peter Wu Michelle A. Lee Yuke Zhu Ruslan Salakhutdinov Louis-Philippe Morency VLM 32 159 0 15 Jul 2021
A Review on Explainability in Multimodal Deep Neural Nets Gargi Joshi Rahee Walambe K. Kotecha 29 139 0 17 May 2021
Towards A Multi-agent System for Online Hate Speech Detection Gaurav Sahu R. Cohen Olga Vechtomova 16 9 0 03 May 2021
Weakly-supervised Multi-task Learning for Multimodal Affect Recognition Wenliang Dai Samuel Cahyawijaya Yejin Bang Pascale Fung CVBM 36 11 0 23 Apr 2021
SMIL: Multimodal Learning with Severely Missing Modality Mengmeng Ma Jian Ren Long Zhao Sergey Tulyakov Cathy H. Wu Xi Peng 49 239 0 09 Mar 2021
Video Sentiment Analysis with Bimodal Information-augmented Multi-Head Attention Ting-Wei Wu Jun-jie Peng Wenqiang Zhang Huiran Zhang Chuan Ma Yansong Huang 30 84 0 03 Mar 2021
Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis Wenmeng Yu Hua Xu Ziqi Yuan Jiele Wu SSL 52 441 0 09 Feb 2021
Deep-HOSeq: Deep Higher Order Sequence Fusion for Multimodal Sentiment Analysis Sunny Verma Jiwei Wang Zhefeng Ge Rujia Shen Fan Jin Yang Wang Fang Chen Wei Liu 29 20 0 16 Oct 2020
Multi-modal Attention for Speech Emotion Recognition Zexu Pan Zhaojie Luo Jichen Yang Haizhou Li CVBM 22 71 0 09 Sep 2020
Learning Modality Interaction for Temporal Sentence Localization and Event Captioning in Videos Shaoxiang Chen Wenhao Jiang Wei Liu Yu-Gang Jiang 25 101 0 28 Jul 2020
Low Rank Fusion based Transformers for Multimodal Sequences Saurav Sahay Eda Okur Shachi H. Kumar L. Nachman ViT 16 61 0 04 Jul 2020
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis Devamanyu Hazarika Roger Zimmermann Soujanya Poria 21 669 0 07 May 2020
Modality to Modality Translation: An Adversarial Representation Learning and Graph Fusion Network for Multimodal Fusion Sijie Mai Haifeng Hu Songlong Xing GAN 32 182 0 18 Nov 2019
Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization Paul Pu Liang Zhun Liu Yao-Hung Hubert Tsai Qibin Zhao Ruslan Salakhutdinov Louis-Philippe Morency AI4TS 30 81 0 01 Jul 2019
UR-FUNNY: A Multimodal Language Dataset for Understanding Humor M. Hasan Wasifur Rahman Amir Zadeh Jianyuan Zhong Md. Iftekhar Tanveer Louis-Philippe Morency Mohammed Ehsan Hoque 21 180 0 14 Apr 2019
Multimodal Speech Emotion Recognition and Ambiguity Resolution Gaurav Sahu 14 47 0 12 Apr 2019
Multimodal Language Analysis with Recurrent Multistage Fusion Paul Pu Liang Liu Ziyin Amir Zadeh Louis-Philippe Morency 30 198 0 12 Aug 2018
Learning Factorized Multimodal Representations Yao-Hung Hubert Tsai Paul Pu Liang Amir Zadeh Louis-Philippe Morency Ruslan Salakhutdinov DRL 63 402 0 16 Jun 2018
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding Akira Fukui Dong Huk Park Daylen Yang Anna Rohrbach Trevor Darrell Marcus Rohrbach 167 1,464 0 06 Jun 2016