Memory Fusion Network for Multi-view Sequential Learning

3 February 2018

Louis-Philippe Morency

ArXiv PDF HTML

Papers citing "Memory Fusion Network for Multi-view Sequential Learning"

50 / 181 papers shown

Title
Deep Equilibrium Multimodal Fusion Jinhong Ni Yalong Bai Wei Zhang Ting Yao Tao Mei 28 1 0 29 Jun 2023
A Low-rank Matching Attention based Cross-modal Feature Fusion Method for Conversational Emotion Recognition Yun-Xu Shou Xiangyong Cao Deyu Meng B. Dong Qinghua Zheng 16 48 0 16 Jun 2023
Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion Shao-Yu Wu Damai Dai Ziwei Qin Tianyu Liu Binghuai Lin Yunbo Cao Zhifang Sui 31 6 0 24 May 2023
Cross-Attention is Not Enough: Incongruity-Aware Dynamic Hierarchical Fusion for Multimodal Affect Recognition Yaoting Wang Yuanchao Li Paul Pu Liang Louis-Philippe Morency P. Bell Catherine Lai CVBM 28 8 0 23 May 2023
HCAM -- Hierarchical Cross Attention Model for Multi-modal Emotion Recognition Soumya Dutta Sriram Ganapathy 24 15 0 14 Apr 2023
TextMI: Textualize Multimodal Information for Integrating Non-verbal Cues in Pre-trained Language Models M. Hasan Md. Saiful Islam Sangwu Lee Wasifur Rahman Iftekhar Naim Mohammed Ibrahim Khan E. Hoque VLM 23 2 0 27 Mar 2023
Decoupled Multimodal Distilling for Emotion Recognition Yong Li Yuan-Zheng Wang Zhen Cui 19 73 0 24 Mar 2023
CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Data Junyi Ma Guang-ming Xiong Jingyi Xu Xieyuanli Chen ViT 24 31 0 03 Feb 2023
Bridging the Emotional Semantic Gap via Multimodal Relevance Estimation Chuan Zhang Daoxin Zhang Ruixiu Zhang Jiawei Li Jianke Zhu 33 1 0 03 Feb 2023
InterMulti:Multi-view Multimodal Interactions with Text-dominated Hierarchical High-order Fusion for Emotion Analysis Feng Qiu Wanzeng Kong Yu-qiong Ding 34 2 0 20 Dec 2022
EffMulti: Efficiently Modeling Complex Multimodal Interactions for Emotion Analysis Feng Qiu Chengyang Xie Yu-qiong Ding Wanzeng Kong 16 1 0 16 Dec 2022
Ring That Bell: A Corpus and Method for Multimodal Metaphor Detection in Videos Khalid Alnajjar Mika Hämäläinen Shuo Zhang 27 7 0 15 Dec 2022
Curriculum Learning Meets Weakly Supervised Modality Correlation Learning Sijie Mai Ya Sun Haifeng Hu 37 2 0 15 Dec 2022
Multimodal Query-guided Object Localization Aditay Tripathi Rajath R Dani Anand Mishra Anirban Chakraborty 22 0 0 01 Dec 2022
FAF: A novel multimodal emotion recognition approach integrating face, body and text Zhongyu Fang Aoyun He Qihui Yu Baopeng Gao Weiping Ding Tong Zhang Lei Ma CVBM 11 3 0 20 Nov 2022
A Self-Adjusting Fusion Representation Learning Model for Unaligned Text-Audio Sequences Kaicheng Yang Ruxuan Zhang Hua Xu Kai Gao 23 3 0 12 Nov 2022
Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations Sijie Mai Ying Zeng Haifeng Hu 37 67 0 31 Oct 2022
M $^3$ Care: Learning with Missing Modalities in Multimodal Healthcare Data Chaohe Zhang Xu Chu Liantao Ma Yinghao Zhu Yasha Wang Jiangtao Wang Junfeng Zhao 26 78 0 28 Oct 2022
Multimodal Contrastive Learning via Uni-Modal Coding and Cross-Modal Prediction for Multimodal Sentiment Analysis Ronghao Lin Haifeng Hu SSL 23 15 0 26 Oct 2022
Extending Compositional Attention Networks for Social Reasoning in Videos Christina Sartzetaki Georgios Paraskevopoulos Alexandros Potamianos LRM 23 3 0 03 Oct 2022
Hybrid Multimodal Fusion for Humor Detection Hao Xu Weifeng Liu Jingwei Liu Mingzheng Li Yu Feng Yasi Peng Yunwei Shi Xiao Sun Meng Wang 32 20 0 24 Sep 2022
MIntRec: A New Dataset for Multimodal Intent Recognition Hanlei Zhang Huanlin Xu Xin Eric Wang Qianrui Zhou Shaojie Zhao Jiayan Teng 38 39 0 09 Sep 2022
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 18 60 0 07 Sep 2022
Trust in Language Grounding: a new AI challenge for human-robot teams David M. Bossens C. Evers 36 1 0 05 Sep 2022
Progressive Fusion for Multimodal Integration Shiv Shankar Laure Thompson M. Fiterau 31 3 0 01 Sep 2022
Cross-Modality Gated Attention Fusion for Multimodal Sentiment Analysis Ming-Xin Jiang Shaoxiong Ji 23 3 0 25 Aug 2022
Multimodal Crop Type Classification Fusing Multi-Spectral Satellite Time Series with Farmers Crop Rotations and Local Crop Distribution Valentin Barrière M. Claverie 21 4 0 23 Aug 2022
Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module Yih-Ling Liu Ziqi Yuan Huisheng Mao Zhiyun Liang Wanqiuyue Yang Yuanzhe Qiu Tie Cheng Xiaoteng Li Hua Xu Kai Gao 29 44 0 22 Aug 2022
CMSBERT-CLR: Context-driven Modality Shifting BERT with Contrastive Learning for linguistic, visual, acoustic Representations Junghun Kim Jihie Kim 25 2 0 21 Aug 2022
Representation Learning with Graph Neural Networks for Speech Emotion Recognition Junghun Kim Jihie Kim SSL GNN 21 5 0 21 Aug 2022
Learning in Audio-visual Context: A Review, Analysis, and New Perspective Yake Wei Di Hu Yapeng Tian Xuelong Li 46 55 0 20 Aug 2022
Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis Guoying Zhao Zheng Lian B. Liu Jianhua Tao 35 47 0 16 Aug 2022
Face-to-Face Contrastive Learning for Social Intelligence Question-Answering Alex Wilf Qianli Ma Paul Pu Liang Amir Zadeh Louis-Philippe Morency 36 10 0 29 Jul 2022
CubeMLP: An MLP-based Model for Multimodal Sentiment Analysis and Depression Estimation Hao Sun Hongyi Wang Jiaqing Liu Yen-Wei Chen Lanfen Lin 11 97 0 28 Jul 2022
Memory-Guided Multi-View Multi-Domain Fake News Detection Yongchun Zhu Qiang Sheng Juan Cao Qiong Nan Kai Shu Ming-hui Wu Jindong Wang Fuzhen Zhuang 24 74 0 26 Jun 2022
Defending Multimodal Fusion Models against Single-Source Adversaries Karren D. Yang Wan-Yi Lin M. Barman Filipe Condessa Zico Kolter AAML 16 30 0 25 Jun 2022
COGMEN: COntextualized GNN based Multimodal Emotion recognitioN Abhinav Joshi A. Bhat Ayush Jain Atinesh Singh Ashutosh Modi 11 76 0 05 May 2022
Brainish: Formalizing A Multimodal Language for Intelligence and Consciousness Paul Pu Liang 22 4 0 14 Apr 2022
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis Huisheng Mao Ziqi Yuan Hua Xu Wenmeng Yu Yihe Liu Kai Gao 22 41 0 23 Mar 2022
Transformer-based Multimodal Information Fusion for Facial Expression Analysis Wei Zhang Feng Qiu Suzhe Wang Hao Zeng Zhimeng Zhang Rudong An Bowen Ma Yu-qiong Ding CVBM 22 88 0 23 Mar 2022
MM-DFN: Multimodal Dynamic Fusion Network for Emotion Recognition in Conversations Dou Hu Xiaolong Hou Lingwei Wei Lian-Xin Jiang Yang Mo 21 115 0 04 Mar 2022
Multi-channel Attentive Graph Convolutional Network With Sentiment Fusion For Multimodal Sentiment Analysis Luwei Xiao Xingjiao Wu Wen Wu Jing Yang Liangbo He 21 15 0 25 Jan 2022
Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition Yi Zhang Mingyuan Chen Jundong Shen Chongjun Wang 21 59 0 15 Jan 2022
Multimodal Representations Learning Based on Mutual Information Maximization and Minimization and Identity Embedding for Multimodal Sentiment Analysis Jiahao Zheng Sen Zhang Xiaoping Wang Zhigang Zeng 14 7 0 10 Jan 2022
Shapes of Emotions: Multimodal Emotion Recognition in Conversations via Emotion Shifts Harsh Agarwal Keshav Bansal Abhinav Joshi Ashutosh Modi 16 17 0 03 Dec 2021
ScaleVLAD: Improving Multimodal Sentiment Analysis via Multi-Scale Fusion of Locally Descriptors Huaishao Luo Lei Ji Yanyong Huang Bin Wang Shenggong Ji Tianrui Li 25 21 0 02 Dec 2021
Transfer Learning in Conversational Analysis through Reusing Preprocessing Data as Supervisors Joshua Y. Kim Tongliang Liu K. Yacef 22 0 0 02 Dec 2021
Sparse Fusion for Multimodal Transformers Yi Ding Alex Rich Mason Wang Noah Stier M. Turk P. Sen Tobias Höllerer ViT 27 7 0 23 Nov 2021
Which is Making the Contribution: Modulating Unimodal and Cross-modal Dynamics for Multimodal Sentiment Analysis Ying Zeng Sijie Mai Haifeng Hu 21 19 0 10 Nov 2021
MEmoBERT: Pre-training Model with Prompt-based Learning for Multimodal Emotion Recognition Jinming Zhao Ruichen Li Qin Jin Xinchao Wang Haizhou Li 19 25 0 27 Oct 2021