Learning Relationships between Text, Audio, and Video via Deep Canonical Correlation for Multimodal Language Analysis

13 November 2019

Papers citing "Learning Relationships between Text, Audio, and Video via Deep Canonical Correlation for Multimodal Language Analysis"

37 / 37 papers shown

Title
Conditional Deep Canonical Time Warping Afek Steinberg Ran Eisenberg Ofir Lindenbaum AI4TS 34 0 0 10 Jan 2025
TCAN: Text-oriented Cross Attention Network for Multimodal Sentiment Analysis Ming Zhou Yunfei Feng Ziqi Zhou Kai Wang Tong Wang Dong-ming Yan 47 0 0 06 Apr 2024
Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models Weijiao Zhang Jindong Han Zhao Xu Hang Ni Hao Liu Hui Xiong Hui Xiong AI4CE 77 15 0 30 Jan 2024
Triple Disentangled Representation Learning for Multimodal Affective Analysis Ying Zhou Xuefeng Liang Han Chen Yin Zhao Xin Chen Lida Yu 52 3 0 29 Jan 2024
Cascaded Cross-Modal Transformer for Audio-Textual Classification Nicolae-Cătălin Ristea Andrei Anghel Radu Tudor Ionescu 36 2 0 15 Jan 2024
Modality-Collaborative Transformer with Hybrid Feature Reconstruction for Robust Emotion Recognition Chengxin Chen Pengyuan Zhang 38 5 0 26 Dec 2023
Modality-invariant and Specific Prompting for Multimodal Human Perception Understanding Hao Sun Ziwei Niu Xinyao Yu Jiaqing Liu Yen-Wei Chen Lanfen Lin 29 0 0 17 Nov 2023
Shared and Private Information Learning in Multimodal Sentiment Analysis with Deep Modal Alignment and Self-supervised Multi-Task Learning Songning Lai Jiakang Li Guinan Guo Xifeng Hu Yulong Li ... Yutong Liu Zhaoxia Ren Chun Wan Danmin Miao Zhi Liu SSL 36 9 0 15 May 2023
TextMI: Textualize Multimodal Information for Integrating Non-verbal Cues in Pre-trained Language Models M. Hasan Md. Saiful Islam Sangwu Lee Wasifur Rahman Iftekhar Naim Mohammed Ibrahim Khan E. Hoque VLM 26 2 0 27 Mar 2023
Effective Multimodal Reinforcement Learning with Modality Alignment and Importance Enhancement Jinming Ma Feng Wu Yingfeng Chen Xianpeng Ji Yu-qiong Ding OffRL 33 4 0 18 Feb 2023
InterMulti:Multi-view Multimodal Interactions with Text-dominated Hierarchical High-order Fusion for Emotion Analysis Feng Qiu Wanzeng Kong Yu-qiong Ding 34 2 0 20 Dec 2022
EffMulti: Efficiently Modeling Complex Multimodal Interactions for Emotion Analysis Feng Qiu Chengyang Xie Yu-qiong Ding Wanzeng Kong 16 1 0 16 Dec 2022
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition Guimin Hu Ting-En Lin Yi Zhao Guangming Lu Yuchuan Wu Yongbin Li 31 110 0 21 Nov 2022
FV2ES: A Fully End2End Multimodal System for Fast Yet Effective Video Emotion Recognition Inference Qinglan Wei Xu-Juan Huang Yuan Zhang 21 14 0 21 Sep 2022
Robust Sound-Guided Image Manipulation Seung Hyun Lee Gyeongrok Oh Wonmin Byeon Sang Ho Yoon Jinkyu Kim Sangpil Kim DiffM 26 7 0 30 Aug 2022
Cross-Modality Gated Attention Fusion for Multimodal Sentiment Analysis Ming-Xin Jiang Shaoxiong Ji 23 3 0 25 Aug 2022
Multimodal Across Domains Gaze Target Detection Francesco Tonini Cigdem Beyan Elisa Ricci 3DPC 26 20 0 23 Aug 2022
CubeMLP: An MLP-based Model for Multimodal Sentiment Analysis and Depression Estimation Hao Sun Hongyi Wang Jiaqing Liu Yen-Wei Chen Lanfen Lin 11 97 0 28 Jul 2022
GraphCFC: A Directed Graph Based Cross-Modal Feature Complementation Approach for Multimodal Conversational Emotion Recognition Jiang Li Xiaoping Wang Guoqing Lv Zhigang Zeng 39 37 0 06 Jul 2022
COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognition M. Tellamekala Shahin Amiriparian Björn W. Schuller Elisabeth André T. Giesbrecht M. Valstar 31 25 0 12 Jun 2022
i-Code: An Integrative and Composable Multimodal Learning Framework Ziyi Yang Yuwei Fang Chenguang Zhu Reid Pryzant Dongdong Chen ... Bin Xiao Yuanxun Lu Takuya Yoshioka Michael Zeng Xuedong Huang 40 45 0 03 May 2022
GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation Zheng Lian Lang Chen Guoying Zhao B. Liu J. Tao 25 83 0 04 Mar 2022
Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition Yi Zhang Mingyuan Chen Jundong Shen Chongjun Wang 21 59 0 15 Jan 2022
Sound-Guided Semantic Image Manipulation Seung Hyun Lee Wonseok Roh Wonmin Byeon Sang Ho Yoon Chanyoung Kim Jinkyu Kim Sangpil Kim DiffM 27 43 0 30 Nov 2021
SMOF: Squeezing More Out of Filters Yields Hardware-Friendly CNN Pruning Yanli Liu Bochen Guan Qinwen Xu Weiyi Li Shuxue Quan 33 2 0 21 Oct 2021
TEASEL: A Transformer-Based Speech-Prefixed Language Model Mehdi Arjmand M. Dousti H. Moradi 33 18 0 12 Sep 2021
Self-supervised Contrastive Cross-Modality Representation Learning for Spoken Question Answering Chenyu You Nuo Chen Yuexian Zou SSL 27 62 0 08 Sep 2021
Hybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysis Sijie Mai Ying Zeng Shuangjia Zheng Haifeng Hu 21 116 0 04 Sep 2021
Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis Wei Han Hui Chen Soujanya Poria 37 316 0 01 Sep 2021
Improving Multimodal fusion via Mutual Dependency Maximisation Pierre Colombo E. Chapuis Matthieu Labeau Chloé Clavel 13 30 0 31 Aug 2021
Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis Wei Han Hui Chen Alexander Gelbukh Amir Zadeh Louis-Philippe Morency Soujanya Poria 24 175 0 28 Jul 2021
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning Paul Pu Liang Yiwei Lyu Xiang Fan Zetian Wu Yun Cheng ... Peter Wu Michelle A. Lee Yuke Zhu Ruslan Salakhutdinov Louis-Philippe Morency VLM 32 159 0 15 Jul 2021
Video Sentiment Analysis with Bimodal Information-augmented Multi-Head Attention Ting-Wei Wu Jun-jie Peng Wenqiang Zhang Huiran Zhang Chuan Ma Yansong Huang 30 84 0 03 Mar 2021
Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis Wenmeng Yu Hua Xu Ziqi Yuan Jiele Wu SSL 52 441 0 09 Feb 2021
Look Before you Speak: Visually Contextualized Utterances Paul Hongsuck Seo Arsha Nagrani Cordelia Schmid 21 66 0 10 Dec 2020
Contextualized Attention-based Knowledge Transfer for Spoken Conversational Question Answering Chenyu You Nuo Chen Yuexian Zou 11 36 0 21 Oct 2020
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis Devamanyu Hazarika Roger Zimmermann Soujanya Poria 21 669 0 07 May 2020