Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module

22 August 2022

Papers citing "Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module"

30 / 30 papers shown

Title
Balanced Multimodal Learning via On-the-fly Gradient Modulation Xiaokang Peng Yake Wei Andong Deng Dong Wang Di Hu 75 213 0 29 Mar 2022
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis Huisheng Mao Ziqi Yuan Hua Xu Wenmeng Yu Yihe Liu Kai Gao 86 46 0 23 Mar 2022
Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors Yang Wu Yanyan Zhao Hao Yang Songmin Chen Bing Qin Xiaohuan Cao Wenting Zhao 49 20 0 01 Mar 2022
ScaleVLAD: Improving Multimodal Sentiment Analysis via Multi-Scale Fusion of Locally Descriptors Huaishao Luo Lei Ji Yanyong Huang Bin Wang Shenggong Ji Tianrui Li 44 22 0 02 Dec 2021
Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis Wei Han Hui Chen Soujanya Poria 74 338 0 01 Sep 2021
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning Paul Pu Liang Yiwei Lyu Xiang Fan Zetian Wu Yun Cheng ... Peter Wu Michelle A. Lee Yuke Zhu Ruslan Salakhutdinov Louis-Philippe Morency VLM 94 171 0 15 Jul 2021
Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection Ruijie Tao Zexu Pan Rohan Kumar Das Xinyuan Qian Mike Zheng Shou Haizhou Li 74 181 0 14 Jul 2021
SSMix: Saliency-Based Span Mixup for Text Classification Soyoung Yoon Gyuwan Kim Kyumin Park 59 71 0 15 Jun 2021
On the Impact of Word Error Rate on Acoustic-Linguistic Speech Emotion Recognition: An Update for the Deep Learning Era Shahin Amiriparian Artem Sokolov Ilhan Aslan Lukas Christ Maurice Gerczuk ... M. Milling Sandra Ottl Ilya Poduremennykh E. Shuranov Björn W. Schuller 58 17 0 20 Apr 2021
Data Augmentation in a Hybrid Approach for Aspect-Based Sentiment Analysis Tomas Liesting Flavius Frasincar Maria Mihaela Truşcǎ 36 31 0 29 Mar 2021
Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis Wenmeng Yu Hua Xu Ziqi Yuan Jiele Wu SSL 102 464 0 09 Feb 2021
Utterance-level Dialogue Understanding: An Empirical Study Deepanway Ghosal Navonil Majumder Rada Mihalcea Soujanya Poria 59 23 0 29 Sep 2020
SaliencyMix: A Saliency Guided Data Augmentation Strategy for Better Regularization A. Uddin Sirazam Monira Wheemyung Shin TaeChoong Chung Sung-Ho Bae 81 228 0 02 Jun 2020
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis Devamanyu Hazarika Roger Zimmermann Soujanya Poria 80 707 0 07 May 2020
Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research Soujanya Poria Devamanyu Hazarika Navonil Majumder Rada Mihalcea 90 220 0 01 May 2020
MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification Jiaao Chen Zichao Yang Diyi Yang VLM 95 364 0 25 Apr 2020
Multimodal Transformer for Unaligned Multimodal Language Sequences Yao-Hung Hubert Tsai Shaojie Bai Paul Pu Liang J. Zico Kolter Louis-Philippe Morency Ruslan Salakhutdinov 94 1,307 0 01 Jun 2019
Augmenting Data with Mixup for Sentence Classification: An Empirical Study Hongyu Guo Yongyi Mao Richong Zhang 76 235 0 22 May 2019
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features Sangdoo Yun Dongyoon Han Seong Joon Oh Sanghyuk Chun Junsuk Choe Y. Yoo OOD 622 4,802 0 13 May 2019
Interpolation Consistency Training for Semi-Supervised Learning Vikas Verma Kenji Kawaguchi Alex Lamb Arno Solin Arno Solin Yoshua Bengio David Lopez-Paz 110 771 0 09 Mar 2019
Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors Yansen Wang Ying Shen Zhun Liu Paul Pu Liang Amir Zadeh Louis-Philippe Morency 78 402 0 23 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations Soujanya Poria Devamanyu Hazarika Navonil Majumder Gautam Naik Min Zhang Rada Mihalcea 109 1,077 0 05 Oct 2018
Efficient Low-rank Multimodal Fusion with Modality-Specific Factors Zhun Liu Ying Shen V. Lakshminarasimhan Paul Pu Liang Amir Zadeh Louis-Philippe Morency 65 648 0 31 May 2018
Multimodal Sentiment Analysis: Addressing Key Issues and Setting up the Baselines Soujanya Poria Navonil Majumder Devamanyu Hazarika Min Zhang Alexander Gelbukh Amir Hussain 36 174 0 19 Mar 2018
Memory Fusion Network for Multi-view Sequential Learning Amir Zadeh Paul Pu Liang Navonil Mazumder Soujanya Poria Min Zhang Louis-Philippe Morency 79 706 0 03 Feb 2018
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 289 9,803 0 25 Oct 2017
Tensor Fusion Network for Multimodal Sentiment Analysis Amir Zadeh Minghai Chen Soujanya Poria Min Zhang Louis-Philippe Morency 85 1,236 0 23 Jul 2017
Multimodal Machine Learning: A Survey and Taxonomy T. Baltrušaitis Chaitanya Ahuja Louis-Philippe Morency 114 2,937 0 26 May 2017
Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networks Kaipeng Zhang Zhanpeng Zhang Zhifeng Li Yu Qiao CVBM 178 4,974 0 11 Apr 2016