UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition

21 November 2022

Ting-En Lin

Papers citing "UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition"

50 / 61 papers shown

Title
LLM supervised Pre-training for Multimodal Emotion Recognition in Conversations Soumya Dutta Sriram Ganapathy 64 4 0 20 Jan 2025
A Heterogeneous Multimodal Graph Learning Framework for Recognizing User Emotions in Social Networks Sree Bhattacharyya Shuhua Yang James Z. Wang 50 0 0 13 Jan 2025
Spatio-Temporal Fuzzy-oriented Multi-Modal Meta-Learning for Fine-grained Emotion Recognition Wenwen Qiang Yuxuan Yang Jingyao Wang Changwen Zheng 106 0 0 18 Dec 2024
UGotMe: An Embodied System for Affective Human-Robot Interaction Peizhen Li Longbing Cao Xiao-Ming Wu Xiaohan Yu Runze Yang 46 1 0 24 Oct 2024
Enhancing Multimodal Sentiment Analysis for Missing Modality through Self-Distillation and Unified Modality Cross-Attention Yuzhe Weng Haotian Wang Tian Gao Kewei Li Shutong Niu Jun Du 54 0 0 19 Oct 2024
Multi-modal Deep Learning Chen Yuhua MedIm 47 35 0 06 Mar 2024
Multimodal Deep Learning Cem Akkus Jiquan Ngiam Vladana Djakovic Steffen Jauch-Walser A. Khosla ... Jann Goschenhofer Honglak Lee A. Ng Daniel Schalk Matthias Aßenmacher 37 3,161 0 12 Jan 2023
SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation Wanwei He Yinpei Dai Min Yang Jian Sun Fei Huang Luo Si Yongbin Li 42 62 0 14 Sep 2022
SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding Wanwei He Yinpei Dai Binyuan Hui Min Yang Zhen Cao Jianbo Dong Fei Huang Luo Si Yongbin Li VLM 79 31 0 14 Sep 2022
MIntRec: A New Dataset for Multimodal Intent Recognition Hanlei Zhang Huanlin Xu Xin Eric Wang Qianrui Zhou Shaojie Zhao Jiayan Teng 50 42 0 09 Sep 2022
VISTANet: VIsual Spoken Textual Additive Net for Interpretable Multimodal Emotion Recognition Puneet Kumar Sarthak Malik Balasubramanian Raman Xiaobai Li 78 2 0 24 Aug 2022
Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue Systems Ting-En Lin Yuchuan Wu Feiling Huang Luo Si Jian Sun Yongbin Li 69 24 0 30 May 2022
COGMEN: COntextualized GNN based Multimodal Emotion recognitioN Abhinav Joshi A. Bhat Ayush Jain Atinesh Singh Ashutosh Modi 26 77 0 05 May 2022
UniDU: Towards A Unified Generative Dialogue Understanding Framework Zhi Chen Lu Chen B. Chen Libo Qin Yuncong Liu Su Zhu Jian-Guang Lou Kai Yu 47 13 0 10 Apr 2022
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis Huisheng Mao Ziqi Yuan Hua Xu Wenmeng Yu Yihe Liu Kai Gao 37 43 0 23 Mar 2022
A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots Sai Zhang Y. Hu Yuchuan Wu Jiaman Wu Yongbin Li Jian Sun Caixia Yuan Xiaojie Wang 43 17 0 21 Mar 2022
MM-DFN: Multimodal Dynamic Fusion Network for Emotion Recognition in Conversations Dou Hu Xiaolong Hou Lingwei Wei Lian-Xin Jiang Yang Mo 32 120 0 04 Mar 2022
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models Tianbao Xie Chen Henry Wu Peng Shi Ruiqi Zhong Torsten Scholak ... Lingpeng Kong Rui Zhang Noah A. Smith Luke Zettlemoyer Tao Yu LMTD 71 297 0 16 Jan 2022
Contrast and Generation Make BART a Good Dialogue Emotion Recognizer Shimin Li Hang Yan Xipeng Qiu 37 86 0 21 Dec 2021
ScaleVLAD: Improving Multimodal Sentiment Analysis via Multi-Scale Fusion of Locally Descriptors Huaishao Luo Lei Ji Yanyong Huang Bin Wang Shenggong Ji Tianrui Li 27 22 0 02 Dec 2021
GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection Wanwei He Yinpei Dai Yinhe Zheng Yuchuan Wu Zhen Cao ... Min Yang Feiling Huang Luo Si Jian Sun Yongbin Li VLM 46 158 0 29 Nov 2021
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts Hangbo Bao Wenhui Wang Li Dong Qiang Liu Owais Khan Mohammed Kriti Aggarwal Subhojit Som Furu Wei VLM MLLM MoE 49 543 0 03 Nov 2021
UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation Zhengkun Zhang Xiaojun Meng Yasheng Wang Xin Jiang Qun Liu Zhenglu Yang 48 46 0 13 Sep 2021
Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis Wei Han Hui Chen Soujanya Poria 42 330 0 01 Sep 2021
CoMPM: Context Modeling with Speaker's Pre-trained Memory Tracking for Emotion Recognition in Conversation Joosung Lee Woo-Ri Lee 34 78 0 26 Aug 2021
MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversation Jingwen Hu Yuchen Liu Jinming Zhao Qin Jin 54 205 0 14 Jul 2021
UniRE: A Unified Label Space for Entity Relation Extraction Yijun Wang Changzhi Sun Yuanbin Wu Hao Zhou Lei Li Junchi Yan 24 113 0 09 Jul 2021
A Unified Generative Framework for Aspect-Based Sentiment Analysis Hang Yan Junqi Dai Tuo Ji Xipeng Qiu Zheng Zhang 42 279 0 08 Jun 2021
A Unified Generative Framework for Various NER Subtasks Hang Yan Tao Gui Junqi Dai Qipeng Guo Zheng Zhang Xipeng Qiu 55 293 0 02 Jun 2021
Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detection Lixing Zhu Gabriele Pergola Lin Gui Deyu Zhou Yulan He 54 145 0 02 Jun 2021
Preview, Attend and Review: Schema-Aware Curriculum Learning for Multi-Domain Dialog State Tracking Yinpei Dai Hangyu Li Yongbin Li Jian Sun Fei Huang Luo Si Xiao-Dan Zhu 51 54 0 01 Jun 2021
Directed Acyclic Graph Network for Conversational Emotion Recognition Weizhou Shen Siyue Wu Yunyi Yang Xiaojun Quan 44 241 0 27 May 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 133 3,336 0 18 Apr 2021
Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis Wenmeng Yu Hua Xu Ziqi Yuan Jiele Wu SSL 73 452 0 09 Feb 2021
Deep Open Intent Classification with Adaptive Decision Boundary Hanlei Zhang Hua Xu Ting-En Lin VLM 31 107 0 18 Dec 2020
Discovering New Intents with Deep Aligned Clustering Hanlei Zhang Hua Xu Ting-En Lin Rui Lv 52 118 0 16 Dec 2020
COSMIC: COmmonSense knowledge for eMotion Identification in Conversations Deepanway Ghosal Navonil Majumder Alexander Gelbukh Rada Mihalcea Soujanya Poria 80 316 0 06 Oct 2020
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis Devamanyu Hazarika Roger Zimmermann Soujanya Poria 35 694 0 07 May 2020
A Survey on Dialog Management: Recent Advances and Challenges Yinpei Dai Huihua Yu Yixuan Jiang Chengguang Tang Yongbin Li Jian Sun OffRL VLM 52 20 0 05 May 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 104 4,476 0 23 Apr 2020
A Post-processing Method for Detecting Unknown Intent of Dialogue System via Pre-trained Deep Neural Network Classifier Ting-En Lin Hua Xu 49 31 0 07 Mar 2020
Discovering New Intents via Constrained Deep Adaptive Clustering with Cluster Refinement Ting-En Lin Hua Xu Hanlei Zhang 9 111 0 20 Nov 2019
Modality to Modality Translation: An Adversarial Representation Learning and Graph Fusion Network for Multimodal Fusion Sijie Mai Haifeng Hu Songlong Xing GAN 56 185 0 18 Nov 2019
Learning Relationships between Text, Audio, and Video via Deep Canonical Correlation for Multimodal Language Analysis Zhongkai Sun P. Sarma W. Sethares Yingyu Liang 25 319 0 13 Nov 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 206 19,824 0 23 Oct 2019
Conversational Transfer Learning for Emotion Recognition Devamanyu Hazarika Soujanya Poria Roger Zimmermann Rada Mihalcea 35 17 0 11 Oct 2019
DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation Deepanway Ghosal Navonil Majumder Soujanya Poria Niyati Chhaya Alexander Gelbukh 62 511 0 30 Aug 2019
Deep Unknown Intent Detection with Margin Loss Ting-En Lin Hua Xu UQCV 21 140 0 02 Jun 2019
Multimodal Transformer for Unaligned Multimodal Language Sequences Yao-Hung Hubert Tsai Shaojie Bai Paul Pu Liang J. Zico Kolter Louis-Philippe Morency Ruslan Salakhutdinov 54 1,280 0 01 Jun 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 42 17,950 0 28 May 2019