Speech-Text Dialog Pre-training for Spoken Dialog Understanding with
Explicit Cross-Modal Alignment

v1v2 (latest)

Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment

19 May 2023

Tianshu Yu

Ting-En Lin

Min Yang

Fei Huang

ArXiv (abs)PDF HTML

Papers citing "Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment"

8 / 8 papers shown

Title
Multimodal Mixture of Low-Rank Experts for Sentiment Analysis and Emotion Recognition Shuo Zhang Jinsong Zhang Zhejun Zhang Lei Li MoE 50 0 0 20 May 2025
Target conversation extraction: Source separation using turn-taking dynamics Tuochao Chen Qirui Wang Bohan Wu Malek Itani Sefik Emre Eskimez Takuya Yoshioka Shyamnath Gollakota 78 6 0 15 Jul 2024
CorMulT: A Semi-supervised Modality Correlation-aware Multimodal Transformer for Sentiment Analysis Yangmin Li Ruiqi Zhu Wengen Li 72 4 0 09 Jul 2024
EmoWear: Exploring Emotional Teasers for Voice Message Interaction on Smartwatches Pengcheng An Jiawen Zhu Zibo Zhang Yifei Yin Qingyuan Ma Che Yan Linghao Du Jian Zhao 76 12 0 11 Feb 2024
Token-Level Contrastive Learning with Modality-Aware Prompting for Multimodal Intent Recognition Qianrui Zhou Hua Xu Hao Li Hanlei Zhang Xiaohan Zhang Yifan Wang Kai Gao 88 18 0 22 Dec 2023
Self-Explanation Prompting Improves Dialogue Understanding in Large Language Models Haoyu Gao Ting-En Lin Hangyu Li Min Yang Yuchuan Wu Wentao Ma Yongbin Li LRM 70 11 0 22 Sep 2023
UniSA: Unified Generative Framework for Sentiment Analysis Zaijing Li Ting-En Lin Yuchuan Wu Meng Liu Fengxiao Tang Mingde Zhao Yongbin Li 101 17 0 04 Sep 2023
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders Andy T. Liu Shu-Wen Yang Po-Han Chi Po-Chun Hsu Hung-yi Lee SSL 157 374 0 25 Oct 2019