Turn-taking and Backchannel Prediction with Acoustic and Large Language Model Fusion

26 January 2024

Papers citing "Turn-taking and Backchannel Prediction with Acoustic and Large Language Model Fusion"

7 / 7 papers shown

Title
Predicting Turn-Taking and Backchannel in Human-Machine Conversations Using Linguistic, Acoustic, and Visual Signals Yuxin Lin Yinglin Zheng Ming Zeng Wangzheng Shi 12 0 0 19 May 2025
ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems Siddhant Arora Yifan Peng Jiatong Shi Jinchuan Tian William Chen ... Yosuke Kashiwagi E. Tsunoo Shuichiro Shimizu Vaibhav Srivastav Shinji Watanabe 42 0 0 11 Mar 2025
Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics Siddhant Arora Zhiyun Lu Chung-Cheng Chiu Ruoming Pang Shinji Watanabe 43 2 0 03 Mar 2025
SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generation Wenyi Yu Siyin Wang Xiaoyu Yang Xianzhao Chen Xiaohai Tian Jun Zhang Guangzhi Sun Lu Lu Yansen Wang Chao Zhang AuLLM 77 7 0 27 Nov 2024
Device-Directed Speech Detection for Follow-up Conversations Using Large Language Models Ognjen Rudovic Pranay Dighe Yi Su Vineet Garg Sameer Dharur Xiaochuan Niu Ahmed H. Abdelaziz Saurabh N. Adya Ahmed H. Tewfik 31 0 0 28 Oct 2024
Multilingual Dyadic Interaction Corpus NoXi+J: Toward Understanding Asian-European Non-verbal Cultural Characteristics and their Influences on Engagement Marius Funk Shogo Okada Elisabeth André 34 0 0 09 Sep 2024
TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialog Erik Ekstedt Gabriel Skantze 42 54 0 21 Oct 2020