Tuning Large language model for End-to-end Speech Translation

3 October 2023

Papers citing "Tuning Large language model for End-to-end Speech Translation"

7 / 7 papers shown

Title
Adaptive Inner Speech-Text Alignment for LLM-based Speech Translation Henglyu Liu Andong Chen Kehai Chen X. Bai M. Zhong Yuan Qiu Min Zhang 78 0 0 13 Mar 2025
Making LLMs Better Many-to-Many Speech-to-Text Translators with Curriculum Learning Yexing Du Youcheng Pan Ziyang Ma Keqi Deng Yifan Yang Keqi Deng Xie Chen Yang Xiang Ming Liu Bing Qin LRM 151 9 0 29 Sep 2024
How to Connect Speech Foundation Models and Large Language Models? What Matters and What Does Not Francesco Verdini Pierfrancesco Melucci Stefano Perna Francesco Cariaggi Marco Gaido ... Marek Kasztelnik L. Bentivogli Sébastien Bratières P. Merialdo Simone Scardapane AuLLM 67 1 0 25 Sep 2024
FASST: Fast LLM-based Simultaneous Speech Translation Siqi Ouyang Xi Xu Chinmay Dandekar Lei Li 64 3 0 18 Aug 2024
LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models Xi Chen Songyang Zhang Qibing Bai Kai-xiang Chen Satoshi Nakamura AuLLM 106 7 0 22 Jul 2024
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? Marco Gaido Sara Papi Matteo Negri L. Bentivogli 133 18 0 19 Feb 2024
Pushing the Limits of Zero-shot End-to-End Speech Translation Ioannis Tsiamas Gerard I. Gállego José A. R. Fonollosa Marta R. Costa-jussá 97 10 0 16 Feb 2024