End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020

4 June 2020

Marco Gaido

Mattia Antonino Di Gangi

Matteo Negri

Marco Turchi

ArXiv (abs)PDF HTML

Papers citing "End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020"

34 / 34 papers shown

Title
HENT-SRT: Hierarchical Efficient Neural Transducer with Self-Distillation for Joint Speech Recognition and Translation A. Hussein Cihan Xiao Matthew Wiesner Dan Povey Leibny Paola García Sanjeev Khudanpur 31 0 0 02 Jun 2025
CTC-GMM: CTC guided modality matching for fast and accurate streaming speech translation Rui Zhao Jinyu Li Ruchao Fan Matt Post 92 2 0 07 Oct 2024
Sentence-wise Speech Summarization: Task, Datasets, and End-to-End Modeling with LM Knowledge Distillation Kohei Matsuura Takanori Ashihara Takafumi Moriya Masato Mimura Takatomo Kano A. Ogawa Marc Delcroix 70 2 0 01 Aug 2024
Pushing the Limits of Zero-shot End-to-End Speech Translation Ioannis Tsiamas Gerard I. Gállego José A. R. Fonollosa Marta R. Costa-jussá 97 10 0 16 Feb 2024
Tuning Large language model for End-to-end Speech Translation Hao Zhang Nianwen Si Yaqi Chen Wenlin Zhang Xu Yang Dan Qu Xiaolin Jiao 99 8 0 03 Oct 2023
Enhancing End-to-End Conversational Speech Translation Through Target Language Context Utilization A. Hussein Brian Yan Antonios Anastasopoulos Shinji Watanabe Sanjeev Khudanpur 83 8 0 27 Sep 2023
Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023 Sara Papi Marco Gaido Matteo Negri 92 7 0 27 Sep 2023
An Empirical Study of Consistency Regularization for End-to-End Speech-to-Text Translation Pengzhi Gao Ruiqing Zhang Zhongjun He Hua Wu Haifeng Wang 66 5 0 28 Aug 2023
Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts Rebekka Hubert Artem Sokolov Stefan Riezler 63 1 0 17 Jul 2023
Recent Advances in Direct Speech-to-text Translation Chen Xu Rong Ye Qianqian Dong Chengqi Zhao Tom Ko Mingxuan Wang Tong Xiao Jingbo Zhu 128 23 0 20 Jun 2023
Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23 Ioannis Tsiamas Gerard I. Gállego José A. R. Fonollosa Marta R. Costa-jussá OT 65 3 0 02 Jun 2023
CMOT: Cross-modal Mixup via Optimal Transport for Speech Translation Yan Zhou Qingkai Fang Yang Feng OT 138 30 0 24 May 2023
Improving speech translation by fusing speech and text Wenbiao Yin Zhicheng Liu Chengqi Zhao Tao Wang Jian-Fei Tong Rong Ye 69 4 0 23 May 2023
Logit-Based Ensemble Distribution Distillation for Robust Autoregressive Sequence Uncertainties Yassir Fathullah Guoxuan Xia Mark Gales UQCV 67 5 0 17 May 2023
Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translation Biao Zhang Barry Haddow Rico Sennrich 98 3 0 21 Feb 2023
SegAugment: Maximizing the Utility of Speech Translation Data with Segmentation-based Augmentations Ioannis Tsiamas José A. R. Fonollosa Marta R. Costa-jussá 90 6 0 19 Dec 2022
WACO: Word-Aligned Contrastive Learning for Speech Translation Siqi Ouyang Rong Ye Lei Li 106 28 0 19 Dec 2022
Efficient Speech Translation with Pre-trained Models Zhaolin Li Jan Niehues 73 2 0 09 Nov 2022
Efficient yet Competitive Speech Translation: FBK@IWSLT2022 Marco Gaido Sara Papi Dennis Fucci G. Fiameni Matteo Negri Marco Turchi 74 20 0 05 May 2022
STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation Qingkai Fang Rong Ye Lei Li Yang Feng Mingxuan Wang 138 100 0 20 Mar 2022
Is "moby dick" a Whale or a Bird? Named Entities and Terminology in Speech Translation Marco Gaido Susana Rodríguez Matteo Negri L. Bentivogli Marco Turchi 52 10 0 15 Sep 2021
Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy Shaolei Zhang Yang Feng MoE 99 43 0 11 Sep 2021
Between Flexibility and Consistency: Joint Generation of Captions and Subtitles Alina Karakanta Marco Gaido Matteo Negri Marco Turchi 75 9 0 13 Jul 2021
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task Yun Tang J. Pino Xian Li Changhan Wang Dmitriy Genzel 177 84 0 12 Jul 2021
The NiuTrans End-to-End Speech Translation System for IWSLT 2021 Offline Task Chen Xu Xiaoqian Liu Xiaowen Liu Laohu Wang Canan Huang Tong Xiao Jingbo Zhu 92 5 0 06 Jul 2021
Dealing with training and test segmentation mismatch: FBK@IWSLT2021 Sara Papi Marco Gaido Matteo Negri Marco Turchi 90 6 0 23 Jun 2021
Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference? L. Bentivogli Mauro Cettolo Marco Gaido Alina Karakanta A. Martinelli Matteo Negri Marco Turchi 80 84 0 02 Jun 2021
End-to-End Speech Translation with Pre-trained Models and Adapters: UPC at IWSLT 2021 Gerard I. Gállego Ioannis Tsiamas Carlos Escolano José A. R. Fonollosa Marta R. Costa-jussá 61 31 0 10 May 2021
Segmenting Subtitles for Correcting ASR Segmentation Errors David Wan Chris Kedzie Faisal Ladhak Elsbeth Turcan P. Galuscáková Elena Zotkina Zhengping Jiang P. Bell Kathleen McKeown 55 4 0 16 Apr 2021
CTC-based Compression for Direct Speech Translation Marco Gaido Mauro Cettolo Matteo Negri Marco Turchi 106 59 0 02 Feb 2021
On Knowledge Distillation for Direct Speech Translation Marco Gaido Mattia Antonino Di Gangi Matteo Negri Marco Turchi 70 14 0 09 Dec 2020
Breeding Gender-aware Direct Speech Translation Systems Marco Gaido Beatrice Savoldi L. Bentivogli Matteo Negri Marco Turchi 81 21 0 09 Dec 2020
Multilingual Speech Translation with Efficient Finetuning of Pretrained Models Xian Li Changhan Wang Yun Tang C. Tran Yuqing Tang J. Pino Alexei Baevski Alexis Conneau Michael Auli 64 6 0 24 Oct 2020
Contextualized Translation of Automatically Segmented Speech Marco Gaido Mattia Antonino Di Gangi Matteo Negri Mauro Cettolo Marco Turchi 66 19 0 05 Aug 2020