Adapting Offline Speech Translation Models for Streaming with
Future-Aware Distillation and Inference

Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference

14 March 2023

Zhongqiang Huang

Papers citing "Adapting Offline Speech Translation Models for Streaming with Future-Aware Distillation and Inference"

19 / 19 papers shown

Title
LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offline Biao Fu Minpeng Liao Kai Fan Chengxi Li Li Zhang Yidong Chen Xiaodong Shi OffRL 338 1 0 13 Apr 2025
LEAPT: Learning Adaptive Prefix-to-prefix Translation For Simultaneous Machine Translation Lei Lin Shuangtao Li Xiaodon Shi 53 5 0 21 Mar 2023
Information-Transport-based Policy for Simultaneous Translation Shaolei Zhang Yang Feng 66 50 0 22 Oct 2022
STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation Qingkai Fang Rong Ye Lei Li Yang Feng Mingxuan Wang 76 97 0 20 Mar 2022
Reducing Position Bias in Simultaneous Machine Translation with Length-Aware Framework Shaolei Zhang Yang Feng 48 21 0 17 Mar 2022
Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement Yichao Du Zhirui Zhang Weizhi Wang Boxing Chen Jun Xie Tong Xu 89 22 0 21 Dec 2021
Decision Attentive Regularization to Improve Simultaneous Speech Translation Systems Mohd Abbas Zaidi Beomseok Lee Sangha Kim Chanwoo Kim 46 5 0 13 Oct 2021
Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy Shaolei Zhang Yang Feng MoE 56 40 0 11 Sep 2021
Direct Simultaneous Speech-to-Text Translation Assisted by Synchronized Streaming ASR Junkun Chen Mingbo Ma Renjie Zheng Liang Huang 43 32 0 11 Jun 2021
RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer Xingshan Zeng Liangyou Li Qun Liu 41 46 0 09 Jun 2021
End-to-end Speech Translation via Cross-modal Progressive Training Rong Ye Mingxuan Wang Lei Li 50 72 0 21 Apr 2021
Efficiently Fusing Pretrained Acoustic and Linguistic Encoders for Low-resource Speech Recognition Cheng Yi Shiyu Zhou Bo Xu 67 40 0 17 Jan 2021
SimulMT to SimulST: Adapting Simultaneous Text Translation to End-to-End Simultaneous Speech Translation Xutai Ma J. Pino Philipp Koehn 34 95 0 03 Nov 2020
SimulEval: An Evaluation Toolkit for Simultaneous Translation Xutai Ma M. Dousti Changhan Wang Jiatao Gu J. Pino 46 105 0 31 Jul 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 179 5,734 0 20 Jun 2020
SkinAugment: Auto-Encoding Speaker Conversions for Automatic Speech Translation Arya D. McCarthy Liezl Puzon J. Pino 62 24 0 27 Feb 2020
Monotonic Multihead Attention Xutai Ma J. Pino James Cross Liezl Puzon Jiatao Gu 46 139 0 26 Sep 2019
Thinking Slow about Latency Evaluation for Simultaneous Machine Translation Colin Cherry George F. Foster 55 47 0 31 May 2019
CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition Linhao Dong Bo Xu 52 127 0 27 May 2019