Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation

13 April 2021

Papers citing "Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation"

40 / 40 papers shown

Title
Understanding and Improving Lexical Choice in Non-Autoregressive Translation Liang Ding Longyue Wang Xuebo Liu Derek F. Wong Dacheng Tao Zhaopeng Tu 132 77 0 29 Dec 2020
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation Hang Le J. Pino Changhan Wang Jiatao Gu D. Schwab Laurent Besacier 80 82 0 02 Nov 2020
Orthros: Non-autoregressive End-to-end Speech Translation with Dual-decoder Hirofumi Inaguma Yosuke Higuchi Kevin Duh Tatsuya Kawahara Shinji Watanabe 47 22 0 25 Oct 2020
fairseq S2T: Fast Speech-to-Text Modeling with fairseq Changhan Wang Yun Tang Xutai Ma Anne Wu Sravya Popuri Dmytro Okhonko J. Pino VLM LRM 63 271 0 11 Oct 2020
CoVoST 2 and Massively Multilingual Speech-to-Text Translation Changhan Wang Anne Wu J. Pino SLR 54 74 0 20 Jul 2020
Conformer: Convolution-augmented Transformer for Speech Recognition Anmol Gulati James Qin Chung-Cheng Chiu Niki Parmar Yu Zhang ... Wei Han Shibo Wang Zhengdong Zhang Yonghui Wu Ruoming Pang 210 3,119 0 16 May 2020
Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasing Brian Thompson Matt Post LRM 53 190 0 30 Apr 2020
Simulated Multiple Reference Training Improves Low-Resource Machine Translation Huda Khayrallah Brian Thompson Matt Post Philipp Koehn 122 38 0 30 Apr 2020
A Study of Non-autoregressive Model for Sequence Generation Yi Ren Jinglin Liu Xu Tan Zhou Zhao Sheng Zhao Tie-Yan Liu 76 61 0 22 Apr 2020
ESPnet-ST: All-in-One Speech Translation Toolkit Hirofumi Inaguma Shun Kiyono Kevin Duh Shigeki Karita Nelson Yalta Tomoki Hayashi Shinji Watanabe 79 164 0 21 Apr 2020
Curriculum Pre-training for End-to-End Speech Translation Chengyi Wang Yu Wu Shujie Liu Ming Zhou Zhenglu Yang 49 109 0 21 Apr 2020
Semi-Autoregressive Training Improves Mask-Predict Decoding Marjan Ghazvininejad Omer Levy Luke Zettlemoyer 63 72 0 23 Jan 2020
Synchronous Speech Recognition and Speech-to-Text Translation with Interactive Decoding Yuchen Liu Jiajun Zhang Hao Xiong Long Zhou Zhongjun He Hua Wu Haifeng Wang Chengqing Zong 63 71 0 16 Dec 2019
Explaining Sequence-Level Knowledge Distillation as Data-Augmentation for Neural Machine Translation Mitchell A. Gordon Kevin Duh 41 28 0 06 Dec 2019
A Comparative Study on End-to-end Speech to Text Translation Parnia Bahar Tobias Bieschke Hermann Ney 61 79 0 20 Nov 2019
Understanding Knowledge Distillation in Non-autoregressive Machine Translation Chunting Zhou Graham Neubig Jiatao Gu 54 220 0 07 Nov 2019
Multilingual End-to-End Speech Translation Hirofumi Inaguma Kevin Duh Tatsuya Kawahara Shinji Watanabe LRM 78 88 0 01 Oct 2019
Bridging the Gap between Pre-Training and Fine-Tuning for End-to-End Speech Translation Chengyi Wang Yu-Huan Wu Shujie Liu Zhenglu Yang M. Zhou 55 84 0 17 Sep 2019
A Comparative Study on Transformer vs RNN in Speech Applications Shigeki Karita Nanxin Chen Tomoki Hayashi Takaaki Hori Hirofumi Inaguma ... Ryuichi Yamamoto Xiao-fei Wang Shinji Watanabe Takenori Yoshimura Wangyou Zhang 65 720 0 13 Sep 2019
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition Daniel S. Park William Chan Yu Zhang Chung-Cheng Chiu Barret Zoph E. D. Cubuk Quoc V. Le VLM 162 3,451 0 18 Apr 2019
End-to-End Speech Translation with Knowledge Distillation Yuchen Liu Hao Xiong Zhongjun He Jiajun Zhang Hua Wu Haifeng Wang Chengqing Zong 76 155 0 17 Apr 2019
Attention-Passing Models for Robust and Data-Efficient End-to-End Speech Translation Matthias Sperber Graham Neubig Jan Niehues A. Waibel 52 102 0 15 Apr 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 73 2,735 0 22 Jan 2019
ParaBank: Monolingual Bitext Generation and Sentential Paraphrasing via Lexically-constrained Neural Machine Translation J. E. Hu Rachel Rudinger Matt Post Benjamin Van Durme 57 82 0 11 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.5K 94,511 0 11 Oct 2018
Pre-training on high-resource speech recognition improves low-resource speech-to-text translation Sameer Bansal Herman Kamper Karen Livescu Adam Lopez Sharon Goldwater 52 197 0 05 Sep 2018
Paraphrases as Foreign Languages in Multilingual Neural Machine Translation Zhong Zhou Matthias Sperber A. Waibel LRM 30 19 0 25 Aug 2018
Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates Taku Kudo 204 1,165 0 29 Apr 2018
Tied Multitask Learning for Neural Speech Translation Antonios Anastasopoulos David Chiang 124 173 0 19 Feb 2018
End-to-End Automatic Speech Translation of Audiobooks Alexandre Berard Laurent Besacier A. Kocabiyikoglu Olivier Pietquin 105 192 0 12 Feb 2018
ParaNMT-50M: Pushing the Limits of Paraphrastic Sentence Embeddings with Millions of Machine Translations John Wieting Kevin Gimpel LRM 63 149 0 15 Nov 2017
Non-Autoregressive Neural Machine Translation Jiatao Gu James Bradbury Caiming Xiong Victor O.K. Li R. Socher 95 795 0 07 Nov 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 640 130,942 0 12 Jun 2017
Learning Paraphrastic Sentence Embeddings from Back-Translated Bitext John Wieting Jonathan Mallinson Kevin Gimpel 53 106 0 06 Jun 2017
Sequence-to-Sequence Models Can Directly Translate Foreign Speech Ron J. Weiss J. Chorowski Navdeep Jaitly Yonghui Wu Zhiwen Chen 79 344 0 24 Mar 2017
Listen and Translate: A Proof of Concept for End-to-End Speech-to-Text Translation Alexandre Berard Olivier Pietquin Christophe Servan Laurent Besacier 70 319 0 06 Dec 2016
Sequence-Level Knowledge Distillation Yoon Kim Alexander M. Rush 107 1,114 0 25 Jun 2016
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 768 27,303 0 02 Dec 2015
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 195 7,729 0 31 Aug 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.5K 149,842 0 22 Dec 2014