v1v2 (latest)

Tied Multitask Learning for Neural Speech Translation

19 February 2018

Papers citing "Tied Multitask Learning for Neural Speech Translation"

50 / 98 papers shown

Title
A Modular-based Strategy for Mitigating Gradient Conflicts in Simultaneous Speech Translation Xiaoqian Liu Yangfan Du Jiadong Wang Yuan Ge Chen Xu Tong Xiao Guocheng Chen Jingbo Zhu 139 0 0 31 Dec 2024
LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models Xi Chen Songyang Zhang Qibing Bai Kai-xiang Chen Satoshi Nakamura AuLLM 101 7 0 22 Jul 2024
A Case Study on Context-Aware Neural Machine Translation with Multi-Task Learning Ramakrishna Appicharla Baban Gain Santanu Pal Asif Ekbal Pushpak Bhattacharyya 51 2 0 03 Jul 2024
Pushing the Limits of Zero-shot End-to-End Speech Translation Ioannis Tsiamas Gerard I. Gállego José A. R. Fonollosa Marta R. Costa-jussá 94 10 0 16 Feb 2024
End-to-End Speech-to-Text Translation: A Survey Nivedita Sethiya Chandresh Kumar Maurya 110 8 0 02 Dec 2023
Rethinking and Improving Multi-task Learning for End-to-end Speech Translation Yuhao Zhang Chen Xu Bei Li Hao Chen Tong Xiao Chunliang Zhang Jingbo Zhu 72 7 0 07 Nov 2023
Unified Segment-to-Segment Framework for Simultaneous Sequence Generation Shaolei Zhang Yang Feng 81 8 0 27 Oct 2023
UniverSLU: Universal Spoken Language Understanding for Diverse Tasks with Natural Language Instructions Siddhant Arora Hayato Futami Jee-weon Jung Yifan Peng Roshan S. Sharma Yosuke Kashiwagi E. Tsunoo Karen Livescu Shinji Watanabe ELM 68 9 0 04 Oct 2023
Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023 Sara Papi Marco Gaido Matteo Negri 77 7 0 27 Sep 2023
A Case Study on Context Encoding in Multi-Encoder based Document-Level Neural Machine Translation Ramakrishna Appicharla Baban Gain Santanu Pal Asif Ekbal 64 1 0 11 Aug 2023
Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts Rebekka Hubert Artem Sokolov Stefan Riezler 56 1 0 17 Jul 2023
Recent Advances in Direct Speech-to-text Translation Chen Xu Rong Ye Qianqian Dong Chengqi Zhao Tom Ko Mingxuan Wang Tong Xiao Jingbo Zhu 116 22 0 20 Jun 2023
Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction Manuel Mager Rajat Bhatnagar Graham Neubig Ngoc Thang Vu Katharina Kann 93 10 0 11 Jun 2023
Constructing Time-Series Momentum Portfolios with Deep Multi-Task Learning Joel Ong Dorien Herremans AI4TS 48 8 0 08 Jun 2023
CTC-based Non-autoregressive Speech Translation Chen Xu Xiaoqian Liu Xiaowen Liu Qingxuan Sun Yuhao Zhang ... Tom Ko Mingxuan Wang Tong Xiao Anxiang Ma Jingbo Zhu 62 11 0 27 May 2023
End-to-End Simultaneous Speech Translation with Differentiable Segmentation Shaolei Zhang Yang Feng 66 18 0 25 May 2023
Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translation Biao Zhang Barry Haddow Rico Sennrich 74 3 0 21 Feb 2023
Pre-training for Speech Translation: CTC Meets Optimal Transport Hang Le Hongyu Gong Changhan Wang J. Pino Benjamin Lecouteux D. Schwab OT 96 26 0 27 Jan 2023
Joint Speech Transcription and Translation: Pseudo-Labeling with Out-of-Distribution Data Mozhdeh Gheini Tatiana Likhomanenko Matthias Sperber Hendra Setiawan 90 5 0 20 Dec 2022
UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units Hirofumi Inaguma Sravya Popuri Ilia Kulikov Peng-Jen Chen Changhan Wang Yu-An Chung Yun Tang Ann Lee Shinji Watanabe J. Pino 112 61 0 15 Dec 2022
Improving End-to-end Speech Translation by Leveraging Auxiliary Speech and Text Data Yuhao Zhang Chen Xu Bojie Hu Chunliang Zhang Tong Xiao Jingbo Zhu 62 16 0 04 Dec 2022
Efficient Speech Translation with Pre-trained Models Zhaolin Li Jan Niehues 54 2 0 09 Nov 2022
Does Joint Training Really Help Cascaded Speech Translation? Viet Anh Khoa Tran David Thulke Yingbo Gao Christian Herold Hermann Ney 72 4 0 24 Oct 2022
Information-Transport-based Policy for Simultaneous Translation Shaolei Zhang Yang Feng 104 52 0 22 Oct 2022
Generating Synthetic Speech from SpokenVocab for Speech Translation Jinming Zhao Gholamreza Haffar Ehsan Shareghi 50 6 0 15 Oct 2022
Learning to Jointly Transcribe and Subtitle for End-to-End Spontaneous Speech Recognition Jakob Poncelet Hugo Van hamme 29 2 0 14 Oct 2022
Revisiting End-to-End Speech-to-Text Translation From Scratch Biao Zhang Barry Haddow Rico Sennrich 81 39 0 09 Jun 2022
Non-Parametric Domain Adaptation for End-to-End Speech Translation Yichao Du Weizhi Wang Zhirui Zhang Boxing Chen Tong Xu Jun Xie Enhong Chen 136 18 0 23 May 2022
Who Are We Talking About? Handling Person Names in Speech Translation Marco Gaido Matteo Negri Marco Turchi 72 8 0 13 May 2022
End-to-End Speech Translation for Code Switched Speech Orion Weller Matthias Sperber Telmo Pires Hendra Setiawan Christian Gollan Dominic Telaar Matthias Paulik 133 29 0 11 Apr 2022
Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation Ye Jia Yifan Ding Ankur Bapna Colin Cherry Yu Zhang Alexis Conneau Nobuyuki Morioka 94 21 0 24 Mar 2022
On the Effectiveness of Pinyin-Character Dual-Decoding for End-to-End Mandarin Chinese ASR Zhao Yang Dianwen Ng Xiao Fu Liping Han Wei Xi Ruimeng Wang Rui Jiang Jizhong Zhao 74 2 0 26 Jan 2022
Regularizing End-to-End Speech Translation with Triangular Decomposition Agreement Yichao Du Zhirui Zhang Weizhi Wang Boxing Chen Jun Xie Tong Xu 131 23 0 21 Dec 2021
DeepAnalyze: Learning to Localize Crashes at Scale Manish Shetty Chetan Bansal Suman Nath Sean Bowles Henry Wang Ozgur Arman Siamak Ahari HAI 67 4 0 29 Sep 2021
Integrated Training for Sequence-to-Sequence Models Using Non-Autoregressive Transformer Evgeniia Tokarchuk Jan Rosendahl Weiyue Wang Pavel Petrushkov Tomer Lancewicki Shahram Khadivi Hermann Ney 50 2 0 27 Sep 2021
Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates Hirofumi Inaguma Siddharth Dalmia Brian Yan Shinji Watanabe 99 11 0 27 Sep 2021
One Source, Two Targets: Challenges and Rewards of Dual Decoding Jitao Xu François Yvon 69 6 0 21 Sep 2021
Between Flexibility and Consistency: Joint Generation of Captions and Subtitles Alina Karakanta Marco Gaido Matteo Negri Marco Turchi 68 9 0 13 Jul 2021
The IWSLT 2021 BUT Speech Translation Systems Hari Krishna Vydana Martin Karafiát L. Burget J. Černocký 25 2 0 13 Jul 2021
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task Yun Tang J. Pino Xian Li Changhan Wang Dmitriy Genzel 175 84 0 12 Jul 2021
Dealing with training and test segmentation mismatch: FBK@IWSLT2021 Sara Papi Marco Gaido Matteo Negri Marco Turchi 71 6 0 23 Jun 2021
RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer Xingshan Zeng Liangyou Li Qun Liu 67 48 0 09 Jun 2021
Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference? L. Bentivogli Mauro Cettolo Marco Gaido Alina Karakanta A. Martinelli Matteo Negri Marco Turchi 76 83 0 02 Jun 2021
How to Split: the Effect of Word Segmentation on Gender Bias in Speech Translation Marco Gaido Beatrice Savoldi L. Bentivogli Matteo Negri Marco Turchi 101 15 0 28 May 2021
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders Chen Xu Bojie Hu Yanyang Li Yuhao Zhang Shen Huang Qi Ju Tong Xiao Jingbo Zhu 68 78 0 12 May 2021
Investigating the Reordering Capability in CTC-based Non-Autoregressive End-to-End Speech Translation Shun-Po Chuang Yung-Sung Chuang Chih-Chiang Chang Hung-yi Lee 88 26 0 11 May 2021
Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks Siddharth Dalmia Brian Yan Vikas Raunak Florian Metze Shinji Watanabe 89 31 0 02 May 2021
AlloST: Low-resource Speech Translation without Source Transcription Yao-Fei Cheng Hung-Shin Lee Hsin-Min Wang 84 9 0 01 May 2021
Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation Hirofumi Inaguma Tatsuya Kawahara Shinji Watanabe 78 43 0 13 Apr 2021
On Knowledge Distillation for Direct Speech Translation Marco Gaido Mattia Antonino Di Gangi Matteo Negri Marco Turchi 63 14 0 09 Dec 2020