Monotonic Multihead Attention

26 September 2019

Papers citing "Monotonic Multihead Attention"

47 / 97 papers shown

Title
Large-Scale Streaming End-to-End Speech Translation with Neural Transducers Jian Xue Peidong Wang Jinyu Li Matt Post Yashesh Gaur AI4TS 32 26 0 11 Apr 2022
Does Simultaneous Speech Translation need Simultaneous Models? Sara Papi Marco Gaido Matteo Negri Marco Turchi 46 26 0 08 Apr 2022
End to End Lip Synchronization with a Temporal AutoEncoder Yoav Shalev Lior Wolf 19 7 0 30 Mar 2022
Exploring Continuous Integrate-and-Fire for Adaptive Simultaneous Speech Translation Chih-Chiang Chang Hung-yi Lee 32 13 0 22 Mar 2022
Modeling Dual Read/Write Paths for Simultaneous Machine Translation Shaolei Zhang Yang Feng 22 25 0 17 Mar 2022
Gaussian Multi-head Attention for Simultaneous Machine Translation Shaolei Zhang Yang Feng 24 22 0 17 Mar 2022
Reducing Position Bias in Simultaneous Machine Translation with Length-Aware Framework Shaolei Zhang Yang Feng 19 19 0 17 Mar 2022
From Simultaneous to Streaming Machine Translation by Leveraging Streaming History Javier Iranzo-Sánchez Jorge Civera Saiz A. Juan CLL 15 12 0 04 Mar 2022
Anticipation-Free Training for Simultaneous Machine Translation Chih-Chiang Chang Shun-Po Chuang Hung-yi Lee 33 6 0 30 Jan 2022
Supervised Visual Attention for Simultaneous Multimodal Machine Translation Veneta Haralampieva Ozan Caglayan Lucia Specia LRM 48 4 0 23 Jan 2022
SimulSLT: End-to-End Simultaneous Sign Language Translation Aoxiong Yin Zhou Zhao Jinglin Liu Weike Jin Meng Zhang Xingshan Zeng Xiaofei He SLR 25 33 0 08 Dec 2021
Simultaneous Neural Machine Translation with Constituent Label Prediction Yasumasa Kano Katsuhito Sudoh Satoshi Nakamura 11 3 0 26 Oct 2021
Monotonic Simultaneous Translation with Chunk-wise Reordering and Refinement HyoJung Han Seokchan Ahn Yoonjung Choi Insoo Chung Sangha Kim Kyunghyun Cho 33 6 0 18 Oct 2021
Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attention Xutai Ma Hongyu Gong Danni Liu Ann Lee Yun Tang Peng-Jen Chen Wei-Ning Hsu P. Koehn J. Pino 62 8 0 15 Oct 2021
Decision Attentive Regularization to Improve Simultaneous Speech Translation Systems Mohd Abbas Zaidi Beomseok Lee Sangha Kim Chanwoo Kim 30 5 0 13 Oct 2021
Translating Images into Maps Avishkar Saha Oscar Alejandro Mendez Maldonado Chris Russell Richard Bowden ViT 21 145 0 03 Oct 2021
Learning When to Translate for Streaming Speech Qianqian Dong Yaoming Zhu Mingxuan Wang Lei Li 52 30 0 15 Sep 2021
Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy Shaolei Zhang Yang Feng MoE 30 39 0 11 Sep 2021
Infusing Future Information into Monotonic Attention Through Language Models Mohd Abbas Zaidi S. Indurthi Beomseok Lee Nikhil Kumar Lakumarapu Sangha Kim 27 2 0 07 Sep 2021
The USTC-NELSLIP Systems for Simultaneous Speech Translation Task at IWSLT 2021 Dan Liu Mengge Du Xiaoxi Li Yuchen Hu Lirong Dai 26 20 0 01 Jul 2021
Full-Sentence Models Perform Better in Simultaneous Translation Using the Information Enhanced Decoding Strategy Zhen Yang 25 0 0 05 May 2021
Impact of Encoding and Segmentation Strategies on End-to-End Simultaneous Speech Translation H. Nguyen Yannick Esteve Laurent Besacier 36 6 0 29 Apr 2021
On Biasing Transformer Attention Towards Monotonicity Annette Rios Gonzales Chantal Amrhein Noëmi Aepli Rico Sennrich 4 7 0 08 Apr 2021
Mutually-Constrained Monotonic Multihead Attention for Online ASR Jae-gyun Song Hajin Shim Eunho Yang 11 0 0 26 Mar 2021
Mask Attention Networks: Rethinking and Strengthen Transformer Zhihao Fan Yeyun Gong Dayiheng Liu Zhongyu Wei Siyuan Wang Jian Jiao Nan Duan Ruofei Zhang Xuanjing Huang 34 72 0 25 Mar 2021
An Empirical Study of End-to-end Simultaneous Speech Translation Decoding Strategies H. Nguyen Yannick Esteve Laurent Besacier 35 19 0 04 Mar 2021
Thank you for Attention: A survey on Attention-based Artificial Neural Networks for Automatic Speech Recognition Priyabrata Karmakar S. Teng Guojun Lu 27 25 0 14 Feb 2021
Future-Guided Incremental Transformer for Simultaneous Translation Shaolei Zhang Yang Feng Liangyou Li CLL 6 38 0 23 Dec 2020
SimulMT to SimulST: Adapting Simultaneous Text Translation to End-to-End Simultaneous Speech Translation Xutai Ma J. Pino Philipp Koehn 17 94 0 03 Nov 2020
Streaming Simultaneous Speech Translation with Augmented Memory Transformer Xutai Ma Yongqiang Wang M. Dousti Philipp Koehn J. Pino 14 37 0 30 Oct 2020
Fluent and Low-latency Simultaneous Speech-to-Speech Translation with Self-adaptive Training Renjie Zheng Mingbo Ma Baigong Zheng Kaibo Liu Jiahong Yuan Kenneth Church Liang Huang 10 14 0 20 Oct 2020
fairseq S2T: Fast Speech-to-Text Modeling with fairseq Changhan Wang Yun Tang Xutai Ma Anne Wu Sravya Popuri Dmytro Okhonko J. Pino VLM LRM 36 264 0 11 Oct 2020
What the Future Brings: Investigating the Impact of Lookahead for Incremental Neural TTS Brooke Stephenson Laurent Besacier Laurent Girin Thomas Hueber 10 13 0 04 Sep 2020
SimulEval: An Evaluation Toolkit for Simultaneous Translation Xutai Ma M. Dousti Changhan Wang Jiatao Gu J. Pino 20 103 0 31 Jul 2020
Temporally Correlated Task Scheduling for Sequence Learning Xueqing Wu Lewen Wang Yingce Xia Weiqing Liu Lijun Wu Shufang Xie Tao Qin Tie-Yan Liu 24 10 0 10 Jul 2020
Fast Transformers with Clustered Attention Apoorv Vyas Angelos Katharopoulos Franccois Fleuret 21 151 0 09 Jul 2020
Online Versus Offline NMT Quality: An In-depth Analysis on English-German and German-English Maha Elbayad M. Ustaszewski Emmanuelle Esperancca-Rodier Francis Brunet Manquat Jakob Verbeek Laurent Besacier OffRL 28 10 0 01 Jun 2020
ON-TRAC Consortium for End-to-End and Simultaneous Speech Translation Challenge Tasks at IWSLT 2020 Maha Elbayad H. Nguyen Fethi Bougares N. Tomashenko Antoine Caubrière Benjamin Lecouteux Yannick Esteve Laurent Besacier 19 12 0 24 May 2020
Low-Latency Sequence-to-Sequence Speech Recognition and Translation by Partial Hypothesis Selection Danni Liu Gerasimos Spanakis Jan Niehues 25 49 0 22 May 2020
Enhancing Monotonic Multihead Attention for Streaming ASR Hirofumi Inaguma Masato Mimura Tatsuya Kawahara 16 32 0 19 May 2020
Efficient Wait-k Models for Simultaneous Machine Translation Maha Elbayad Laurent Besacier Jakob Verbeek VLM 24 77 0 18 May 2020
Speech Recognition and Multi-Speaker Diarization of Long Conversations H. H. Mao Shuyang Li Julian McAuley G. Cottrell VLM 27 40 0 16 May 2020
Opportunistic Decoding with Timely Correction for Simultaneous Translation Renjie Zheng Mingbo Ma Baigong Zheng Kaibo Liu Liang Huang 17 18 0 02 May 2020
Re-translation versus Streaming for Simultaneous Translation N. Arivazhagan Colin Cherry Wolfgang Macherey George F. Foster 6 63 0 07 Apr 2020
Discriminative Neural Clustering for Speaker Diarisation Qiujia Li Florian Kreyssig Chao Zhang P. Woodland 11 44 0 22 Oct 2019
An Attentive Survey of Attention Models S. Chaudhari Varun Mithal Gungor Polatkan R. Ramanath 30 641 0 05 Apr 2019
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 220 7,930 0 17 Aug 2015