Gated Recurrent Context: Softmax-free Attention for Online
Encoder-Decoder Speech Recognition

v1v2v3 (latest)

Gated Recurrent Context: Softmax-free Attention for Online Encoder-Decoder Speech Recognition

10 July 2020

Hyeongju Kim

ArXiv (abs)PDF HTML

Papers citing "Gated Recurrent Context: Softmax-free Attention for Online Encoder-Decoder Speech Recognition"

14 / 14 papers shown

Title
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 203 1,793 0 29 Jun 2020
Towards Online End-to-end Transformer Automatic Speech Recognition E. Tsunoo Yosuke Kashiwagi Toshiyuki Kumakura Shinji Watanabe 68 32 0 25 Oct 2019
Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernel Yao-Hung Hubert Tsai Shaojie Bai M. Yamada Louis-Philippe Morency Ruslan Salakhutdinov 129 261 0 30 Aug 2019
Two-Pass End-to-End Speech Recognition Tara N. Sainath Ruoming Pang David Rybach Yanzhang He Rohit Prabhavalkar ... Qiao Liang Trevor Strohman Yonghui Wu Ian McGraw Chung-Cheng Chiu 80 148 0 29 Aug 2019
Monotonic Infinite Lookback Attention for Simultaneous Machine Translation N. Arivazhagan Colin Cherry Wolfgang Macherey Chung-Cheng Chiu Semih Yavuz Ruoming Pang Wei Li Colin Raffel CLL 49 196 0 12 Jun 2019
CIF: Continuous Integrate-and-Fire for End-to-End Speech Recognition Linhao Dong Bo Xu 73 128 0 27 May 2019
RETURNN as a Generic Flexible Neural Toolkit with Application to Translation and Speech Recognition Albert Zeyer Tamer Alkhouli Hermann Ney 65 92 0 14 May 2018
Improving the Performance of Online Neural Transducer Models Tara N. Sainath Chung-Cheng Chiu Rohit Prabhavalkar Anjuli Kannan Yonghui Wu Patrick Nguyen Zhiwen Chen AI4TS 79 49 0 05 Dec 2017
State-of-the-art Speech Recognition With Sequence-to-Sequence Models Chung-Cheng Chiu Tara N. Sainath Yonghui Wu Rohit Prabhavalkar Patrick Nguyen ... Katya Gonina Navdeep Jaitly Yue Liu J. Chorowski M. Bacchiani AI4TS 93 1,154 0 05 Dec 2017
A Comprehensive Study of Deep Bidirectional LSTM RNNs for Acoustic Modeling in Speech Recognition Albert Zeyer P. Doetsch P. Voigtlaender Ralf Schluter Hermann Ney 61 169 0 22 Jun 2016
Highway Long Short-Term Memory RNNs for Distant Speech Recognition Yu Zhang Guoguo Chen Dong Yu Kaisheng Yao Sanjeev Khudanpur James R. Glass 3DV AI4TS 66 292 0 30 Oct 2015
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 413 7,971 0 17 Aug 2015
Listen, Attend and Spell William Chan Navdeep Jaitly Quoc V. Le Oriol Vinyals RALM 163 2,269 0 05 Aug 2015
Sequence Transduction with Recurrent Neural Networks Alex Graves 195 1,872 0 14 Nov 2012

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.