Streaming Chunk-Aware Multihead Attention for Online End-to-End Speech
Recognition

Streaming Chunk-Aware Multihead Attention for Online End-to-End Speech Recognition

21 May 2020

Lei Xie

ArXiv (abs)PDF HTML

Papers citing "Streaming Chunk-Aware Multihead Attention for Online End-to-End Speech Recognition"

18 / 18 papers shown

Title
SAN-M: Memory Equipped Self-Attention for End-to-End Speech Recognition Zhifu Gao Shiliang Zhang Ming Lei Ian Mcloughlin 54 35 0 21 May 2020
Streaming automatic speech recognition with the transformer model Niko Moritz Takaaki Hori Jonathan Le Roux 76 186 0 08 Jan 2020
Towards Online End-to-end Transformer Automatic Speech Recognition E. Tsunoo Yosuke Kashiwagi Toshiyuki Kumakura Shinji Watanabe 65 32 0 25 Oct 2019
A Comparative Study on Transformer vs RNN in Speech Applications Shigeki Karita Nanxin Chen Tomoki Hayashi Takaaki Hori Hirofumi Inaguma ... Ryuichi Yamamoto Xiao-fei Wang Shinji Watanabe Takenori Yoshimura Wangyou Zhang 74 721 0 13 Sep 2019
Very Deep Self-Attention Networks for End-to-End Speech Recognition Ngoc-Quan Pham T. Nguyen Jan Niehues Markus Müller Sebastian Stüker A. Waibel 60 161 0 30 Apr 2019
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition Daniel S. Park William Chan Yu Zhang Chung-Cheng Chiu Barret Zoph E. D. Cubuk Quoc V. Le VLM 177 3,465 0 18 Apr 2019
An Online Attention-based Model for Speech Recognition Ruchao Fan Pan Zhou Wei Chen Jia Jia Gang Liu 45 48 0 13 Nov 2018
Deep-FSMN for Large Vocabulary Continuous Speech Recognition Shiliang Zhang Ming Lei Zhijie Yan Lirong Dai 77 110 0 04 Mar 2018
Monotonic Chunkwise Attention Chung-Cheng Chiu Colin Raffel 67 256 0 14 Dec 2017
AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baseline Hui Bu Jiayu Du Xingyu Na Bengu Wu Hao Zheng CVBM 66 844 0 16 Sep 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 728 132,199 0 12 Jun 2017
Online and Linear-Time Attention by Enforcing Monotonic Alignments Colin Raffel Minh-Thang Luong Peter J. Liu Ron J. Weiss Douglas Eck 78 261 0 03 Apr 2017
TensorFlow: A system for large-scale machine learning Martín Abadi P. Barham Jianmin Chen Zhiwen Chen Andy Davis ... Vijay Vasudevan Pete Warden Martin Wicke Yuan Yu Xiaoqiang Zhang GNN AI4CE 433 18,361 0 27 May 2016
Listen, Attend and Spell William Chan Navdeep Jaitly Quoc V. Le Oriol Vinyals RALM 156 2,269 0 05 Aug 2015
Fast and Accurate Recurrent Neural Network Acoustic Models for Speech Recognition Hasim Sak A. Senior Kanishka Rao F. Beaufays 85 436 0 24 Jul 2015
Attention-Based Models for Speech Recognition J. Chorowski Dzmitry Bahdanau Dmitriy Serdyuk Kyunghyun Cho Yoshua Bengio 129 2,609 0 24 Jun 2015
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 575 27,325 0 01 Sep 2014
Sequence Transduction with Recurrent Neural Networks Alex Graves 191 1,871 0 14 Nov 2012