BERT Meets CTC: New Formulation of End-to-End Speech Recognition with
Pre-trained Masked Language Model

v1v2 (latest)

BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model

29 October 2022

Tetsunori Kobayashi

Shinji Watanabe

ArXiv (abs)PDF HTML

Papers citing "BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model"

15 / 65 papers shown

Title
AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baseline Hui Bu Jiayu Du Xingyu Na Bengu Wu Hao Zheng CVBM 61 841 0 16 Sep 2017
Cold Fusion: Training Seq2Seq Models Together with Language Models Anuroop Sriram Heewoo Jun S. Satheesh Adam Coates VLM 84 281 0 21 Aug 2017
Recent Trends in Deep Learning Based Natural Language Processing Tom Young Devamanyu Hazarika Soujanya Poria Min Zhang 75 2,835 0 09 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 701 131,652 0 12 Jun 2017
Towards better decoding and language model integration in sequence to sequence models J. Chorowski Navdeep Jaitly 76 369 0 08 Dec 2016
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 221 7,745 0 31 Aug 2015
Listen, Attend and Spell William Chan Navdeep Jaitly Quoc V. Le Oriol Vinyals RALM 156 2,266 0 05 Aug 2015
Attention-Based Models for Speech Recognition J. Chorowski Dzmitry Bahdanau Dmitriy Serdyuk Kyunghyun Cho Yoshua Bengio 127 2,607 0 24 Jun 2015
On Using Monolingual Corpora in Neural Machine Translation Çağlar Gülçehre Orhan Firat Kelvin Xu Kyunghyun Cho Loïc Barrault Huei-Chi Lin Fethi Bougares Holger Schwenk Yoshua Bengio 124 562 0 11 Mar 2015
Deep Speech: Scaling up end-to-end speech recognition Awni Y. Hannun Carl Case Jared Casper Bryan Catanzaro G. Diamos ... R. Prenger S. Satheesh Shubho Sengupta Adam Coates A. Ng 180 2,128 0 17 Dec 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 437 20,568 0 10 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 560 27,311 0 01 Sep 2014
Speech Recognition with Deep Recurrent Neural Networks Alex Graves Abdel-rahman Mohamed Geoffrey E. Hinton 226 8,517 0 22 Mar 2013
Sequence Transduction with Recurrent Neural Networks Alex Graves 191 1,870 0 14 Nov 2012
Natural Language Processing (almost) from Scratch R. Collobert Jason Weston Léon Bottou Michael Karlen Koray Kavukcuoglu Pavel P. Kuksa 191 7,726 0 02 Mar 2011