Mixed-Precision Training for NLP and Speech Recognition with OpenSeq2Seq

Mixed-Precision Training for NLP and Speech Recognition with OpenSeq2Seq

25 May 2018

Oleksii Kuchaiev

Boris Ginsburg

Vitaly Lavrukhin

Jason Chun Lok Li

Paulius Micikevicius

Papers citing "Mixed-Precision Training for NLP and Speech Recognition with OpenSeq2Seq"

16 / 16 papers shown

Title
Evaluating OpenAI's Whisper ASR for Punctuation Prediction and Topic Modeling of life histories of the Museum of the Person L. Gris R. Marcacini Arnaldo Cândido Júnior Edresson Casanova A. S. Soares S. Aluísio 21 7 0 23 May 2023
Transformers in Speech Processing: A Survey S. Latif Aun Zaidi Heriberto Cuayáhuitl Fahad Shamshad Moazzam Shoukat Junaid Qadir 42 47 0 21 Mar 2023
Unit Scaling: Out-of-the-Box Low-Precision Training Charlie Blake Douglas Orr Carlo Luschi MQ 24 7 0 20 Mar 2023
Inter-KD: Intermediate Knowledge Distillation for CTC-Based Automatic Speech Recognition J. Yoon Beom Jun Woo Sunghwan Ahn Hyeon Seung Lee N. Kim VLM 23 9 0 28 Nov 2022
ApproxTrain: Fast Simulation of Approximate Multipliers for DNN Training and Inference Jing Gong Hassaan Saadat Hasindu Gamaarachchi Haris Javaid X. Hu S. Parameswaran 31 12 0 09 Sep 2022
8-bit Numerical Formats for Deep Neural Networks Badreddine Noune Philip Jones Daniel Justus Dominic Masters Carlo Luschi MQ 23 34 0 06 Jun 2022
Oracle Teacher: Leveraging Target Information for Better Knowledge Distillation of CTC Models J. Yoon H. Kim Hyeon Seung Lee Sunghwan Ahn N. Kim 36 1 0 05 Nov 2021
Inductive biases, pretraining and fine-tuning jointly account for brain responses to speech Juliette Millet J. King 53 34 0 25 Feb 2021
End-to-End Speech Recognition and Disfluency Removal Paria Jamshid Lou Mark Johnson 19 32 0 22 Sep 2020
ESPnet-TTS: Unified, Reproducible, and Integratable Open Source End-to-End Text-to-Speech Toolkit Tomoki Hayashi Ryuichi Yamamoto Katsuki Inoue Takenori Yoshimura Shinji Watanabe T. Toda K. Takeda Yu Zhang Xu Tan VLM 29 201 0 24 Oct 2019
Exascale Deep Learning for Scientific Inverse Problems N. Laanait Josh Romero Junqi Yin M. T. Young Sean Treichler V. Starchenko A. Borisevich Alexander Sergeev Michael A. Matheson FedML BDL 35 29 0 24 Sep 2019
Mixed Precision Training With 8-bit Floating Point Naveen Mellempudi Sudarshan Srinivasan Dipankar Das Bharat Kaul MQ 18 68 0 29 May 2019
TTS Skins: Speaker Conversion via ASR Adam Polyak Lior Wolf Yaniv Taigman 18 27 0 18 Apr 2019
wav2letter++: The Fastest Open-source Speech Recognition System Vineel Pratap Awni Y. Hannun Qiantong Xu Jeff Cai Jacob Kahn Gabriel Synnaeve Vitaliy Liptchinsky R. Collobert VLM 15 156 0 18 Dec 2018
OpenNMT: Open-Source Toolkit for Neural Machine Translation Guillaume Klein Yoon Kim Yuntian Deng Jean Senellart Alexander M. Rush 273 1,896 0 10 Jan 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,748 0 26 Sep 2016