End-to-end spoken language understanding using transformer networks and
self-supervised pre-trained features

End-to-end spoken language understanding using transformer networks and self-supervised pre-trained features

16 November 2020

Brian Kingsbury

ArXiv (abs)PDF HTML

Papers citing "End-to-end spoken language understanding using transformer networks and self-supervised pre-trained features"

14 / 14 papers shown

Title
End-to-End Spoken Language Understanding Without Full Transcripts H. Kuo Zoltán Tüske Samuel Thomas Yinghui Huang Kartik Audhkhasi Brian Kingsbury Gakuto Kurata Zvi Kons R. Hoory Luis A. Lastras AuLLM 69 26 0 30 Sep 2020
End-to-End Neural Transformer Based Spoken Language Understanding Martin H. Radfar Athanasios Mouchtaris Siegfried Kunzmann 98 61 0 12 Aug 2020
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech Andy T. Liu Shang-Wen Li Hung-yi Lee SSL 132 359 0 12 Jul 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 299 5,849 0 20 Jun 2020
Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation Po-Han Chi Pei-Hung Chung Tsung-Han Wu Chun-Cheng Hsieh Yen-Hao Chen Shang-Wen Li Hung-yi Lee SSL 70 148 0 18 May 2020
ESPnet-ST: All-in-One Speech Translation Toolkit Hirofumi Inaguma Shun Kiyono Kevin Duh Shigeki Karita Nelson Yalta Tomoki Hayashi Shinji Watanabe 98 166 0 21 Apr 2020
Improved Speech Representations with Multi-Target Autoregressive Predictive Coding Yu-An Chung James R. Glass SSL 67 56 0 11 Apr 2020
Leveraging Lead Bias for Zero-shot Abstractive News Summarization Chenguang Zhu Ziyi Yang R. Gmyr Michael Zeng Xuedong Huang 43 19 0 25 Dec 2019
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders Andy T. Liu Shu-Wen Yang Po-Han Chi Po-Chun Hsu Hung-yi Lee SSL 155 374 0 25 Oct 2019
Curriculum-based transfer learning for an effective end-to-end spoken language understanding and domain portability Antoine Caubrière N. Tomashenko Antoine Laurent Emmanuel Morin Nathalie Camelin Yannick Esteve 50 54 0 18 Jun 2019
Speech Model Pre-training for End-to-End Spoken Language Understanding Loren Lugosch Mirco Ravanelli Patrick Ignoto Vikrant Singh Tomar Yoshua Bengio SyDa AuLLM 70 355 0 07 Apr 2019
From Audio to Semantics: Approaches to end-to-end spoken language understanding Parisa Haghani A. Narayanan M. Bacchiani Galen Chuang Neeraj Gaur Pedro J. Moreno Rohit Prabhavalkar Zhongdi Qu Austin Waters 58 150 0 24 Sep 2018
SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing Taku Kudo John Richardson 206 3,531 0 19 Aug 2018
Towards end-to-end spoken language understanding Dmitriy Serdyuk Yongqiang Wang Christian Fuegen Anuj Kumar Baiyang Liu Yoshua Bengio 60 233 0 23 Feb 2018