Pretrained Semantic Speech Embeddings for End-to-End Spoken Language Understanding via Cross-Modal Teacher-Student Learning

3 July 2020

Papers citing "Pretrained Semantic Speech Embeddings for End-to-End Spoken Language Understanding via Cross-Modal Teacher-Student Learning"

22 / 22 papers shown

Title
SpeechBERT: An Audio-and-text Jointly Learned Language Model for End-to-end Spoken Question Answering Yung-Sung Chuang Chi-Liang Liu Hung-yi Lee Lin-shan Lee AuLLM 53 39 0 25 Oct 2019
A Comparative Study on Transformer vs RNN in Speech Applications Shigeki Karita Nanxin Chen Tomoki Hayashi Takaaki Hori Hirofumi Inaguma ... Ryuichi Yamamoto Xiao-fei Wang Shinji Watanabe Takenori Yoshimura Wangyou Zhang 65 720 0 13 Sep 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 948 12,129 0 27 Aug 2019
IMS-Speech: A Speech to Text Tool Pavel Denisov Ngoc Thang Vu 51 11 0 13 Aug 2019
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition Daniel S. Park William Chan Yu Zhang Chung-Cheng Chiu Barret Zoph E. D. Cubuk Quoc V. Le VLM 159 3,451 0 18 Apr 2019
Speech Model Pre-training for End-to-End Spoken Language Understanding Loren Lugosch Mirco Ravanelli Patrick Ignoto Vikrant Singh Tomar Yoshua Bengio SyDa AuLLM 63 352 0 07 Apr 2019
Context-aware Neural-based Dialog Act Classification on Automatically Generated Transcriptions Daniel Ortega Chia-Yu Li Gisela Vallejo Pavel Denisov Ngoc Thang Vu 42 12 0 28 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.4K 94,511 0 11 Oct 2018
From Audio to Semantics: Approaches to end-to-end spoken language understanding Parisa Haghani A. Narayanan M. Bacchiani Galen Chuang Neeraj Gaur Pedro J. Moreno Rohit Prabhavalkar Zhongdi Qu Austin Waters 50 150 0 24 Sep 2018
End-to-end Speech Recognition with Word-based RNN Language Models Takaaki Hori Jaejin Cho Shinji Watanabe 62 106 0 08 Aug 2018
Unsupervised Cross-Modal Alignment of Speech and Text Embedding Spaces Yu-An Chung W. Weng S. Tong James R. Glass 71 100 0 18 May 2018
Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates Taku Kudo 186 1,165 0 29 Apr 2018
Speech2Vec: A Sequence-to-Sequence Framework for Learning Word Embeddings from Speech Yu-An Chung James R. Glass 3DV 64 184 0 23 Mar 2018
Lexico-acoustic Neural-based Models for Dialog Act Classification Daniel Ortega Ngoc Thang Vu 29 19 0 02 Mar 2018
Towards end-to-end spoken language understanding Dmitriy Serdyuk Yongqiang Wang Christian Fuegen Anuj Kumar Baiyang Liu Yoshua Bengio 52 232 0 23 Feb 2018
Large-Scale Domain Adaptation via Teacher-Student Learning Jinyu Li M. Seltzer Xi Wang Rui Zhao Jiawei Liu 115 140 0 17 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 622 130,942 0 12 Jun 2017
Transfer Learning for Speech Recognition on a Budget Julius Kunze Louis Kirsch Ilia Kurenkov A. Krug Jens Johannsmeier Sebastian Stober 48 138 0 01 Jun 2017
Towards better decoding and language model integration in sequence to sequence models J. Chorowski Navdeep Jaitly 71 369 0 08 Dec 2016
Joint CTC-Attention based End-to-End Speech Recognition using Multi-task Learning Suyoun Kim Takaaki Hori Shinji Watanabe 71 925 0 21 Sep 2016
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 304 19,580 0 09 Mar 2015
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 349 33,500 0 16 Oct 2013