Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining

26 October 2020

Papers citing "Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining"

27 / 27 papers shown

Title
Semi-Supervised Cognitive State Classification from Speech with Multi-View Pseudo-Labeling Yuanchao Li Zixing Zhang Jing Han P. Bell Catherine Lai 90 1 0 25 Sep 2024
Style Attuned Pre-training and Parameter Efficient Fine-tuning for Spoken Language Understanding Jin Cao Jun Wang Wael Hamza Kelly Vanee Shang-Wen Li 21 10 0 09 Oct 2020
Speech To Semantics: Improve ASR and NLU Jointly via All-Neural Interfaces Milind Rao A. Raju Pranav Dheram Bach Bui Ariya Rastrow 45 43 0 14 Aug 2020
End-to-End Neural Transformer Based Spoken Language Understanding Martin H. Radfar Athanasios Mouchtaris Siegfried Kunzmann 72 61 0 12 Aug 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 219 5,767 0 20 Jun 2020
Speech to Text Adaptation: Towards an Efficient Cross-Modal Distillation Won Ik Cho Donghyun Kwak J. Yoon N. Kim 58 26 0 17 May 2020
SpeechBERT: An Audio-and-text Jointly Learned Language Model for End-to-end Spoken Question Answering Yung-Sung Chuang Chi-Liang Liu Hung-yi Lee Lin-shan Lee AuLLM 53 39 0 25 Oct 2019
Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders Andy T. Liu Shu-Wen Yang Po-Han Chi Po-Chun Hsu Hung-yi Lee SSL 130 373 0 25 Oct 2019
Gunrock: A Social Bot for Complex and Engaging Long Conversations Dian Yu Michelle Cohn Yi Mang Yang Chun-Yen Chen Weiming Wen ... Shreenath Iyer G. Sreenivasulu Sam Davidson Ashwin Bhandare Zhou Yu 48 30 0 07 Oct 2019
Recent Advances in End-to-End Spoken Language Understanding N. Tomashenko Antoine Caubrière Yannick Esteve Antoine Laurent Emmanuel Morin 55 29 0 29 Sep 2019
Learning ASR-Robust Contextualized Embeddings for Spoken Language Understanding Chao-Wei Huang Yun-Nung Chen 35 43 0 24 Sep 2019
A scalable noisy speech dataset and online subjective test framework Chandan K. A. Reddy Ebrahim Beyrami Jamie Pool Ross Cutler Sriram Srinivasan J. Gehrke 86 145 0 17 Sep 2019
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition Daniel S. Park William Chan Yu Zhang Chung-Cheng Chiu Barret Zoph E. D. Cubuk Quoc V. Le VLM 159 3,451 0 18 Apr 2019
Mitigating the Impact of Speech Recognition Errors on Spoken Question Answering by Adversarial Domain Adaptation Chia-Hsuan Lee Yun-Nung Chen Hung-yi Lee 46 22 0 16 Apr 2019
wav2vec: Unsupervised Pre-training for Speech Recognition Steffen Schneider Alexei Baevski R. Collobert Michael Auli SSL 62 418 0 11 Apr 2019
Speech Model Pre-training for End-to-End Spoken Language Understanding Loren Lugosch Mirco Ravanelli Patrick Ignoto Vikrant Singh Tomar Yoshua Bengio SyDa AuLLM 63 352 0 07 Apr 2019
An Unsupervised Autoregressive Model for Speech Representation Learning Yu-An Chung Wei-Ning Hsu Hao Tang James R. Glass SSL 74 408 0 05 Apr 2019
BERT for Joint Intent Classification and Slot Filling Qian Chen Zhu Zhuo Wen Wang VLM 68 553 0 28 Feb 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.3K 94,511 0 11 Oct 2018
From Audio to Semantics: Approaches to end-to-end spoken language understanding Parisa Haghani A. Narayanan M. Bacchiani Galen Chuang Neeraj Gaur Pedro J. Moreno Rohit Prabhavalkar Zhongdi Qu Austin Waters 50 150 0 24 Sep 2018
SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing Taku Kudo John Richardson 175 3,514 0 19 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 278 10,253 0 10 Jul 2018
End-to-end named entity extraction from speech Sahar Ghannay Antoine Caubrière Yannick Esteve Antoine Laurent Emmanuel Morin 54 24 0 30 May 2018
Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces A. Coucke Alaa Saade Adrien Ball Théodore Bluche A. Caulier ... Thibault Gisselbrecht F. Caltagirone Thibaut Lavril Maël Primet Joseph Dureau SyDa 110 822 0 25 May 2018
Towards end-to-end spoken language understanding Dmitriy Serdyuk Yongqiang Wang Christian Fuegen Anuj Kumar Baiyang Liu Yoshua Bengio 52 232 0 23 Feb 2018
Encoder-decoder with Focus-mechanism for Sequence Labelling Based Spoken Language Understanding Su Zhu Kai Yu 59 72 0 06 Aug 2016
Listen, Attend and Spell William Chan Navdeep Jaitly Quoc V. Le Oriol Vinyals RALM 147 2,264 0 05 Aug 2015