Evaluating and Improving Continual Learning in Spoken Language Understanding

16 February 2024

Muqiao Yang

Xiang Li

Umberto Cappellazzo

Shinji Watanabe

Bhiksha Raj

CLL

ArXiv (abs)PDF HTML

Papers citing "Evaluating and Improving Continual Learning in Spoken Language Understanding"

23 / 23 papers shown

Title
Progressive Prompts: Continual Learning for Language Models Anastasia Razdaibiedina Yuning Mao Rui Hou Madian Khabsa M. Lewis Amjad Almahairi VLM KELM CLL 106 140 0 29 Jan 2023
Continual Learning for On-Device Speech Recognition using Disentangled Conformers Anuj Diwan Ching-Feng Yeh Wei-Ning Hsu Paden Tomasello Eunsol Choi David Harwath Abdel-rahman Mohamed CLL BDL 60 8 0 02 Dec 2022
Continual evaluation for lifelong learning: Identifying the stability gap Matthias De Lange Gido M. van de Ven Tinne Tuytelaars CLL 157 42 0 26 May 2022
The Effect of Task Ordering in Continual Learning Samuel J. Bell Neil D. Lawrence CLL 73 17 0 26 May 2022
Rainbow Keywords: Efficient Incremental Learning for Online Spoken Keyword Spotting Yanghua Xiao Nana Hou Eng Siong Chng CLL 50 15 0 30 Mar 2022
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 101 794 0 16 Dec 2021
DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT Heng-Jui Chang Shu-Wen Yang Hung-yi Lee SSL 112 174 0 05 Oct 2021
Towards Lifelong Learning of End-to-end ASR Heng-Jui Chang Hung-yi Lee Lin-Shan Lee KELM CLL 85 34 0 04 Apr 2021
Rainbow Memory: Continual Learning with a Memory of Diverse Samples Jihwan Bang Heesu Kim Y. Yoo Jung-Woo Ha Jonghyun Choi CLL 102 343 0 31 Mar 2021
Distilling Causal Effect of Data in Class-Incremental Learning Xinting Hu Kaihua Tang Chunyan Miao Xiansheng Hua Hanwang Zhang CML 244 177 0 02 Mar 2021
SLURP: A Spoken Language Understanding Resource Package E. Bastianelli Andrea Vanzo P. Swietojanski Verena Rieser VLM 93 231 0 26 Nov 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 291 5,837 0 20 Jun 2020
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,295 0 27 Aug 2019
Speech Model Pre-training for End-to-End Spoken Language Understanding Loren Lugosch Mirco Ravanelli Patrick Ignoto Vikrant Singh Tomar Yoshua Bengio SyDa AuLLM 68 355 0 07 Apr 2019
Experience Replay for Continual Learning David Rolnick Arun Ahuja Jonathan Richard Schwarz Timothy Lillicrap Greg Wayne CLL 116 1,171 0 28 Nov 2018
Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfaces A. Coucke Alaa Saade Adrien Ball Théodore Bluche A. Caulier ... Thibault Gisselbrecht F. Caltagirone Thibaut Lavril Maël Primet Joseph Dureau SyDa 115 827 0 25 May 2018
Progress & Compress: A scalable framework for continual learning Jonathan Richard Schwarz Jelena Luketina Wojciech M. Czarnecki A. Grabska-Barwinska Yee Whye Teh Razvan Pascanu R. Hadsell CLL 125 889 0 16 May 2018
Memory Aware Synapses: Learning what (not) to forget Rahaf Aljundi F. Babiloni Mohamed Elhoseiny Marcus Rohrbach Tinne Tuytelaars KELM CLL 87 1,646 0 27 Nov 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 127 2,735 0 26 Jun 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 372 7,561 0 02 Dec 2016
iCaRL: Incremental Classifier and Representation Learning Sylvestre-Alvise Rebuffi Alexander Kolesnikov G. Sperl Christoph H. Lampert CLL OOD 160 3,774 0 23 Nov 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 304 4,428 0 29 Jun 2016
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 228 7,755 0 31 Aug 2015