An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks

21 December 2013

Aaron Courville

Papers citing "An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks"

50 / 306 papers shown

Title
Exemplar-free Continual Learning of Vision Transformers via Gated Class-Attention and Cascaded Feature Drift Compensation Marco Cotogni Fei Yang C. Cusano Andrew D. Bagdanov Joost van de Weijer CLL 30 0 0 22 Nov 2022
AF Adapter: Continual Pretraining for Building Chinese Biomedical Language Model Yongyu Yan Kui Xue Xiaoming Shi Qi Ye Jingping Liu Tong Ruan CLL 47 1 0 21 Nov 2022
Unveiling the Tapestry: the Interplay of Generalization and Forgetting in Continual Learning Zenglin Shi Jing Jie Ying Sun J. Lim Mengmi Zhang CLL 44 1 0 21 Nov 2022
Delving into Transformer for Incremental Semantic Segmentation Zekai Xu Mingying Zhang Jiayue Hou Xing Gong Chuan Wen Chengjie Wang Junge Zhang CLL 29 1 0 18 Nov 2022
Eliciting Knowledge from Large Pre-Trained Models for Unsupervised Knowledge-Grounded Conversation Yanyang Li Jianqiao Zhao M. Lyu Liwei Wang 24 15 0 03 Nov 2022
Domain Curricula for Code-Switched MT at MixMT 2022 Lekan Raheem Maab Elrashid 34 1 0 31 Oct 2022
Correlation of the importances of neural network weights calculated by modern methods of overcoming catastrophic forgetting Alexey Kutalev 16 0 0 24 Oct 2022
Scalable Representation Learning in Linear Contextual Bandits with Constant Regret Guarantees Andrea Tirinzoni Matteo Papini Ahmed Touati A. Lazaric Matteo Pirotta 33 4 0 24 Oct 2022
Task-Free Continual Learning via Online Discrepancy Distance Learning Fei Ye A. Bors CLL 24 28 0 12 Oct 2022
Multi-Object Navigation with dynamically learned neural implicit representations Pierre Marza L. Matignon Olivier Simonin Christian Wolf 35 23 0 11 Oct 2022
Grow and Merge: A Unified Framework for Continuous Categories Discovery Xinwei Zhang Jianwen Jiang Yutong Feng Zhi-Fan Wu Xibin Zhao Hai Wan Mingqian Tang Rong Jin Yue Gao CLL 43 29 0 09 Oct 2022
Optimizing Class Distribution in Memory for Multi-Label Online Continual Learning Yanyan Liang Wu-Jun Li CLL 29 8 0 23 Sep 2022
Learn the Time to Learn: Replay Scheduling in Continual Learning Marcus Klasson Hedvig Kjellström Chen Zhang CLL 37 9 0 18 Sep 2022
Continual Learning for Class- and Domain-Incremental Semantic Segmentation Tobias Kalb M. Roschani M. Ruf Jürgen Beyerer CLL VLM 19 23 0 16 Sep 2022
The Role Of Biology In Deep Learning Robert Bain 27 0 0 07 Sep 2022
Dynamic Data-Free Knowledge Distillation by Easy-to-Hard Learning Strategy Jingru Li Sheng Zhou Liangcheng Li Haishuai Wang Zhi Yu Jiajun Bu 39 14 0 29 Aug 2022
Continual Prune-and-Select: Class-incremental learning with specialized subnetworks Aleksandr Dekhovich David Tax M. Sluiter Miguel A. Bessa CLL 31 20 0 09 Aug 2022
A Multi-label Continual Learning Framework to Scale Deep Learning Approaches for Packaging Equipment Monitoring Davide Dalle Pezze Denis Deronjic Chiara Masiero Diego Tosato A. Beghi Gian Antonio Susto CLL 34 9 0 08 Aug 2022
Progressive Voronoi Diagram Subdivision: Towards A Holistic Geometric Framework for Exemplar-free Class-Incremental Learning Chunwei Ma Zhanghexuan Ji Ziyun Huang Yan Shen Mingchen Gao Jinhui Xu 33 1 0 28 Jul 2022
Streamable Neural Fields Junwoo Cho Seungtae Nam Daniel Rho J. Ko Eunbyung Park AI4TS 40 17 0 20 Jul 2022
ILASR: Privacy-Preserving Incremental Learning for Automatic Speech Recognition at Production Scale Gopinath Chennupati Milind Rao Gurpreet Chadha Aaron Eakin A. Raju ... Andrew Oberlin Buddha Nandanoor Prahalad Venkataramanan Zheng Wu Pankaj Sitpure CLL 27 8 0 19 Jul 2022
Class-incremental Novel Class Discovery Subhankar Roy Mingxuan Liu Zhun Zhong N. Sebe Elisa Ricci CLL 33 43 0 18 Jul 2022
Consistency is the key to further mitigating catastrophic forgetting in continual learning Prashant Shivaram Bhat Bahram Zonooz Elahe Arani CLL 34 16 0 11 Jul 2022
TKIL: Tangent Kernel Approach for Class Balanced Incremental Learning Jinlin Xiang Eli Shlizerman CLL 19 8 0 17 Jun 2022
Queried Unlabeled Data Improves and Robustifies Class-Incremental Learning Tianlong Chen Sijia Liu Shiyu Chang Lisa Amini Zhangyang Wang CLL 26 4 0 15 Jun 2022
SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Features Juri Opitz Anette Frank 34 33 0 14 Jun 2022
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks Tuan Dinh Yuchen Zeng Ruisu Zhang Ziqian Lin Michael Gira Shashank Rajput Jy-yong Sohn Dimitris Papailiopoulos Kangwook Lee LMTD 50 128 0 14 Jun 2022
Remember the Past: Distilling Datasets into Addressable Memories for Neural Networks Zhiwei Deng Olga Russakovsky FedML DD 45 94 0 06 Jun 2022
The Effect of Task Ordering in Continual Learning Samuel J. Bell Neil D. Lawrence CLL 50 17 0 26 May 2022
Rethinking Task-Incremental Learning Baselines Md. Rejwanul Hossain P. Saha T. Chowdhury Shafin Rahman Fuad Rahman Nabeel Mohammed CLL 35 5 0 23 May 2022
KRNet: Towards Efficient Knowledge Replay Yingying Zhang Qiaoyong Zhong Di Xie Shi Pu CLL 33 0 0 23 May 2022
Self-distilled Knowledge Delegator for Exemplar-free Class Incremental Learning Fanfan Ye Liang Ma Qiaoyong Zhong Di Xie Shiliang Pu BDL CLL 21 2 0 23 May 2022
Incremental Learning with Differentiable Architecture and Forgetting Search James Smith Zachary Seymour Han-Pang Chiu OOD CLL AI4CE 49 4 0 19 May 2022
How catastrophic can catastrophic forgetting be in linear regression? Itay Evron E. Moroshko Rachel A. Ward Nati Srebro Daniel Soudry CLL 35 48 0 19 May 2022
Efficient Few-Shot Fine-Tuning for Opinion Summarization Arthur Bravzinskas Ramesh Nallapati Joey Tianyi Zhou Markus Dreyer 19 24 0 04 May 2022
DIRA: Dynamic Domain Incremental Regularised Adaptation Abanoub Ghobrial Xu Zheng Darryl Hond Hamid Asgari Kerstin Eder AI4CE 28 1 0 30 Apr 2022
Memory Bounds for Continual Learning Xi Chen Christos H. Papadimitriou Binghui Peng CLL LRM 29 22 0 22 Apr 2022
Alleviating Representational Shift for Continual Fine-tuning Shibo Jie Zhi-Hong Deng Ziheng Li CLL 45 11 0 22 Apr 2022
Understanding and Preventing Capacity Loss in Reinforcement Learning Clare Lyle Mark Rowland Will Dabney CLL 41 110 0 20 Apr 2022
IndicXNLI: Evaluating Multilingual Inference for Indian Languages Divyanshu Aggarwal V. Gupta Anoop Kunchukuttan 31 27 0 19 Apr 2022
LifeLonger: A Benchmark for Continual Disease Classification Mohammad Mahdi Derakhshani Ivona Najdenkoska Tom van Sonsbeek Xiantong Zhen Dwarikanath Mahapatra M. Worring Cees G. M. Snoek 35 31 0 12 Apr 2022
TOV: The Original Vision Model for Optical Remote Sensing Image Understanding via Self-supervised Learning Chao Tao Ji Qi Guo Zhang Qing Zhu Weipeng Lu Haifeng Li 42 40 0 10 Apr 2022
SoundBeam: Target sound extraction conditioned on sound-class labels and enrollment clues for increased performance and continuous learning Marc Delcroix Jorge Bennasar Vázquez Tsubasa Ochiai K. Kinoshita Yasunori Ohishi S. Araki VLM 22 32 0 08 Apr 2022
Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation Tao Feng Mang Wang Hangjie Yuan ObjD CLL 26 84 0 05 Apr 2022
Constrained Few-shot Class-incremental Learning Michael Hersche G. Karunaratne G. Cherubini Luca Benini Abu Sebastian Abbas Rahimi CLL 35 141 0 30 Mar 2022
Online Continual Learning on a Contaminated Data Stream with Blurry Task Boundaries Jihwan Bang Hyun-woo Koh Seulki Park Hwanjun Song Jung-Woo Ha Jonghyun Choi CLL 32 39 0 29 Mar 2022
R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learning Qiankun Gao Chen Zhao Guohao Li Jian Zhang CLL 28 61 0 24 Mar 2022
Continual Feature Selection: Spurious Features in Continual Learning Timothée Lesort CLL 37 10 0 02 Mar 2022
Data refinement for fully unsupervised visual inspection using pre-trained networks Antoine Cordier Benjamin Missaoui Pierre Gutierrez 37 5 0 25 Feb 2022
Continual Learning Beyond a Single Model T. Doan Seyed Iman Mirzadeh Mehrdad Farajtabar CLL 31 16 0 20 Feb 2022