v1v2 (latest)

A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning

16 July 2023

Li Shen

ArXiv (abs)PDF HTML Github (305★)

Papers citing "A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning"

50 / 126 papers shown

Title
Online Coreset Selection for Rehearsal-based Continual Learning Jaehong Yoon Divyam Madaan Eunho Yang Sung Ju Hwang CLL 75 144 0 02 Jun 2021
How Well Does Self-Supervised Pre-Training Perform with Streaming Data? Dapeng Hu Shipeng Yan Qizhengqiu Lu Lanqing Hong Hailin Hu Yifan Zhang Zhenguo Li Xinchao Wang Jiashi Feng 100 29 0 25 Apr 2021
Rainbow Memory: Continual Learning with a Memory of Diverse Samples Jihwan Bang Heesu Kim Y. Yoo Jung-Woo Ha Jonghyun Choi CLL 109 344 0 31 Mar 2021
Gradient Regularized Contrastive Learning for Continual Domain Adaptation Shixiang Tang Peng Su Peng Gao Ni Zhao CLL 49 67 0 23 Mar 2021
Gradient Projection Memory for Continual Learning Gobinda Saha Isha Garg Kaushik Roy VLM CLL 84 292 0 17 Mar 2021
Remember What You Want to Forget: Algorithms for Machine Unlearning Ayush Sekhari Jayadev Acharya Gautam Kamath A. Suresh FedML MU 92 317 0 04 Mar 2021
Posterior Meta-Replay for Continual Learning Christian Henning Maria R. Cervera Francesco DÁngelo J. Oswald Regina Traber Benjamin Ehret Seijin Kobayashi Benjamin Grewe João Sacramento CLL BDL 91 60 0 01 Mar 2021
Few-Shot Lifelong Learning Pratik Mazumder Pravendra Singh Piyush Rai CLL 77 121 0 01 Mar 2021
Online Continual Learning in Image Classification: An Empirical Survey Zheda Mai Ruiwen Li Jihwan Jeong David Quispe Hyunwoo J. Kim Scott Sanner VLM CLL 114 419 0 25 Jan 2021
ORDisCo: Effective and Efficient Usage of Incremental Unlabeled Data for Semi-supervised Continual Learning Liyuan Wang Kuo Yang Chongxuan Li Lanqing Hong Zhenguo Li Jun Zhu CLL BDL 97 82 0 02 Jan 2021
Towards Continual Reinforcement Learning: A Review and Perspectives Khimya Khetarpal Matthew D Riemer Irina Rish Doina Precup CLL OffRL 111 324 0 25 Dec 2020
Continual Adaptation of Visual Representations via Domain Randomization and Meta-learning Riccardo Volpi Diane Larlus Grégory Rogez VLM OOD CLL 69 74 0 08 Dec 2020
Class-incremental learning: survey and performance evaluation on image classification Marc Masana Xialei Liu Bartlomiej Twardowski Mikel Menta Andrew D. Bagdanov Joost van de Weijer CLL 79 698 0 28 Oct 2020
Continual Learning in Low-rank Orthogonal Subspaces Arslan Chaudhry Naeemullah Khan P. Dokania Philip Torr CLL 63 123 0 22 Oct 2020
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix T. Doan Mehdi Abbana Bennani Bogdan Mazoure Guillaume Rabusseau Pierre Alquier CLL 70 86 0 07 Oct 2020
Online Continual Learning under Extreme Memory Constraints Enrico Fini Stéphane Lathuilière E. Sangineto Moin Nabi Elisa Ricci CLL 92 65 0 04 Aug 2020
La-MAML: Look-ahead Meta Learning for Continual Learning Gunshi Gupta Karmesh Yadav Liam Paull CLL VLM 90 69 0 27 Jul 2020
Gradient-based Editing of Memory Examples for Online Task-free Continual Learning Xisen Jin Arka Sadhu Junyi Du Xiang Ren CLL KELM BDL 70 99 0 27 Jun 2020
Supermasks in Superposition Mitchell Wortsman Vivek Ramanujan Rosanne Liu Aniruddha Kembhavi Mohammad Rastegari J. Yosinski Ali Farhadi SSL CLL 91 297 0 26 Jun 2020
DeltaGrad: Rapid retraining of machine learning models Yinjun Wu Yan Sun S. Davidson MU 63 202 0 26 Jun 2020
Transient Non-Stationarity and Generalisation in Deep Reinforcement Learning Maximilian Igl Gregory Farquhar Jelena Luketina Wendelin Boehmer Shimon Whiteson 98 88 0 10 Jun 2020
Variational Auto-Regressive Gaussian Processes for Continual Learning Sanyam Kapoor Theofanis Karaletsos T. Bui BDL 55 26 0 09 Jun 2020
Addressing Catastrophic Forgetting in Few-Shot Problems Pauching Yap H. Ritter David Barber CLL BDL 71 19 0 30 Apr 2020
Few-Shot Class-Incremental Learning Xiaoyu Tao Xiaopeng Hong Xinyuan Chang Songlin Dong Xing Wei Yihong Gong CLL 100 412 0 23 Apr 2020
Dark Experience for General Continual Learning: a Strong, Simple Baseline Pietro Buzzega Matteo Boschini Angelo Porrello Davide Abati Simone Calderara BDL CLL 85 925 0 15 Apr 2020
Memory-Efficient Incremental Learning Through Feature Adaptation Ahmet Iscen Jeffrey O. Zhang Svetlana Lazebnik Cordelia Schmid CLL VLM 57 165 0 01 Apr 2020
Continual Learning with Node-Importance based Adaptive Group Sparse Regularization Sangwon Jung Hongjoon Ahn Sungmin Cha Taesup Moon CLL 67 128 0 30 Mar 2020
Learn to Forget: Machine Unlearning via Neuron Masking Yang Liu Zhuo Ma Ximeng Liu Jian Liu Zhongyuan Jiang Jianfeng Ma Philip Yu K. Ren MU 73 67 0 24 Mar 2020
XtarNet: Learning to Extract Task-Adaptive Representation for Incremental Few-Shot Learning Sung Whan Yoon Do-Yeon Kim Jun Seo Jaekyun Moon CLL 233 46 0 19 Mar 2020
Federated Continual Learning with Weighted Inter-client Transfer Jaehong Yoon Wonyoung Jeong Giwoong Lee Eunho Yang Sung Ju Hwang FedML 119 209 0 06 Mar 2020
Mnemonics Training: Multi-Class Incremental Learning without Forgetting Yaoyao Liu Yuting Su Anan Liu Bernt Schiele Qianru Sun CLL 81 347 0 24 Feb 2020
BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learning Yeming Wen Dustin Tran Jimmy Ba OOD FedML UQCV 184 493 0 17 Feb 2020
A Neural Dirichlet Process Mixture Model for Task-Free Continual Learning Soochan Lee Junsoo Ha Dongsu Zhang Gunhee Kim BDL CLL 90 212 0 03 Jan 2020
Maintaining Discrimination and Fairness in Class Incremental Learning Bowen Zhao Xi Xiao Guojun Gan Bin Zhang Shutao Xia CLL 135 431 0 16 Nov 2019
Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networks Aditya Golatkar Alessandro Achille Stefano Soatto CLL MU 95 505 0 12 Nov 2019
Invariant Representations through Adversarial Forgetting Ayush Jaiswal Daniel Moyer Greg Ver Steeg Wael AbdAlmageed Premkumar Natarajan OOD 53 39 0 11 Nov 2019
Certified Data Removal from Machine Learning Models Chuan Guo Tom Goldstein Awni Y. Hannun Laurens van der Maaten MU 114 451 0 08 Nov 2019
Continual Unsupervised Representation Learning Dushyant Rao Francesco Visin Andrei A. Rusu Yee Whye Teh Razvan Pascanu R. Hadsell BDL CLL SSL DRL 41 262 0 31 Oct 2019
Overcoming Forgetting in Federated Learning on Non-IID Data N. Shoham Tomer Avidor Aviv Keren Nadav Tal-Israel Daniel Benditkis Liron Mor Yosef Itai Zeitak CLL FedML 135 226 0 17 Oct 2019
Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models Cheolhyoung Lee Kyunghyun Cho Wanmo Kang MoE 284 209 0 25 Sep 2019
LAMOL: LAnguage MOdeling for Lifelong Language Learning Fan-Keng Sun Cheng-Hao Ho Hung-yi Lee CLL KELM 90 213 0 07 Sep 2019
Online Continual Learning with Maximally Interfered Retrieval Rahaf Aljundi Lucas Caccia Eugene Belilovsky Massimo Caccia Min Lin Laurent Charlin Tinne Tuytelaars CLL 85 549 0 11 Aug 2019
Lifelong GAN: Continual Learning for Conditional Image Generation Mengyao Zhai Lei Chen Frederick Tung Jiawei He Megha Nawhal Greg Mori CLL 89 183 0 23 Jul 2019
Learning to Forget for Meta-Learning Sungyong Baik Seokil Hong Kyoung Mu Lee CLL KELM 60 88 0 13 Jun 2019
Continual learning with hypernetworks J. Oswald Christian Henning Benjamin Grewe João Sacramento CLL 81 363 0 03 Jun 2019
Large Scale Incremental Learning Yue Wu Yinpeng Chen Lijuan Wang Yuancheng Ye Zicheng Liu Yandong Guo Y. Fu CLL 102 1,259 0 30 May 2019
Similarity of Neural Network Representations Revisited Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton 143 1,435 0 01 May 2019
Three scenarios for continual learning Gido M. van de Ven A. Tolias CLL 104 896 0 15 Apr 2019
Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting Xilai Li Yingbo Zhou Tianfu Wu R. Socher Caiming Xiong CLL 108 434 0 31 Mar 2019
On Tiny Episodic Memories in Continual Learning Arslan Chaudhry Marcus Rohrbach Mohamed Elhoseiny Thalaiyasingam Ajanthan P. Dokania Philip Torr MarcÁurelio Ranzato CLL 91 400 0 27 Feb 2019