A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix

7 October 2020

Papers citing "A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix"

22 / 22 papers shown

Title
Better Rates for Random Task Orderings in Continual Linear Models Itay Evron Ran Levinstein Matan Schliserman Uri Sherman Tomer Koren Daniel Soudry Nathan Srebro CLL 35 0 0 06 Apr 2025
Theory on Mixture-of-Experts in Continual Learning Hongbo Li Sen-Fon Lin Lingjie Duan Yingbin Liang Ness B. Shroff MoE MoMe CLL 153 14 0 20 Feb 2025
CENSOR: Defense Against Gradient Inversion via Orthogonal Subspace Bayesian Sampling Kaiyuan Zhang Siyuan Cheng Guangyu Shen Bruno Ribeiro Shengwei An Pin-Yu Chen Xinming Zhang Ninghui Li 102 1 0 28 Jan 2025
LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learning Liangzu Peng Juan Elenter Joshua Agterberg Alejandro Ribeiro René Vidal VLM CLL 46 1 0 01 Oct 2024
Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning Mohammadamin Banayeeanzade Mahdi Soltanolkotabi Mohammad Rostami CLL LRM 103 1 0 29 Aug 2024
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective Jingren Liu Zhong Ji Yunlong Yu Jiale Cao Yanwei Pang Jungong Han X. Li CLL 42 3 0 24 Jul 2024
Data-dependent and Oracle Bounds on Forgetting in Continual Learning Lior Friedman Ron Meir 75 0 0 13 Jun 2024
Disentangling and Mitigating the Impact of Task Similarity for Continual Learning Naoki Hiratani CLL 35 2 0 30 May 2024
NTK-Guided Few-Shot Class Incremental Learning Jingren Liu Zhong Ji Yanwei Pang Yunlong Yu CLL 39 3 0 19 Mar 2024
Clustering-based Domain-Incremental Learning Christiaan Lamers René Vidal A. Belbachir Niki van Stein Thomas Baeck Paris Giampouras CLL OOD 32 10 0 21 Sep 2023
SketchOGD: Memory-Efficient Continual Learning Benjamin Wright Youngjae Min Jeremy Bernstein Navid Azizan CLL 28 0 0 25 May 2023
Fixed Design Analysis of Regularization-Based Continual Learning Haoran Li Jingfeng Wu Vladimir Braverman CLL 26 9 0 17 Mar 2023
Selective Amnesia: On Efficient, High-Fidelity and Blind Suppression of Backdoor Effects in Trojaned Machine Learning Models Rui Zhu Di Tang Siyuan Tang Xiaofeng Wang Haixu Tang AAML FedML 37 13 0 09 Dec 2022
Continual Learning with Distributed Optimization: Does CoCoA Forget? Martin Hellkvist Ayça Özçelikkale Anders Ahlén CLL OOD 22 1 0 30 Nov 2022
Understanding Impacts of Task Similarity on Backdoor Attack and Detection Di Tang Rui Zhu Xiaofeng Wang Haixu Tang Yi Chen AAML 24 5 0 12 Oct 2022
ATLAS: Universal Function Approximator for Memory Retention H. V. Deventer Anna Sergeevna Bosman 22 0 0 10 Aug 2022
Continual Feature Selection: Spurious Features in Continual Learning Timothée Lesort CLL 24 10 0 02 Mar 2022
Provable Continual Learning via Sketched Jacobian Approximations Reinhard Heckel CLL 20 9 0 09 Dec 2021
Learning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting Ryo Karakida S. Akaho CLL 32 11 0 03 Dec 2021
Provable Lifelong Learning of Representations Xinyuan Cao Weiyang Liu Santosh Vempala CLL 21 13 0 27 Oct 2021
Artificial Neural Variability for Deep Learning: On Overfitting, Noise Memorization, and Catastrophic Forgetting Zeke Xie Fengxiang He Shaopeng Fu Issei Sato Dacheng Tao Masashi Sugiyama 21 59 0 12 Nov 2020
Deep Reinforcement and InfoMax Learning Bogdan Mazoure Rémi Tachet des Combes T. Doan Philip Bachman R. Devon Hjelm AI4CE 25 108 0 12 Jun 2020