Provable Continual Learning via Sketched Jacobian Approximations

9 December 2021

Papers citing "Provable Continual Learning via Sketched Jacobian Approximations"

12 / 12 papers shown

Title
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix T. Doan Mehdi Abbana Bennani Bogdan Mazoure Guillaume Rabusseau Pierre Alquier CLL 60 83 0 07 Oct 2020
Early Stopping in Deep Networks: Double Descent and How to Eliminate it Reinhard Heckel Fatih Yilmaz 58 45 0 20 Jul 2020
Limitations of the Empirical Fisher Approximation for Natural Gradient Descent Frederik Kunstner Lukas Balles Philipp Hennig 68 215 0 29 May 2019
Gradient Descent Provably Optimizes Over-parameterized Neural Networks S. Du Xiyu Zhai Barnabás Póczós Aarti Singh MLT ODL 204 1,270 0 04 Oct 2018
Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting H. Ritter Aleksandar Botev David Barber BDL CLL 81 329 0 20 May 2018
Progress & Compress: A scalable framework for continual learning Jonathan Richard Schwarz Jelena Luketina Wojciech M. Czarnecki A. Grabska-Barwinska Yee Whye Teh Razvan Pascanu R. Hadsell CLL 108 886 0 16 May 2018
Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgetting Xialei Liu Marc Masana Luis Herranz Joost van de Weijer Antonio M. López Andrew D. Bagdanov CLL 81 274 0 08 Feb 2018
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence Arslan Chaudhry P. Dokania Thalaiyasingam Ajanthan Philip Torr CLL 89 1,137 0 30 Jan 2018
Deep Neural Networks as Gaussian Processes Jaehoon Lee Yasaman Bahri Roman Novak S. Schoenholz Jeffrey Pennington Jascha Narain Sohl-Dickstein UQCV BDL 113 1,091 0 01 Nov 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 325 7,478 0 02 Dec 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 282 4,391 0 29 Jun 2016
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks Ian Goodfellow M. Berk Mirza Xia Da Aaron Courville Yoshua Bengio 137 1,439 0 21 Dec 2013