v1v2v3 (latest)

Formalizing the Generalization-Forgetting Trade-off in Continual Learning

28 September 2021

Papers citing "Formalizing the Generalization-Forgetting Trade-off in Continual Learning"

37 / 37 papers shown

Title
Continual Learning of a Mixed Sequence of Similar and Dissimilar Tasks Zixuan Ke Bing-Quan Liu Xingchang Huang CLL 63 125 0 18 Dec 2021
CoachNet: An Adversarial Sampling Approach for Reinforcement Learning E. Abolfathi Jun Luo Peyman Yadmellat K. Rezaee OnRL 41 3 0 07 Jan 2021
Continual Learning in Low-rank Orthogonal Subspaces Arslan Chaudhry Naeemullah Khan P. Dokania Philip Torr CLL 58 122 0 22 Oct 2020
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix T. Doan Mehdi Abbana Bennani Bogdan Mazoure Guillaume Rabusseau Pierre Alquier CLL 70 83 0 07 Oct 2020
Meta-Consolidation for Continual Learning K. J. Joseph V. Balasubramanian CLL 59 56 0 01 Oct 2020
Online Continual Learning under Extreme Memory Constraints Enrico Fini Stéphane Lathuilière E. Sangineto Moin Nabi Elisa Ricci CLL 76 65 0 04 Aug 2020
La-MAML: Look-ahead Meta Learning for Continual Learning Gunshi Gupta Karmesh Yadav Liam Paull CLL VLM 79 69 0 27 Jul 2020
Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent Mehdi Abbana Bennani Thang Doan Masashi Sugiyama CLL 87 62 0 21 Jun 2020
Understanding the Role of Training Regimes in Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Razvan Pascanu H. Ghasemzadeh CLL 76 226 0 12 Jun 2020
Optimal Continual Learning has Perfect Memory and is NP-hard Jeremias Knoblauch Hisham Husain Tom Diethe CLL 125 105 0 09 Jun 2020
Continual Deep Learning by Functional Regularisation of Memorable Past Pingbo Pan S. Swaroop Alexander Immer Runa Eschenhagen Richard Turner Mohammad Emtiyaz Khan KELM CLL 52 143 0 29 Apr 2020
Continual Learning with Node-Importance based Adaptive Group Sparse Regularization Sangwon Jung Hongjoon Ahn Sungmin Cha Taesup Moon CLL 50 128 0 30 Mar 2020
Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning Massimo Caccia Pau Rodríguez López O. Ostapenko Fabrice Normandin Min Lin ... I. Laradji Irina Rish Alexande Lacoste David Vazquez Laurent Charlin CLL KELM 67 66 0 12 Mar 2020
Learning to Continually Learn Shawn L. E. Beaulieu Lapo Frati Thomas Miconi Joel Lehman Kenneth O. Stanley Jeff Clune Nick Cheney KELM CLL 85 148 0 21 Feb 2020
Orthogonal Gradient Descent for Continual Learning Mehrdad Farajtabar Navid Azizan Alex Mott Ang Li CLL 96 373 0 15 Oct 2019
Meta-Learning Representations for Continual Learning Khurram Javed Martha White KELM CLL 80 320 0 29 May 2019
On Tiny Episodic Memories in Continual Learning Arslan Chaudhry Marcus Rohrbach Mohamed Elhoseiny Thalaiyasingam Ajanthan P. Dokania Philip Torr MarcÁurelio Ranzato CLL 91 400 0 27 Feb 2019
Functional Regularisation for Continual Learning with Gaussian Processes Michalis K. Titsias Jonathan Richard Schwarz A. G. Matthews Razvan Pascanu Yee Whye Teh CLL BDL 61 186 0 31 Jan 2019
Deep Online Learning via Meta-Learning: Continual Adaptation for Model-Based RL Anusha Nagabandi Chelsea Finn Sergey Levine OffRL CLL 97 191 0 18 Dec 2018
Re-evaluating Continual Learning Scenarios: A Categorization and Case for Strong Baselines Yen-Chang Hsu Yen-Cheng Liu Anita Ramasamy Z. Kira CLL ELM 83 358 0 30 Oct 2018
Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference Matthew D Riemer Ignacio Cases R. Ajemian Miao Liu Irina Rish Y. Tu Gerald Tesauro CLL 95 787 0 29 Oct 2018
Meta-Learning: A Survey Joaquin Vanschoren FedML OOD 69 762 0 08 Oct 2018
Generative replay with feedback connections as a general strategy for continual learning Gido M. van de Ven A. Tolias CLL KELM 75 226 0 27 Sep 2018
Meta Continual Learning Risto Vuorio D.-Y. Cho Daejoong Kim Jiwon Kim CLL 52 28 0 11 Jun 2018
Progress & Compress: A scalable framework for continual learning Jonathan Richard Schwarz Jelena Luketina Wojciech M. Czarnecki A. Grabska-Barwinska Yee Whye Teh Razvan Pascanu R. Hadsell CLL 125 889 0 16 May 2018
On First-Order Meta-Learning Algorithms Alex Nichol Joshua Achiam John Schulman 233 2,237 0 08 Mar 2018
Memory Aware Synapses: Learning what (not) to forget Rahaf Aljundi F. Babiloni Mohamed Elhoseiny Marcus Rohrbach Tinne Tuytelaars KELM CLL 87 1,642 0 27 Nov 2017
Lifelong Learning with Dynamically Expandable Networks Jaehong Yoon Eunho Yang Jeongtae Lee Sung Ju Hwang CLL 123 1,228 0 04 Aug 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 127 2,725 0 26 Jun 2017
Continual Learning with Deep Generative Replay Hanul Shin Jung Kwon Lee Jaehong Kim Jiwon Kim KELM CLL 80 2,080 0 24 May 2017
Prototypical Networks for Few-shot Learning Jake C. Snell Kevin Swersky R. Zemel 303 8,145 0 15 Mar 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 825 11,937 0 09 Mar 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 372 7,547 0 02 Dec 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 304 4,423 0 29 Jun 2016
Progressive Neural Networks Andrei A. Rusu Neil C. Rabinowitz Guillaume Desjardins Hubert Soyer J. Kirkpatrick Koray Kavukcuoglu Razvan Pascanu R. Hadsell CLL AI4CE 77 2,463 0 15 Jun 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 373 7,333 0 13 Jun 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.0K 150,260 0 22 Dec 2014