An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks

21 December 2013

Aaron Courville

Papers citing "An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks"

50 / 306 papers shown

Title
Federated Learning with Additional Mechanisms on Clients to Reduce Communication Costs Xin Yao Tianchi Huang Chenglei Wu Ruixiao Zhang Lifeng Sun FedML 21 38 0 16 Aug 2019
Towards Making the Most of BERT in Neural Machine Translation Jiacheng Yang Mingxuan Wang Hao Zhou Chengqi Zhao Yong Yu Weinan Zhang Lei Li CLL 21 156 0 15 Aug 2019
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation Dongmin Park Seokil Hong Bohyung Han Kyoung Mu Lee AAML CLL 24 39 0 08 Aug 2019
Continual Learning for Robotics: Definition, Framework, Learning Strategies, Opportunities and Challenges Timothée Lesort Vincenzo Lomonaco Andrei Stoian Davide Maltoni David Filliat Natalia Díaz Rodríguez CLL 24 248 0 29 Jun 2019
End-to-End 3D-PointCloud Semantic Segmentation for Autonomous Driving Mohammed Abdou Mahmoud Elkhateeb Ibrahim Sobh Ahmad El-Sallab 3DPC 22 5 0 26 Jun 2019
Conditional Computation for Continual Learning Min Lin Jie Fu Yoshua Bengio CLL 34 10 0 16 Jun 2019
Sequential mastery of multiple visual tasks: Networks naturally learn to learn and forget to forget Guy Davidson Michael C. Mozer CLL 26 23 0 26 May 2019
Catastrophic forgetting: still a problem for DNNs Benedikt Pfülb A. Gepperth Saad Abdullah André Kilian CLL 11 22 0 20 May 2019
Meta-learning of Sequential Strategies Pedro A. Ortega Jane X. Wang Mark Rowland Tim Genewein Z. Kurth-Nelson ... Yee Whye Teh H. V. Hasselt Nando de Freitas M. Botvinick Shane Legg OffRL 27 97 0 08 May 2019
From Video Game to Real Robot: The Transfer between Action Spaces Janne Karttunen Anssi Kanervisto Ville Kyrki Ville Hautamaki 22 8 0 02 May 2019
Semantic-Aware Knowledge Preservation for Zero-Shot Sketch-Based Image Retrieval Qing Liu Lingxi Xie Huiyu Wang Alan Yuille VLM 27 108 0 05 Apr 2019
Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning O. Ostapenko M. Puscas T. Klein P. Jähnichen Moin Nabi CLL 60 298 0 05 Apr 2019
Class-incremental Learning via Deep Model Consolidation Junting Zhang Jie Zhang Shalini Ghosh Dawei Li Serafettin Tasci Larry Heck Heming Zhang C.-C. Jay Kuo CLL 27 335 0 19 Mar 2019
Robust and Communication-Efficient Federated Learning from Non-IID Data Felix Sattler Simon Wiedemann K. Müller Wojciech Samek FedML 24 1,337 0 07 Mar 2019
Never Forget: Balancing Exploration and Exploitation via Learning Optical Flow Hsuan-Kung Yang Po-Han Chiang Kuan-Wei Ho Min-Fong Hong Chun-Yi Lee 35 7 0 24 Jan 2019
Transfer learning to model inertial confinement fusion experiments K. Humbird J. Peterson R. McClarren 10 62 0 14 Dec 2018
Partitioned Variational Inference: A unified framework encompassing federated and continual learning T. Bui Cuong V Nguyen S. Swaroop Richard Turner FedML 27 55 0 27 Nov 2018
Concept-Oriented Deep Learning: Generative Concept Representations Daniel T. Chang DRL GAN BDL 36 12 0 15 Nov 2018
Incremental Learning for Semantic Segmentation of Large-Scale Remote Sensing Data O. Tasar Y. Tarabalka Pierre Alliez CLL 6 127 0 29 Oct 2018
A Survey and Critique of Multiagent Deep Reinforcement Learning Pablo Hernandez-Leal Bilal Kartal Matthew E. Taylor OffRL 48 553 0 12 Oct 2018
Continual Learning of Context-dependent Processing in Neural Networks Guanxiong Zeng Yang Chen Bo Cui Shan Yu CLL 33 296 0 29 Sep 2018
Negative Update Intervals in Deep Multi-Agent Reinforcement Learning Gregory Palmer Rahul Savani K. Tuyls 28 27 0 13 Sep 2018
Life-Long Disentangled Representation Learning with Cross-Domain Latent Homologies Alessandro Achille Tom Eccles Loic Matthey Christopher P. Burgess Nicholas Watters Alexander Lerchner I. Higgins BDL 40 119 0 20 Aug 2018
DynMat, a network that can learn after learning J. H. Lee OffRL 24 5 0 16 Jun 2018
Selfless Sequential Learning Rahaf Aljundi Marcus Rohrbach Tinne Tuytelaars CLL 33 114 0 14 Jun 2018
Adding New Tasks to a Single Network with Weight Transformations using Binary Masks Massimiliano Mancini Elisa Ricci Barbara Caputo Samuel Rota Buló 25 51 0 28 May 2018
Keep and Learn: Continual Learning by Constraining the Latent Space for Knowledge Preservation in Neural Networks Hyo-Eun Kim Seungwook Kim Jaehwan Lee CLL 19 31 0 28 May 2018
Self-Net: Lifelong Learning via Continual Self-Modeling Blake Camp J. Mandivarapu Rolando Estrada CLL SSL 27 16 0 25 May 2018
Towards Robust Evaluations of Continual Learning Sebastian Farquhar Y. Gal CLL 28 305 0 24 May 2018
Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting H. Ritter Aleksandar Botev David Barber BDL CLL 16 327 0 20 May 2018
The Limits and Potentials of Deep Learning for Robotics Niko Sünderhauf Oliver Brock Walter J. Scheirer R. Hadsell Dieter Fox ... B. Upcroft Pieter Abbeel Wolfram Burgard Michael Milford Peter Corke 17 522 0 18 Apr 2018
Combating catastrophic forgetting with developmental compression Shawn L. E. Beaulieu Sam Kriegman Josh Bongard 30 4 0 12 Apr 2018
Selective Experience Replay for Lifelong Learning David Isele Akansel Cosgun CLL 43 449 0 28 Feb 2018
SeNA-CNN: Overcoming Catastrophic Forgetting in Convolutional Neural Networks by Selective Network Augmentation Abel S. Zacarias Luís A. Alexandre CLL 32 12 0 22 Feb 2018
Continual Reinforcement Learning with Complex Synapses Christos Kaplanis Murray Shanahan Claudia Clopath KELM 24 87 0 20 Feb 2018
Overcoming catastrophic forgetting with hard attention to the task Joan Serrà Dídac Surís M. Miron Alexandros Karatzoglou CLL 41 1,051 0 04 Jan 2018
Rapid Adaptation with Conditionally Shifted Neurons Tsendsuren Munkhdalai Xingdi Yuan Soroush Mehri Adam Trischler 21 13 0 28 Dec 2017
FearNet: Brain-Inspired Model for Incremental Learning Ronald Kemker Christopher Kanan CLL 53 475 0 28 Nov 2017
Meta-Learning by Adjusting Priors Based on Extended PAC-Bayes Theory Ron Amit Ron Meir BDL MLT 32 176 0 03 Nov 2017
Variational Continual Learning Cuong V Nguyen Yingzhen Li T. Bui Richard Turner CLL VLM BDL 36 728 0 29 Oct 2017
Deep Generative Dual Memory Network for Continual Learning Nitin Kamra Umang Gupta Yan Liu BDL 24 153 0 28 Oct 2017
Overcoming Catastrophic Interference by Conceptors Xu He H. Jaeger BDL 31 13 0 16 Jul 2017
Continual Learning with Deep Generative Replay Hanul Shin Jung Kwon Lee Jaehong Kim Jiwon Kim KELM CLL 45 2,036 0 24 May 2017
Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks Roby Velez Jeff Clune DiffM 21 50 0 20 May 2017
CORe50: a New Dataset and Benchmark for Continuous Object Recognition Vincenzo Lomonaco Davide Maltoni 34 490 0 09 May 2017
Molecular De Novo Design through Deep Reinforcement Learning Marcus Olivecrona T. Blaschke Ola Engkvist Hongming Chen BDL 55 995 0 25 Apr 2017
Overcoming Catastrophic Forgetting by Incremental Moment Matching Sang-Woo Lee Jin-Hwa Kim Jaehyun Jun Jung-Woo Ha Byoung-Tak Zhang CLL 30 668 0 24 Mar 2017
ASP: Learning to Forget with Adaptive Synaptic Plasticity in Spiking Neural Networks Priyadarshini Panda Jason M. Allred S. Ramanathan Kaushik Roy 13 49 0 22 Mar 2017
Continual Learning Through Synaptic Intelligence Friedemann Zenke Ben Poole Surya Ganguli 42 51 0 13 Mar 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 57 7,334 0 02 Dec 2016