Information-theoretic Online Memory Selection for Continual Learning

Information-theoretic Online Memory Selection for Continual Learning

10 April 2022

Daniele Calandriello

Michalis K. Titsias

ArXiv (abs)PDF HTML

Papers citing "Information-theoretic Online Memory Selection for Continual Learning"

16 / 16 papers shown

Title
Bridging Neuroscience and AI: Environmental Enrichment as a Model for Forward Knowledge Transfer Rajat Saxena Bruce L. McNaughton CLL 112 2 0 12 May 2024
Lossy Compression for Lossless Prediction Yann Dubois Benjamin Bloem-Reddy Karen Ullrich Chris J. Maddison 107 62 0 21 Jun 2021
Online Coreset Selection for Rehearsal-based Continual Learning Jaehong Yoon Divyam Madaan Eunho Yang Sung Ju Hwang CLL 80 145 0 02 Jun 2021
Rainbow Memory: Continual Learning with a Memory of Diverse Samples Jihwan Bang Heesu Kim Y. Yoo Jung-Woo Ha Jonghyun Choi CLL 109 344 0 31 Mar 2021
Coresets via Bilevel Optimization for Continual Learning and Streaming Zalan Borsos Mojmír Mutný Andreas Krause CLL 87 239 0 06 Jun 2020
Dark Experience for General Continual Learning: a Strong, Simple Baseline Pietro Buzzega Matteo Boschini Angelo Porrello Davide Abati Simone Calderara BDL CLL 85 925 0 15 Apr 2020
Task-Free Continual Learning Rahaf Aljundi Klaas Kelchtermans Tinne Tuytelaars CLL 138 362 0 10 Dec 2018
Efficient Lifelong Learning with A-GEM Arslan Chaudhry MarcÁurelio Ranzato Marcus Rohrbach Mohamed Elhoseiny CLL 212 1,463 0 02 Dec 2018
Experience Replay for Continual Learning David Rolnick Arun Ahuja Jonathan Richard Schwarz Timothy Lillicrap Greg Wayne CLL 116 1,171 0 28 Nov 2018
Automated Scalable Bayesian Inference via Hilbert Coresets Trevor Campbell Tamara Broderick 85 127 0 13 Oct 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 133 2,743 0 26 Jun 2017
Streaming Sparse Gaussian Process Approximations T. Bui Cuong V Nguyen Richard Turner 73 103 0 19 May 2017
Automated Curriculum Learning for Neural Networks Alex Graves Marc G. Bellemare Jacob Menick Rémi Munos Koray Kavukcuoglu 101 530 0 10 Apr 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 374 7,587 0 02 Dec 2016
Unifying Count-Based Exploration and Intrinsic Motivation Marc G. Bellemare S. Srinivasan Georg Ostrovski Tom Schaul D. Saxton Rémi Munos 186 1,485 0 06 Jun 2016
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks Ian Goodfellow M. Berk Mirza Xia Da Aaron Courville Yoshua Bengio 159 1,455 0 21 Dec 2013