v1v2 (latest)

The Ideal Continual Learner: An Agent That Never Forgets

29 April 2023

Papers citing "The Ideal Continual Learner: An Agent That Never Forgets"

48 / 48 papers shown

Title
Theory on Mixture-of-Experts in Continual Learning Hongbo Li Sen-Fon Lin Lingjie Duan Yingbin Liang Ness B. Shroff MoE MoMe CLL 264 17 0 20 Feb 2025
Skill Expansion and Composition in Parameter Space Tenglong Liu Junjie Li Yinan Zheng Haoyi Niu Yixing Lan Xin Xu Xianyuan Zhan 119 4 0 09 Feb 2025
Prospective Learning: Learning for a Dynamic Future Ashwin De Silva Rahul Ramesh Rubing Yang Siyu Yu Joshua T. Vogelstein Pratik Chaudhari AI4TS 144 0 0 31 Oct 2024
Continual Learning in Linear Classification on Separable Data Itay Evron E. Moroshko G. Buzaglo M. Khriesh B. Marjieh Nathan Srebro Daniel Soudry CLL 67 17 0 06 Jun 2023
Latent Spectral Regularization for Continual Learning Emanuele Frascaroli Riccardo Benaglia Matteo Boschini Luca Moschella Cosimo Fiorini Emanuele Rodolà Simone Calderara BDL CLL 68 3 0 09 Jan 2023
Beyond Not-Forgetting: Continual Learning with Backward Knowledge Transfer Sen Lin Li Yang Deliang Fan Junshan Zhang CLL 167 48 0 01 Nov 2022
Improving Task-free Continual Learning by Distributionally Robust Memory Evolution Zhenyi Wang Li Shen Le Fang Qiuling Suo Tiehang Duan Mingchen Gao OOD 69 42 0 15 Jul 2022
Information-theoretic Online Memory Selection for Continual Learning Shengyang Sun Daniele Calandriello Huiyi Hu Ang Li Michalis K. Titsias CLL 47 51 0 10 Apr 2022
General Incremental Learning with Domain-aware Categorical Representations Jiangwei Xie Shipeng Yan Xuming He OOD CLL 114 39 0 08 Apr 2022
Memory Replay with Data Compression for Continual Learning Liyuan Wang Xingxing Zhang Kuo Yang L. Yu Chongxuan Li Lanqing Hong Shifeng Zhang Zhenguo Li Yi Zhong Jun Zhu 81 103 0 14 Feb 2022
Continual Learning with Recursive Gradient Optimization Hao Liu Huaping Liu VLM CLL 134 38 0 29 Jan 2022
Wide Neural Networks Forget Less Catastrophically Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Huiyi Hu Razvan Pascanu Dilan Görür Mehrdad Farajtabar CLL 74 67 0 21 Oct 2021
Recent Advances of Continual Learning in Computer Vision: An Overview Haoxuan Qu Hossein Rahmani Li Xu Bryan M. Williams Jun Liu VLM CLL 112 77 0 23 Sep 2021
Continual Learning in the Teacher-Student Setup: Impact of Task Similarity Sebastian Lee Sebastian Goldt Andrew M. Saxe CLL 75 74 0 09 Jul 2021
Global Convergence of Gradient Descent for Asymmetric Low-Rank Matrix Factorization Tian-Chun Ye S. Du 57 48 0 27 Jun 2021
Model Zoo: A Growing "Brain" That Learns Continually Rahul Ramesh Pratik Chaudhari CLL FedML 75 65 0 06 Jun 2021
Rehearsal revealed: The limits and merits of revisiting samples in continual learning Eli Verwimp Matthias De Lange Tinne Tuytelaars CLL 52 108 0 15 Apr 2021
Rainbow Memory: Continual Learning with a Memory of Diverse Samples Jihwan Bang Heesu Kim Y. Yoo Jung-Woo Ha Jonghyun Choi CLL 102 343 0 31 Mar 2021
Gradient Projection Memory for Continual Learning Gobinda Saha Isha Garg Kaushik Roy VLM CLL 78 289 0 17 Mar 2021
Training Networks in Null Space of Feature Covariance for Continual Learning Shipeng Wang Xiaorong Li Jian Sun Zongben Xu CLL 94 144 0 12 Mar 2021
Constrained Learning with Non-Convex Losses Luiz F. O. Chamon Santiago Paternain Miguel Calvo-Fullana Alejandro Ribeiro 52 38 0 08 Mar 2021
Selective Replay Enhances Learning in Online Continual Analogical Reasoning Tyler L. Hayes Christopher Kanan CLL 57 20 0 06 Mar 2021
Continual Learning in Low-rank Orthogonal Subspaces Arslan Chaudhry Naeemullah Khan P. Dokania Philip Torr CLL 58 123 0 22 Oct 2020
Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Dilan Görür Razvan Pascanu H. Ghasemzadeh CLL 81 146 0 09 Oct 2020
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix T. Doan Mehdi Abbana Bennani Bogdan Mazoure Guillaume Rabusseau Pierre Alquier CLL 70 83 0 07 Oct 2020
Task Agnostic Continual Learning Using Online Variational Bayes with Fixed-Point Updates Chen Zeno Itay Golan Elad Hoffer Daniel Soudry OOD FedML 71 47 0 01 Oct 2020
Conservative Stochastic Optimization with Expectation Constraints Zeeshan Akhtar Amrit Singh Bedi K. Rajawat 76 21 0 13 Aug 2020
Gradient-based Editing of Memory Examples for Online Task-free Continual Learning Xisen Jin Arka Sadhu Junyi Du Xiang Ren CLL KELM BDL 64 99 0 27 Jun 2020
Optimal Continual Learning has Perfect Memory and is NP-hard Jeremias Knoblauch Hisham Husain Tom Diethe CLL 125 105 0 09 Jun 2020
Coresets via Bilevel Optimization for Continual Learning and Streaming Zalan Borsos Mojmír Mutný Andreas Krause CLL 78 238 0 06 Jun 2020
Dark Experience for General Continual Learning: a Strong, Simple Baseline Pietro Buzzega Matteo Boschini Angelo Porrello Davide Abati Simone Calderara BDL CLL 85 921 0 15 Apr 2020
A Neural Dirichlet Process Mixture Model for Task-Free Continual Learning Soochan Lee Junsoo Ha Dongsu Zhang Gunhee Kim BDL CLL 88 212 0 03 Jan 2020
Constrained Reinforcement Learning Has Zero Duality Gap Santiago Paternain Luiz F. O. Chamon Miguel Calvo-Fullana Alejandro Ribeiro 59 193 0 29 Oct 2019
Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networks Mahyar Fazlyab Alexander Robey Hamed Hassani M. Morari George J. Pappas 98 461 0 12 Jun 2019
Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting Xilai Li Yingbo Zhou Tianfu Wu R. Socher Caiming Xiong CLL 94 434 0 31 Mar 2019
Continual Learning of Context-dependent Processing in Neural Networks Guanxiong Zeng Yang Chen Bo Cui Shan Yu CLL 82 310 0 29 Sep 2018
Optimization with Non-Differentiable Constraints with Applications to Fairness, Recall, Churn, and Other Goals Andrew Cotter Heinrich Jiang S. Wang Taman Narayan Maya R. Gupta Seungil You Karthik Sridharan 79 158 0 11 Sep 2018
Streaming PCA and Subspace Tracking: The Missing Data Case Laura Balzano Yuejie Chi Yue M. Lu 60 87 0 12 Jun 2018
Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting H. Ritter Aleksandar Botev David Barber BDL CLL 89 334 0 20 May 2018
Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgetting Xialei Liu Marc Masana Luis Herranz Joost van de Weijer Antonio M. López Andrew D. Bagdanov CLL 85 279 0 08 Feb 2018
Memory Aware Synapses: Learning what (not) to forget Rahaf Aljundi F. Babiloni Mohamed Elhoseiny Marcus Rohrbach Tinne Tuytelaars KELM CLL 87 1,646 0 27 Nov 2017
Robust Subspace Learning: Robust PCA, Robust Subspace Tracking, and Robust Subspace Recovery Namrata Vaswani T. Bouwmans S. Javed Praneeth Narayanamurthy OOD 71 278 0 26 Nov 2017
Online Convex Optimization with Stochastic Constraints Hao Yu M. Neely Xiaohan Wei 69 224 0 12 Aug 2017
Lifelong Learning with Dynamically Expandable Networks Jaehong Yoon Eunho Yang Jeongtae Lee Sung Ju Hwang CLL 123 1,229 0 04 Aug 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 127 2,735 0 26 Jun 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 372 7,561 0 02 Dec 2016
The Benefit of Multitask Representation Learning Andreas Maurer Massimiliano Pontil Bernardino Romera-Paredes SSL 109 375 0 23 May 2015
Robust computation of linear models by convex relaxation Gilad Lerman Michael B. McCoy J. Tropp Teng Zhang 150 161 0 18 Feb 2012