Architecture Matters in Continual Learning

1 February 2022

Papers citing "Architecture Matters in Continual Learning"

40 / 40 papers shown

Title
The Importance of Being Lazy: Scaling Limits of Continual Learning Jacopo Graldi Alessandro Breccia Giulia Lanzillotta Thomas Hofmann Lorenzo Noci CLL 32 0 0 20 Jun 2025
Rethinking the Stability-Plasticity Trade-off in Continual Learning from an Architectural Perspective Aojun Lu Hangjie Yuan Tao Feng Yanan Sun 63 2 0 04 Jun 2025
A Good Start Matters: Enhancing Continual Learning with Data-Driven Weight Initialization Md Yousuf Harun Christopher Kanan AI4CE 93 0 0 09 Mar 2025
Position: Continual Learning Benefits from An Evolving Population over An Unified Model Aojun Lu Junchao Ke Chunhui Ding Jiahao Fan Yanan Sun CLL 111 0 0 10 Feb 2025
Revisiting Neural Networks for Continual Learning: An Architectural Perspective Aojun Lu Tao Feng Hangjie Yuan Xiaotian Song Yanan Sun 71 10 0 23 Apr 2024
Continual Learning with Weight Interpolation Jkedrzej Kozal Jan Wasilewski Bartosz Krawczyk Michal Wo'zniak CLL MoMe 90 7 0 05 Apr 2024
Convolutional Prompting meets Language Models for Continual Learning Anurag Roy Riddhiman Moulick Vinay Kumar Verma Saptarshi Ghosh Abir Das VLM CLL LRM 69 18 0 29 Mar 2024
Self-Regulated Neurogenesis for Online Data-Incremental Learning Murat Onur Yildirim Elif Ceren Gok Yildirim Decebal Constantin Mocanu Joaquin Vanschoren CLL 100 0 0 13 Mar 2024
On the Diminishing Returns of Width for Continual Learning E. Guha V. Lakshman CLL 68 6 0 11 Mar 2024
Fine-tuning Reinforcement Learning Models is Secretly a Forgetting Mitigation Problem Maciej Wolczyk Bartłomiej Cupiał M. Ostaszewski Michal Bortkiewicz Michal Zajkac Razvan Pascanu Lukasz Kuciñski Piotr Milo's CLL 153 18 0 05 Feb 2024
Benchmarking Sensitivity of Continual Graph Learning for Skeleton-Based Action Recognition Wei Wei Tom De Schepper Kevin Mets 112 2 0 31 Jan 2024
What Can AutoML Do For Continual Learning? Mert Kilickaya Joaquin Vanschoren 65 2 0 20 Nov 2023
A Survey on Continual Semantic Segmentation: Theory, Challenge, Method and Application Bo Yuan Danpei Zhao 3DV CLL 105 12 0 22 Oct 2023
Elephant Neural Networks: Born to Be a Continual Learner Qingfeng Lan A. Rupam Mahmood CLL 104 9 0 02 Oct 2023
An Intentional Forgetting-Driven Self-Healing Method For Deep Reinforcement Learning Systems Ahmed Haj Yahmed Rached Bouchoucha Houssem Ben Braiek Foutse Khomh CLL AI4CE 66 0 0 23 Aug 2023
Complementary Learning Subnetworks for Parameter-Efficient Class-Incremental Learning Depeng Li Zhigang Zeng CLL 127 1 0 21 Jun 2023
Heterogeneous Continual Learning Divyam Madaan Hongxu Yin Wonmin Byeon Jan Kautz Pavlo Molchanov CLL 67 5 0 14 Jun 2023
LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning Bo Liu Yifeng Zhu Chongkai Gao Yihao Feng Qian Liu Yuke Zhu Peter Stone CLL 188 157 0 05 Jun 2023
Overcoming the Stability Gap in Continual Learning Md Yousuf Harun Christopher Kanan AI4CE 84 11 0 02 Jun 2023
The Tunnel Effect: Building Data Representations in Deep Neural Networks Wojciech Masarczyk M. Ostaszewski Ehsan Imani Razvan Pascanu Piotr Milo's Tomasz Trzciñski 92 25 0 31 May 2023
Deep Reinforcement Learning with Plasticity Injection Evgenii Nikishin Junhyuk Oh Georg Ostrovski Clare Lyle Razvan Pascanu Will Dabney André Barreto OffRL 66 52 0 24 May 2023
A Review of Deep Learning for Video Captioning Moloud Abdar Meenakshi Kollati Swaraja Kuraparthi Farhad Pourpanah Daniel J. McDuff ... Shuicheng Yan Abduallah A. Mohamed Abbas Khosravi Min Zhang Fatih Porikli 3DV 121 22 0 22 Apr 2023
Is forgetting less a good inductive bias for forward transfer? Jiefeng Chen Timothy Nguyen Dilan Görür Arslan Chaudhry CLL 111 14 0 14 Mar 2023
PromptFusion: Decoupling Stability and Plasticity for Continual Learning Haoran Chen Zuxuan Wu Xintong Han Menglin Jia Yu-Gang Jiang CLL 164 12 0 13 Mar 2023
Effects of Architectures on Continual Semantic Segmentation Tobias Kalb Niket Ahuja Jingxing Zhou Jürgen Beyerer CLL 87 3 0 21 Feb 2023
Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages Simeng Sun Maha Elbayad Anna Y. Sun James Cross CLL LRM 98 3 0 07 Feb 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 243 718 0 31 Jan 2023
Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers Sungmin Cha Sungjun Cho Dasol Hwang Honglak Lee Taesup Moon Moontae Lee MU 151 44 0 27 Jan 2023
3rd Continual Learning Workshop Challenge on Egocentric Category and Instance Level Object Understanding Lorenzo Pellegrini Chenchen Zhu Fanyi Xiao Zhicheng Yan Antonio Carta Matthias De Lange Vincenzo Lomonaco Roshan Sumbaly Pau Rodríguez López David Vazquez CLL 109 7 0 13 Dec 2022
CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learning James Smith Leonid Karlinsky V. Gutta Paola Cascante-Bonilla Donghyun Kim Assaf Arbelle Yikang Shen Rogerio Feris Z. Kira CLL VPVLM VLM 110 299 0 23 Nov 2022
Continual Learning by Modeling Intra-Class Variation L. Yu Tianyang Hu Lanqing Hong Zhen Liu Adrian Weller Weiyang Liu CLL 83 13 0 11 Oct 2022
CoSCL: Cooperation of Small Continual Learners is Stronger than a Big One Liyuan Wang Xingxing Zhang Qian Li Jun Zhu Yi Zhong CLL 81 49 0 13 Jul 2022
Memory Population in Continual Learning via Outlier Elimination J. Hurtado Alain Raymond-Sáez Vladimir Araujo Vincenzo Lomonaco Alvaro Soto D. Bacciu 74 9 0 04 Jul 2022
Analysis of Catastrophic Forgetting for Random Orthogonal Transformation Tasks in the Overparameterized Regime Daniel Goldfarb Paul Hand CLL 61 14 0 01 Jun 2022
Engineering flexible machine learning systems by traversing functionally-invariant paths G. Raghavan Bahey Tharwat S. N. Hari Dhruvil Satani Matt Thomson OOD AI4CE 42 8 0 30 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 136 506 0 10 Apr 2022
Towards Exemplar-Free Continual Learning in Vision Transformers: an Account of Attention, Functional and Weight Regularization Francesco Pelosin Saurav Jha A. Torsello Bogdan Raducanu Joost van de Weijer CLL 120 31 0 24 Mar 2022
Increasing Depth of Neural Networks for Life-long Learning Jkedrzej Kozal Michal Wo'zniak CLL 55 8 0 22 Feb 2022
Wide Neural Networks Forget Less Catastrophically Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Huiyi Hu Razvan Pascanu Dilan Görür Mehrdad Farajtabar CLL 86 68 0 21 Oct 2021
Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse Networks Ghada Sokar Decebal Constantin Mocanu Mykola Pechenizkiy CLL 94 8 0 11 Oct 2021