Continual Normalization: Rethinking Batch Normalization for Online Continual Learning

30 March 2022

ArXiv (abs)PDF HTML Github (13★)

Papers citing "Continual Normalization: Rethinking Batch Normalization for Online Continual Learning"

37 / 37 papers shown

Title
Rethinking the Stability-Plasticity Trade-off in Continual Learning from an Architectural Perspective Aojun Lu Hangjie Yuan Tao Feng Yanan Sun 51 2 0 04 Jun 2025
Continual Learning Beyond Experience Rehearsal and Full Model Surrogates Prashant Shivaram Bhat Laurens Niesten Elahe Arani Bahram Zonooz CLL 15 0 0 28 May 2025
Hybrid Batch Normalisation: Resolving the Dilemma of Batch Normalisation in Federated Learning Hongyao Chen Tianyang Xu Xiaojun Wu Josef Kittler FedML 23 0 0 28 May 2025
Human-inspired Perspectives: A Survey on AI Long-term Memory Zihong He Weizhe Lin Hao Zheng Fan Zhang Matt Jones Laurence Aitchison X. Xu Miao Liu Per Ola Kristensson Junxiao Shen 242 3 0 01 Nov 2024
Dual-CBA: Improving Online Continual Learning via Dual Continual Bias Adaptors from a Bi-level Optimization Perspective Quanziang Wang Renzhen Wang Yichen Wu Xixi Jia Minghao Zhou Deyu Meng 87 1 0 26 Aug 2024
ER-FSL: Experience Replay with Feature Subspace Learning for Online Continual Learning Huiwei Lin CLL 136 0 0 17 Jul 2024
CCSI: Continual Class-Specific Impression for Data-free Class Incremental Learning Sana Ayromlou Teresa S. M. Tsang Purang Abolmaesumi Xiaoxiao Li CLL 61 2 0 09 Jun 2024
Exploring the Evolution of Hidden Activations with Live-Update Visualization Xianglin Yang Jin Song Dong 55 0 0 24 May 2024
Integrating Present and Past in Unsupervised Continual Learning Yipeng Zhang Laurent Charlin R. Zemel Mengye Ren CLL 74 4 0 29 Apr 2024
Revisiting Neural Networks for Continual Learning: An Architectural Perspective Aojun Lu Tao Feng Hangjie Yuan Xiaotian Song Yanan Sun 69 9 0 23 Apr 2024
One-Shot Domain Incremental Learning Yasushi Esaki Satoshi Koide Takuro Kutsuna CLL VLM 111 1 0 25 Mar 2024
Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learning Da-Wei Zhou Hai-Long Sun Han-Jia Ye De-Chuan Zhan CLL 100 61 0 18 Mar 2024
Class-incremental Learning for Time Series: Benchmark and Evaluation Zhongzheng Qiao Quang Pham Zhen Cao Hoang H Le Ponnuthurai Nagaratnam Suganthan Xudong Jiang Savitha Ramasamy 101 10 0 19 Feb 2024
Catastrophic Forgetting in Deep Learning: A Comprehensive Taxonomy Everton L. Aleixo J. Colonna Marco Cristo Everlandio Fernandes CLL 114 26 0 16 Dec 2023
Weighted Ensemble Models Are Strong Continual Learners Imad Eddine Marouf Subhankar Roy Enzo Tartaglione Stéphane Lathuilière CLL 109 22 0 14 Dec 2023
Prior-Free Continual Learning with Unlabeled Data in the Wild Tao Zhuo Zhiyong Cheng Hehe Fan Mohan S. Kankanhalli VLM CLL 74 2 0 16 Oct 2023
Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation Yilin Lyu Liyuan Wang Xingxing Zhang Zicheng Sun Hang Su Jun Zhu Liping Jing 80 8 0 13 Oct 2023
Factorized Tensor Networks for Multi-Task and Multi-Domain Learning Yash Garg Nebiyou Yismaw Rakib Hyder Ashley Prater-Bennette M. Salman Asif 58 2 0 09 Oct 2023
HPCR: Holistic Proxy-based Contrastive Replay for Online Continual Learning Huiwei Lin Shanshan Feng Baoquan Zhang Xutao Li Yew-Soon Ong CLL 131 0 0 26 Sep 2023
SymED: Adaptive and Online Symbolic Representation of Data on the Edge Daniel Hofstätter Shashikant Ilager Ivan Lujic Ivona Brandić 38 3 0 06 Sep 2023
Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-free Continual Learning Filip Szatkowski Mateusz Pyla Marcin Przewiȩźlikowski Sebastian Cygert Bartlomiej Twardowski Tomasz Trzciñski CLL 84 11 0 18 Aug 2023
Class-Incremental Mixture of Gaussians for Deep Continual Learning Lukasz Korycki Bartosz Krawczyk CLL BDL 58 1 0 09 Jul 2023
Does Continual Learning Equally Forget All Parameters? Haiyan Zhao Dinesh Manocha Guodong Long Jing Jiang Chengqi Zhang CLL KELM 98 14 0 09 Apr 2023
Principles of Forgetting in Domain-Incremental Semantic Segmentation in Adverse Weather Conditions Tobias Kalb Jürgen Beyerer CLL 52 5 0 24 Mar 2023
Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need Da-Wei Zhou Han-Jia Ye De-Chuan Zhan Ziwei Liu CLL 106 111 0 13 Mar 2023
Effects of Architectures on Continual Semantic Segmentation Tobias Kalb Niket Ahuja Jingxing Zhou Jürgen Beyerer CLL 80 3 0 21 Feb 2023
New Insights for the Stability-Plasticity Dilemma in Online Continual Learning Dahuin Jung Dongjin Lee Sunwon Hong Hyemi Jang Ho Bae Sungroh Yoon CLL 62 15 0 17 Feb 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 234 712 0 31 Jan 2023
On the Soft-Subnetwork for Few-shot Class Incremental Learning Haeyong Kang Jaehong Yoon Sultan Rizky Hikmawan Madjid Sung Ju Hwang Chang D. Yoo CLL 112 44 0 15 Sep 2022
Towards Diverse Evaluation of Class Incremental Learning: A Representation Learning Perspective Sungmin Cha Jihwan Kwak Dongsub Shim Hyunwoo J. Kim Moontae Lee Honglak Lee Taesup Moon CLL 61 1 0 16 Jun 2022
Alleviating Representational Shift for Continual Fine-tuning Shibo Jie Zhi-Hong Deng Ziheng Li CLL 89 11 0 22 Apr 2022
On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis Dominik Rivoir Isabel Funke Stefanie Speidel 98 19 0 15 Mar 2022
Diagnosing Batch Normalization in Class Incremental Learning Minghao Zhou Quanziang Wang Jun Shu Qian Zhao Deyu Meng CLL 79 6 0 16 Feb 2022
Architecture Matters in Continual Learning Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Timothy Nguyen Razvan Pascanu Dilan Görür Mehrdad Farajtabar OOD KELM 170 62 0 01 Feb 2022
Rebalancing Batch Normalization for Exemplar-based Class-Incremental Learning Sungmin Cha Sungjun Cho Dasol Hwang Sunwon Hong Moontae Lee Taesup Moon CLL 130 19 0 29 Jan 2022
Task-Specific Normalization for Continual Learning of Blind Image Quality Models Weixia Zhang Kede Ma Guangtao Zhai Xiaokang Yang VLM 103 24 0 28 Jul 2021
CrossQ: Batch Normalization in Deep Reinforcement Learning for Greater Sample Efficiency and Simplicity Aditya Bhatt Daniel Palenicek Boris Belousov Max Argus Artemij Amiranashvili Thomas Brox Jan Peters 125 57 0 14 Feb 2019