Training Networks in Null Space of Feature Covariance for Continual Learning

12 March 2021

Papers citing "Training Networks in Null Space of Feature Covariance for Continual Learning"

50 / 78 papers shown

Title
Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer Zhenrong Liu J. Huttunen M. Honkala CLL 49 0 0 13 May 2025
DeltaEdit: Enhancing Sequential Editing in Large Language Models by Controlling Superimposed Noise Ding Cao Yuchen Cai Rongxi Guo X. He Guiquan Liu KELM 42 0 0 12 May 2025
Mathematics of Continual Learning Liangzu Peng René Vidal CLL 70 0 0 24 Apr 2025
Self-Controlled Dynamic Expansion Model for Continual Learning RunQing Wu KaiHui Huang HanYi Zhang Fei Ye CLL VLM 47 0 0 14 Apr 2025
BECAME: BayEsian Continual Learning with Adaptive Model MErging Mei Li Yuxiang Lu Qinyan Dai Suizhi Huang Yue Ding Hongtao Lu CLL MoMe 44 0 0 03 Apr 2025
ProtoGuard-guided PROPEL: Class-Aware Prototype Enhancement and Progressive Labeling for Incremental 3D Point Cloud Segmentation H. Li Yuecong Xu Junjie Chen Kemi Ding 3DPC CLL 37 0 0 02 Apr 2025
Continual Learning With Quasi-Newton Methods Steven Vander Eeckt Hugo Van hamme CLL BDL 69 0 0 25 Mar 2025
LoRA Subtraction for Drift-Resistant Space in Exemplar-Free Continual Learning Xuan Liu Xiaobin Chang CLL 174 0 0 23 Mar 2025
Continual Multimodal Contrastive Learning Xiaohao Liu Xiaobo Xia See-Kiong Ng Tat-Seng Chua CLL 57 0 0 19 Mar 2025
ACE: Concept Editing in Diffusion Models without Performance Degradation Ruipeng Wang Junfeng Fang Jiaqi Li Hao Chen Jie Shi K. Wang X. Wang DiffM 53 2 0 11 Mar 2025
SPEED: Scalable, Precise, and Efficient Concept Erasure for Diffusion Models Ouxiang Li Yuan Wang Xinting Hu Houcheng Jiang Tao Liang Y. Hao Guojun Ma Fuli Feng DiffM 49 1 0 10 Mar 2025
Achieving Upper Bound Accuracy of Joint Training in Continual Learning Saleh Momeni Bing Liu CLL 84 1 0 17 Feb 2025
Demystifying Catastrophic Forgetting in Two-Stage Incremental Object Detector Qirui Wu Shizhou Zhang De-Chun Cheng Yinghui Xing Di Xu Peng Wang Yanning Zhang ObjD 61 0 0 08 Feb 2025
Incrementally Learning Multiple Diverse Data Domains via Multi-Source Dynamic Expansion Model RunQing Wu Fei Ye QiHe Liu Guoxi Huang Jinyu Guo Rongyao Hu CLL 172 0 0 15 Jan 2025
Dual Low-Rank Adaptation for Continual Learning with Pre-Trained Models Huancheng Chen Jingtao Li Nidham Gazagnadou Weiming Zhuang Chen Chen Lingjuan Lyu VLM CLL 47 1 0 01 Nov 2024
SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture Jiayi Han Liang Du Hongwei Du Xiangguo Zhou Yiwen Wu Weibo Zheng Donghong Han CLL MoMe MoE 38 2 0 10 Oct 2024
AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models Junfeng Fang Houcheng Jiang Kun Wang Yunshan Ma Shi Jie Xiangnan He Tat-Seng Chua Tat-seng Chua KELM 37 33 0 03 Oct 2024
LW2G: Learning Whether to Grow for Prompt-based Continual Learning Qian Feng Dawei Zhou Hanbin Zhao Chao Zhang Hui Qian VLM CLL 37 3 0 27 Sep 2024
NPAT Null-Space Projected Adversarial Training Towards Zero Deterioration Hanyi Hu Qiao Han Kui Chen Yao Yang AAML 20 0 0 18 Sep 2024
Continual Learning of Nonlinear Independent Representations Boyang Sun Ignavier Ng Guangyi Chen Yifan Shen Qirong Ho Kun Zhang OOD CML 45 0 0 11 Aug 2024
Diffusion Model Meets Non-Exemplar Class-Incremental Learning and Beyond Jichuan Zhang Yali Li Xin Liu Shengjin Wang DiffM 41 0 0 06 Aug 2024
HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning Liyuan Wang Jingyi Xie Xingxing Zhang Hang Su Jun Zhu CLL 47 4 0 07 Jul 2024
The Solution for the sequential task continual learning track of the 2nd Greater Bay Area International Algorithm Competition Sishun Pan Xixian Wu Tingmin Li Longfei Huang Mingxu Feng Zhonghua Wan Yang Yang CLL 26 0 0 06 Jul 2024
Multimodal Classification via Modal-Aware Interactive Enhancement Qing-Yuan Jiang Zhouyang Chi Yang Yang 33 3 0 05 Jul 2024
The Championship-Winning Solution for the 5th CLVISION Challenge 2024 Sishun Pan Tingmin Li Yang Yang CLL 29 0 0 24 Jun 2024
Center-Sensitive Kernel Optimization for Efficient On-Device Incremental Learning Dingwen Zhang Yan Li De-Chun Cheng N. Wang J. Han CLL 36 0 0 13 Jun 2024
Visual Prompt Tuning in Null Space for Continual Learning Yue Lu Shizhou Zhang De-Chun Cheng Yinghui Xing N. Wang Peng Wang Yanning Zhang VLM VPVLM CLL 29 8 0 09 Jun 2024
Machine Unlearning via Null Space Calibration Huiqiang Chen Tianqing Zhu Xin Yu Wanlei Zhou 41 6 0 21 Apr 2024
Control Theoretic Approach to Fine-Tuning and Transfer Learning Erkan Bayram Shenyu Liu M. Belabbas Tamer Basar 19 0 0 17 Apr 2024
Enhancing Visual Continual Learning with Language-Guided Supervision Bolin Ni Hongbo Zhao Chenghao Zhang Ke Hu Gaofeng Meng Zhaoxiang Zhang Shiming Xiang CLL VLM 43 3 0 24 Mar 2024
Approximate Nullspace Augmented Finetuning for Robust Vision Transformers Haoyang Liu Aditya Singh Yijiang Li Haohan Wang AAML ViT 36 1 0 15 Mar 2024
Continual All-in-One Adverse Weather Removal with Knowledge Replay on a Unified Network Structure De-Chun Cheng Yanling Ji Dong Gong Yan Li Nannan Wang Junwei Han Dingwen Zhang CLL 23 12 0 12 Mar 2024
Robustness-Congruent Adversarial Training for Secure Machine Learning Model Updates Daniele Angioni Luca Demetrio Maura Pintor Luca Oneto Davide Anguita Battista Biggio Fabio Roli AAML 27 2 0 27 Feb 2024
Maintaining Adversarial Robustness in Continuous Learning Xiaolei Ru Xiaowei Cao Zijia Liu Jack Murdoch Moore Xin-Ya Zhang Xia Zhu Wenjia Wei Gang Yan AAML 19 1 0 17 Feb 2024
Towards Continual Learning Desiderata via HSIC-Bottleneck Orthogonalization and Equiangular Embedding Depeng Li Tianqi Wang Junwei Chen Qining Ren Kenji Kawaguchi Zhigang Zeng CLL 45 6 0 17 Jan 2024
Learning a Low-Rank Feature Representation: Achieving Better Trade-Off between Stability and Plasticity in Continual Learning Zhenrong Liu Yang Li Yi Gong Yik-Chung Wu CLL 18 1 0 14 Dec 2023
Continual Learning through Networks Splitting and Merging with Dreaming-Meta-Weighted Model Fusion Yi Sun Xin Xu Jian Li Guanglei Xie Yifei Shi Qiang Fang CLL MoMe 26 1 0 12 Dec 2023
Hessian Aware Low-Rank Perturbation for Order-Robust Continual Learning Jiaqi Li Yuanhao Lai Rui Wang Changjian Shui Sabyasachi Sahoo Charles X. Ling Shichun Yang Boyu Wang Christian Gagné Fan Zhou CLL 40 1 0 26 Nov 2023
CovarNav: Machine Unlearning via Model Inversion and Covariance Navigation Ali Abbasi Chayne Thrash Elaheh Akbari Daniel Zhang Soheil Kolouri MU 30 3 0 21 Nov 2023
BrainWash: A Poisoning Attack to Forget in Continual Learning Ali Abbasi Parsa Nooralinejad Hamed Pirsiavash Soheil Kolouri CLL KELM AAML 26 5 0 20 Nov 2023
Towards Plastic and Stable Exemplar-Free Incremental Learning: A Dual-Learner Framework with Cumulative Parameter Averaging Wenju Sun Qingyong Li Wen Wang Yangli-ao Geng CLL MoMe 13 3 0 28 Oct 2023
Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Prompt Gangwei Jiang Caigao Jiang Siqiao Xue James Y. Zhang Junqing Zhou Defu Lian Ying Wei VLM 32 7 0 19 Oct 2023
Keep Moving: identifying task-relevant subspaces to maximise plasticity for newly learned tasks Daniel Anthes Sushrut Thorat Peter König Tim C Kietzmann CLL 22 0 0 07 Oct 2023
Continual Contrastive Spoken Language Understanding Umberto Cappellazzo Enrico Fini Muqiao Yang Daniele Falavigna A. Brutti Bhiksha Raj CLL 23 1 0 04 Oct 2023
Primal Dual Continual Learning: Balancing Stability and Plasticity through Adaptive Memory Allocation Juan Elenter Navid Naderializadeh Tara Javidi Alejandro Ribeiro CLL 15 1 0 29 Sep 2023
ScrollNet: Dynamic Weight Importance for Continual Learning Fei Yang Kai Wang Joost van de Weijer 22 4 0 31 Aug 2023
Balanced Destruction-Reconstruction Dynamics for Memory-replay Class Incremental Learning Yuhang Zhou Jiangchao Yao Feng Hong Ya-Qin Zhang Yanfeng Wang 23 6 0 03 Aug 2023
Towards Open Federated Learning Platforms: Survey and Vision from Technical and Legal Perspectives Moming Duan Qinbin Li Linshan Jiang Bingsheng He FedML 31 4 0 05 Jul 2023
POP: Prompt Of Prompts for Continual Learning Zhiyuan Hu J. Lyu Dashan Gao Nuno Vasconcelos CLL LRM VLM 11 5 0 14 Jun 2023
The Ideal Continual Learner: An Agent That Never Forgets Liangzu Peng Paris V. Giampouras René Vidal CLL 108 26 0 29 Apr 2023