Gradient Projection Memory for Continual Learning

17 March 2021

Papers citing "Gradient Projection Memory for Continual Learning"

50 / 58 papers shown

Title
GDI-Bench: A Benchmark for General Document Intelligence with Vision and Reasoning Decoupling Siqi Li Yufan Shen Xiangnan Chen Jiayi Chen Hengwei Ju ... Licheng Wen Botian Shi Y. Liu Xinyu Cai Yu Qiao VLM ELM 91 0 0 30 Apr 2025
Mitigating Catastrophic Forgetting in the Incremental Learning of Medical Images Sara Yavari Jacob Furst CLL 58 0 0 28 Apr 2025
Mathematics of Continual Learning Liangzu Peng René Vidal CLL 70 0 0 24 Apr 2025
SUV: Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearning Tianyang Xu Xiaoze Liu Feijie Wu Xiaoqian Wang Jing Gao MU 61 0 0 29 Mar 2025
Continual Learning With Quasi-Newton Methods Steven Vander Eeckt Hugo Van hamme CLL BDL 69 0 0 25 Mar 2025
One-for-More: Continual Diffusion Model for Anomaly Detection Xiaofan Li Xin Tan Zhuo Chen Zhizhong Zhang Ruixin Zhang ... Guanna Jiang Yulong Chen Yanyun Qu Lizhuang Ma Yuan Xie DiffM 58 1 0 27 Feb 2025
Orthogonal Calibration for Asynchronous Federated Learning Jiayun Zhang Shuheng Li Haiyu Huang Xiaofan Yu Rajesh K. Gupta Jingbo Shang FedML 65 0 0 21 Feb 2025
Theory on Mixture-of-Experts in Continual Learning Hongbo Li Sen-Fon Lin Lingjie Duan Yingbin Liang Ness B. Shroff MoE MoMe CLL 153 14 0 20 Feb 2025
CE-SDWV: Effective and Efficient Concept Erasure for Text-to-Image Diffusion Models via a Semantic-Driven Word Vocabulary Jiahang Tu Qian Feng Chufan Chen Jiahua Dong Hanbin Zhao Chao Zhang Hui Qian 72 2 0 28 Jan 2025
TinySubNets: An efficient and low capacity continual learning strategy Marcin Pietroñ Kamil Faber Dominik Zurek Roberto Corizzo 80 0 0 14 Dec 2024
Gradient Localization Improves Lifelong Pretraining of Language Models Jared Fernandez Yonatan Bisk Emma Strubell KELM 39 1 0 07 Nov 2024
Dual Low-Rank Adaptation for Continual Learning with Pre-Trained Models Huancheng Chen Jingtao Li Nidham Gazagnadou Weiming Zhuang Chen Chen Lingjuan Lyu VLM CLL 47 1 0 01 Nov 2024
AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models Fan Zhang Houcheng Jiang Kun Wang Yunshan Ma Shi Jie Xiangnan He Tat-Seng Chua Tat-seng Chua KELM 39 34 0 03 Oct 2024
LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learning Liangzu Peng Juan Elenter Joshua Agterberg Alejandro Ribeiro René Vidal VLM CLL 46 1 0 01 Oct 2024
Buffer-based Gradient Projection for Continual Federated Learning Shenghong Dai Jy-yong Sohn Yicong Chen S. Alam Ravikumar Balakrishnan Suman Banerjee N. Himayat Kangwook Lee FedML 75 2 0 03 Sep 2024
HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning Liyuan Wang Jingyi Xie Xingxing Zhang Hang Su Jun Zhu CLL 47 5 0 07 Jul 2024
EdgeSync: Faster Edge-model Updating via Adaptive Continuous Learning for Video Data Drift Peng Zhao Runchu Dong Guiqin Wang Cong Zhao 38 1 0 05 Jun 2024
Machine Unlearning via Null Space Calibration Huiqiang Chen Tianqing Zhu Xin Yu Wanlei Zhou 41 6 0 21 Apr 2024
EsaCL: Efficient Continual Learning of Sparse Models Weijieying Ren V. Honavar CLL 25 3 0 11 Jan 2024
Continual Learning through Networks Splitting and Merging with Dreaming-Meta-Weighted Model Fusion Yi Sun Xin Xu Jian Li Guanglei Xie Yifei Shi Qiang Fang CLL MoMe 31 1 0 12 Dec 2023
Two Complementary Perspectives to Continual Learning: Ask Not Only What to Optimize, But Also How Timm Hess Tinne Tuytelaars Gido M. van de Ven 44 7 0 08 Nov 2023
A Unified Approach to Domain Incremental Learning with Memory: Theory and Algorithm Haizhou Shi Hao Wang CLL 34 18 0 18 Oct 2023
Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation Yilin Lyu Liyuan Wang Xingxing Zhang Zicheng Sun Hang Su Jun Zhu Liping Jing 34 8 0 13 Oct 2023
Can Continual Learning Improve Long-Tailed Recognition? Toward a Unified Framework Mahdiyar Molahasani Michael A. Greenspan Ali Etemad 24 2 0 23 Jun 2023
Task Difficulty Aware Parameter Allocation & Regularization for Lifelong Learning Wenjin Wang Yunqing Hu Qianglong Chen Yin Zhang CLL 32 13 0 11 Apr 2023
CoDeC: Communication-Efficient Decentralized Continual Learning Sakshi Choudhary Sai Aparna Aketi Gobinda Saha Kaushik Roy CLL 50 3 0 27 Mar 2023
Fixed Design Analysis of Regularization-Based Continual Learning Haoran Li Jingfeng Wu Vladimir Braverman CLL 26 9 0 17 Mar 2023
Subspace based Federated Unlearning Guang-Ming Li Li Shen Yan Sun Yuejun Hu Han Hu Dacheng Tao MU FedML 28 20 0 24 Feb 2023
Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning? Chengwei Qin Q. Li Ruochen Zhao Shafiq R. Joty VLM LRM 23 15 0 16 Feb 2023
Restricted Orthogonal Gradient Projection for Continual Learning Zeyuan Yang Zonghan Yang Peng Li Yang Liu CLL 29 4 0 28 Jan 2023
Projected Subnetworks Scale Adaptation Siddhartha Datta N. Shadbolt VLM CLL 28 0 0 27 Jan 2023
Enabling Hard Constraints in Differentiable Neural Network and Accelerator Co-Exploration Deokki Hong Kanghyun Choi Hyeyoon Lee Joonsang Yu Noseong Park Youngsok Kim Jinho Lee 19 3 0 23 Jan 2023
PIVOT: Prompting for Video Continual Learning Andrés Villa Juan Carlos León Alcázar Motasem Alfarra Kumail Alhamoud J. Hurtado Fabian Caba Heilbron Alvaro Soto Guohao Li VLM CLL 40 45 0 09 Dec 2022
G-MAP: General Memory-Augmented Pre-trained Language Model for Domain Tasks Zhongwei Wan Yichun Yin Wei Zhang Jiaxin Shi Lifeng Shang Guangyong Chen Xin Jiang Qun Liu VLM CLL 36 16 0 07 Dec 2022
Continual Learning with Optimal Transport based Mixture Model Quyen Tran Hoang Phan Khoat Than Dinh Q. Phung Trung Le CLL 21 1 0 30 Nov 2022
Progressive Learning without Forgetting Tao Feng Hangjie Yuan Mang Wang Ziyuan Huang Ang Bian Jianzhou Zhang CLL KELM 44 4 0 28 Nov 2022
Domain-incremental Cardiac Image Segmentation with Style-oriented Replay and Domain-sensitive Feature Whitening Kang Li Lequan Yu Pheng-Ann Heng CLL 24 22 0 09 Nov 2022
Continual Learning by Modeling Intra-Class Variation L. Yu Tianyang Hu Lanqing Hong Zhen Liu Adrian Weller Weiyang Liu CLL 48 12 0 11 Oct 2022
A Multi-Head Model for Continual Learning via Out-of-Distribution Replay Gyuhak Kim Zixuan Ke Bin Liu VLM CLL OODD 25 29 0 20 Aug 2022
S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learning Yabin Wang Zhiwu Huang Xiaopeng Hong CLL VLM 27 210 0 26 Jul 2022
Incremental Task Learning with Incremental Rank Updates Rakib Hyder Ken Shao Boyu Hou P. Markopoulos Ashley Prater-Bennette M. Salman Asif CLL 16 13 0 19 Jul 2022
How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition Jorge Armando Mendez Mendez Eric Eaton KELM CLL 32 27 0 15 Jul 2022
Improving Task-free Continual Learning by Distributionally Robust Memory Evolution Zhenyi Wang Li Shen Le Fang Qiuling Suo Tiehang Duan Mingchen Gao OOD 37 39 0 15 Jul 2022
Remember the Past: Distilling Datasets into Addressable Memories for Neural Networks Zhiwei Deng Olga Russakovsky FedML DD 41 92 0 06 Jun 2022
Teaching Networks to Solve Optimization Problems Xinran Liu Yuzhe Lu Ali Abbasi Meiyi Li Javad Mohammadi Soheil Kolouri 44 11 0 08 Feb 2022
Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank? Sheikh Shams Azam Seyyedali Hosseinalipour Qiang Qiu Christopher G. Brinton FedML 26 20 0 01 Feb 2022
Technical Report for ICCV 2021 Challenge SSLAD-Track3B: Transformers Are Better Continual Learners Duo Li Guimei Cao Yunlu Xu Zhanzhan Cheng Yi Niu CLL 22 21 0 13 Jan 2022
Generative Kernel Continual learning Mohammad Mahdi Derakhshani Xiantong Zhen Ling Shao Cees G. M. Snoek BDL VLM 38 0 0 26 Dec 2021
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion Arthur Douillard Alexandre Ramé Guillaume Couairon Matthieu Cord CLL 30 295 0 22 Nov 2021
Towards Lifelong Learning of Multilingual Text-To-Speech Synthesis Mu Yang Shaojin Ding Tianlong Chen Tong Wang Zhangyang Wang CLL 22 5 0 09 Oct 2021