Overcoming catastrophic forgetting with hard attention to the task

4 January 2018

Joan Serra

Dídac Surís

M. Miron

Alexandros Karatzoglou

CLL

ArXiv PDF HTML

Papers citing "Overcoming catastrophic forgetting with hard attention to the task"

50 / 192 papers shown

Title
Beyond CLIP Generalization: Against Forward&Backward Forgetting Adapter for Continual Learning of Vision-Language Models Songlin Dong Chenhao Ding Jiangyang Li Jizhou Han Qiang Wang Yuhang He Yihong Gong CLL VLM 37 0 0 12 May 2025
Ranking-aware Continual Learning for LiDAR Place Recognition Xufei Wang Gengxuan Tian Junqiao Zhao Siyue Tao Qiwen Gu Qiankun Yu Tiantian Feng CLL 28 0 0 12 May 2025
Autoencoder-Based Hybrid Replay for Class-Incremental Learning M. Nori Il Kim Guanghui Wang CLL 50 0 0 09 May 2025
The Estimation of Continual Causal Effect for Dataset Shifting Streams Baining Chen Yiming Zhang Yuqiao Han Ruyue Zhang Ruihuan Du Zhishuo Zhou Zhengdan Zhu Xun Liu Jiecheng Guo 116 0 0 29 Apr 2025
Enhancing Pre-Trained Model-Based Class-Incremental Learning through Neural Collapse Kun He Zijian Song Shuoxi Zhang J. Hopcroft CLL 56 0 0 25 Apr 2025
Continual Learning With Quasi-Newton Methods Steven Vander Eeckt Hugo Van hamme CLL BDL 69 0 0 25 Mar 2025
Adaptive Weighted Parameter Fusion with CLIP for Class-Incremental Learning J. Guo Xiaoguang Zhu Liangyu Teng Hao Yang J. Liu Y. Liu Liang Song CLL VLM 69 1 0 25 Mar 2025
UniCon: Unidirectional Information Flow for Effective Control of Large-Scale Diffusion Models Fanghua Yu Jinjin Gu Jinfan Hu Zheyuan Li Chao Dong DiffM 52 0 0 21 Mar 2025
H2ST: Hierarchical Two-Sample Tests for Continual Out-of-Distribution Detection Yuhang Liu Wenjie Zhao Yunhui Guo OODD 72 0 0 19 Mar 2025
Enhanced Continual Learning of Vision-Language Models with Model Fusion Haoyuan Gao Zicong Zhang Yuqi Wei Linglan Zhao Guilin Li Y. Li Linghe Kong Weiran Huang CLL VLM 165 0 0 12 Mar 2025
Lifelong Learning with Task-Specific Adaptation: Addressing the Stability-Plasticity Dilemma Ruiyu Wang Sen Wang X. Zuo Q. Sun CLL KELM 65 0 0 08 Mar 2025
Mastering Continual Reinforcement Learning through Fine-Grained Sparse Network Allocation and Dormant Neuron Exploration Chengqi Zheng Haiyan Yin Jianda Chen Terence Ng Yew-Soon Ong Ivor Tsang CLL 143 0 0 07 Mar 2025
Theory on Mixture-of-Experts in Continual Learning Hongbo Li Sen-Fon Lin Lingjie Duan Yingbin Liang Ness B. Shroff MoE MoMe CLL 153 14 0 20 Feb 2025
Achieving Upper Bound Accuracy of Joint Training in Continual Learning Saleh Momeni Bing Liu CLL 84 1 0 17 Feb 2025
Unlocking the Power of Function Vectors for Characterizing and Mitigating Catastrophic Forgetting in Continual Instruction Tuning Gangwei Jiang Caigao Jiang Zhaoyi Li Siqiao Xue Jun-ping Zhou Linqi Song Defu Lian Yin Wei CLL MU 60 0 0 16 Feb 2025
The impact of allocation strategies in subset learning on the expressive power of neural networks Ofir Schlisselberg Ran Darshan 91 0 0 10 Feb 2025
Iterative Feature Space Optimization through Incremental Adaptive Evaluation Yanping Wu Yanyong Huang Zhengzhang Chen Zijun Yao Yanjie Fu Kunpeng Liu Xiao Luo Dongjie Wang 34 0 0 28 Jan 2025
Dynamic Continual Learning: Harnessing Parameter Uncertainty for Improved Network Adaptation Christopher Angelini N. Bouaynaya BDL 33 0 0 18 Jan 2025
LSEBMCL: A Latent Space Energy-Based Model for Continual Learning Xiaodi Li Dingcheng Li Rujun Gao Mahmoud Zamani Latifur Khan CLL KELM 44 0 0 09 Jan 2025
Integrating Dual Prototypes for Task-Wise Adaption in Pre-Trained Model-Based Class-Incremental Learning Zhiming Xu S. M. I. Simon X. Yang Baile Xu Jian Zhao F. Shen CLL 81 0 0 26 Nov 2024
RECAST: Reparameterized, Compact weight Adaptation for Sequential Tasks Nazia Tasnim Bryan A. Plummer CLL OffRL 74 0 0 25 Nov 2024
Efficient Non-Exemplar Class-Incremental Learning with Retrospective Feature Synthesis Liang Bai Hong Song Yucong Lin Tianyu Fu Deqiang Xiao Danni Ai Jingfan Fan Jian Yang CLL 36 0 0 03 Nov 2024
ATLAS: Adapter-Based Multi-Modal Continual Learning with a Two-Stage Learning Strategy Hong Li Zhiquan Tan Xingyu Li Weiran Huang CLL MoMe 43 1 0 14 Oct 2024
Temporal-Difference Variational Continual Learning L. Melo Alessandro Abate Yarin Gal BDL CLL VLM 46 0 0 10 Oct 2024
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey Dianzhi Yu Xinni Zhang Yankai Chen Aiwei Liu Yifei Zhang Philip S. Yu Irwin King VLM CLL 44 9 0 07 Oct 2024
Drift to Remember Jin Du X. Zhang Hao Shen Xun Xian Ganghua Wang Jiawei Zhang Yuhong Yang Na Li Jia Liu Jie Ding CLL 18 0 0 21 Sep 2024
Joint Input and Output Coordination for Class-Incremental Learning Shuai Wang Yibing Zhan Yong Luo Han Hu Wei Yu Yonggang Wen Dacheng Tao CLL 35 2 0 09 Sep 2024
Buffer-based Gradient Projection for Continual Federated Learning Shenghong Dai Jy-yong Sohn Yicong Chen S. Alam Ravikumar Balakrishnan Suman Banerjee N. Himayat Kangwook Lee FedML 75 2 0 03 Sep 2024
Exploiting the Semantic Knowledge of Pre-trained Text-Encoders for Continual Learning Lu Yu Hesong Li Ying Fu J. Weijer Changsheng Xu CLL 49 1 0 02 Aug 2024
HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning Liyuan Wang Jingyi Xie Xingxing Zhang Hang Su Jun Zhu CLL 47 4 0 07 Jul 2024
CLoG: Benchmarking Continual Learning of Image Generation Models Haotian Zhang Junting Zhou Haowei Lin Hang Ye Jianhua Zhu Zihao Wang Liangcai Gao Yizhou Wang Yitao Liang DiffM VLM 31 0 0 07 Jun 2024
Disentangling and Mitigating the Impact of Task Similarity for Continual Learning Naoki Hiratani CLL 35 2 0 30 May 2024
Distribution Aligned Semantics Adaption for Lifelong Person Re-Identification Qizao Wang Xuelin Qian Bin Li Xiangyang Xue 24 1 0 30 May 2024
Auto-selected Knowledge Adapters for Lifelong Person Re-identification Xuelin Qian Ruiqi Wu Gong Cheng Junwei Han CLL 52 2 0 29 May 2024
Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System Chen Chen Ruizhe Li Yuchen Hu Yuanyuan Chen Chengwei Qin Qiang Zhang CLL 41 1 0 16 May 2024
Double Mixture: Towards Continual Event Detection from Speech Jingqi Kang Tongtong Wu Jinming Zhao Guitao Wang Yinwei Wei Haomiao Yang Guilin Qi Yuan-Fang Li Gholamreza Haffari 28 0 0 20 Apr 2024
Adaptive Memory Replay for Continual Learning James Seale Smith Lazar Valkov Shaunak Halbe V. Gutta Rogerio Feris Z. Kira Leonid Karlinsky 36 6 0 18 Apr 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 42 8 0 27 Mar 2024
One-Shot Domain Incremental Learning Yasushi Esaki Satoshi Koide Takuro Kutsuna CLL VLM 40 0 0 25 Mar 2024
HOP to the Next Tasks and Domains for Continual Learning in NLP Umberto Michieli Mete Ozay VLM 33 2 0 28 Feb 2024
COPR: Continual Human Preference Learning via Optimal Policy Regularization Han Zhang Lin Gui Yu Lei Yuanzhao Zhai Yehong Zhang ... Hui Wang Yue Yu Kam-Fai Wong Bin Liang Ruifeng Xu CLL 34 4 0 22 Feb 2024
Continual Learning on Graphs: A Survey Zonggui Tian Duanhao Zhang Hong-Ning Dai 45 5 0 09 Feb 2024
Spiking-PhysFormer: Camera-Based Remote Photoplethysmography with Parallel Spike-driven Transformer Mingxuan Liu Jiankai Tang Haoxiang Li Jiahao Qi Siwei Li Kegang Wang Yuntao wang Hong Chen Yuntao Wang Hong Chen 91 14 0 07 Feb 2024
Divide and not forget: Ensemble of selectively trained experts in Continual Learning Grzegorz Rype'sć Sebastian Cygert Valeriya Khan Tomasz Trzciñski Bartosz Zieliñski Bartlomiej Twardowski CLL 24 28 0 18 Jan 2024
Federated Continual Learning via Knowledge Fusion: A Survey Xin Yang Hao Yu Xin Gao Hao Wang Junbo Zhang Tianrui Li FedML 30 31 0 27 Dec 2023
Doubly Perturbed Task Free Continual Learning Byung Hyun Lee Min-hwan Oh Se Young Chun 16 3 0 20 Dec 2023
Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models Kyra Ahrens Hans Hergen Lehmann Jae Hee Lee Stefan Wermter CLL 35 7 0 13 Dec 2023
Benchmarking Continual Learning from Cognitive Perspectives Xiaoqian Liu Junge Zhang Mingyi Zhang Peipei Yang 16 0 0 06 Dec 2023
Rethinking E-Commerce Search Haixun Wang Taesik Na 35 6 0 06 Dec 2023
CUCL: Codebook for Unsupervised Continual Learning Chen Cheng Jingkuan Song Xiaosu Zhu Junchen Zhu Lianli Gao H. Shen CLL 23 2 0 25 Nov 2023