A Comprehensive Survey of Continual Learning: Theory, Method and Application

31 January 2023

Liyuan Wang

Xingxing Zhang

Hang Su

Jun Zhu

KELM

CLL

ArXiv PDF HTML

Papers citing "A Comprehensive Survey of Continual Learning: Theory, Method and Application"

50 / 169 papers shown

Title
One VLM to Keep it Learning: Generation and Balancing for Data-free Continual Visual Question Answering Deepayan Das Davide Talon Massimiliano Mancini Yiming Wang Elisa Ricci 50 0 0 04 Nov 2024
Interacting Large Language Model Agents. Interpretable Models and Social Learning Adit Jain Vikram Krishnamurthy LLMAG 37 0 0 02 Nov 2024
Dual Low-Rank Adaptation for Continual Learning with Pre-Trained Models Huancheng Chen Jingtao Li Nidham Gazagnadou Weiming Zhuang Chen Chen Lingjuan Lyu VLM CLL 49 1 0 01 Nov 2024
Teddy: Efficient Large-Scale Dataset Distillation via Taylor-Approximated Matching Ruonan Yu Songhua Liu Jingwen Ye Xinchao Wang DD 40 4 0 10 Oct 2024
Temporal-Difference Variational Continual Learning Luckeciano C. Melo Alessandro Abate Yarin Gal BDL CLL VLM 46 0 0 10 Oct 2024
LeanAgent: Lifelong Learning for Formal Theorem Proving Adarsh Kumarappan Mo Tiwari Peiyang Song Robert Joseph George Chaowei Xiao Anima Anandkumar CLL LLMAG LRM 74 8 0 08 Oct 2024
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey Dianzhi Yu Xinni Zhang Yankai Chen Aiwei Liu Yifei Zhang Philip S. Yu Irwin King VLM CLL 52 10 0 07 Oct 2024
Where are we in audio deepfake detection? A systematic analysis over generative and detection models Xiang Li Pin-Yu Chen Wenqi Wei 41 2 0 06 Oct 2024
Structural-Entropy-Based Sample Selection for Efficient and Effective Learning Tianchi Xie Jiangning Zhu Guozu Ma Minzhi Lin Wei Chen Weikai Yang Shixia Liu 33 0 0 03 Oct 2024
Dual Consolidation for Pre-Trained Model-Based Domain-Incremental Learning Da-Wei Zhou Zi-Wen Cai Han-Jia Ye Lijun Zhang De-Chuan Zhan CLL AI4CE 76 2 0 01 Oct 2024
LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learning Liangzu Peng Juan Elenter Joshua Agterberg Alejandro Ribeiro René Vidal VLM CLL 46 1 0 01 Oct 2024
Mining Your Own Secrets: Diffusion Classifier Scores for Continual Personalization of Text-to-Image Diffusion Models Saurav Jha Shiqi Yang Masato Ishii Mengjie Zhao Christian Simon Muhammad Jehanzeb Mirza Dong Gong Lina Yao Shusuke Takahashi Yuki Mitsufuji DiffM 67 2 0 01 Oct 2024
M2Distill: Multi-Modal Distillation for Lifelong Imitation Learning Kaushik Roy Akila Dissanayake Brendan Tidd Peyman Moghadam CLL VLM 69 2 0 30 Sep 2024
Tiny Robotics Dataset and Benchmark for Continual Object Detection Francesco Pasti Riccardo De Monte Davide Dalle Pezze Gian Antonio Susto Nicola Bellotto 47 1 0 24 Sep 2024
Towards LifeSpan Cognitive Systems Yu Wang Chi Han Tongtong Wu Xiaoxin He Wangchunshu Zhou ... Zexue He Wei Wang Gholamreza Haffari Heng Ji Julian McAuley KELM CLL 215 1 0 20 Sep 2024
A Unified Framework for Neural Computation and Learning Over Time S. Melacci Alessandro Betti Michele Casoni Tommaso Guidi Matteo Tiezzi Marco Gori AI4TS 30 0 0 18 Sep 2024
Few-Shot Class-Incremental Learning with Non-IID Decentralized Data Cuiwei Liu Siang Xu Huaijun Qiu Jing Zhang Zhi Liu Liang Zhao CLL 36 0 0 18 Sep 2024
ReFu: Recursive Fusion for Exemplar-Free 3D Class-Incremental Learning Yi Yang Lei Zhong Huiping Zhuang 3DPC CLL 47 0 0 18 Sep 2024
Towards understanding evolution of science through language model series Junjie Dong Zhuoqi Lyu Qing Ke AI4TS 37 0 0 15 Sep 2024
Wind turbine condition monitoring based on intra- and inter-farm federated learning Albin Grataloup Stefan Jonas Angela Meyer AI4CE 41 0 0 05 Sep 2024
Prompt Baking Aman Bhargava Cameron Witkowski Alexander Detkov Matt W. Thomson AI4CE 38 0 0 04 Sep 2024
Mitigating the Stability-Plasticity Dilemma in Adaptive Train Scheduling with Curriculum-Driven Continual DQN Expansion Achref Jaziri Etienne Kunzel Visvanathan Ramesh CLL 58 0 0 19 Aug 2024
An Effective Dynamic Gradient Calibration Method for Continual Learning Weichen Lin Jiaxiang Chen Ru Huang Huihua Ding CLL 44 0 0 30 Jul 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 83 3 0 30 Jul 2024
Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective Jingren Liu Zhong Ji YunLong Yu Jiale Cao Yanwei Pang Jungong Han Xuelong Li CLL 42 5 0 24 Jul 2024
CLIP with Generative Latent Replay: a Strong Baseline for Incremental Learning Emanuele Frascaroli Aniello Panariello Pietro Buzzega Lorenzo Bonicelli Angelo Porrello Simone Calderara VLM CLL 43 3 0 22 Jul 2024
Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning Qifan Zhang Yunhui Guo Yu Xiang CLL VLM 58 0 0 18 Jul 2024
R+X: Retrieval and Execution from Everyday Human Videos Georgios Papagiannis Norman Di Palo Pietro Vitiello Edward Johns 64 16 0 17 Jul 2024
HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning Liyuan Wang Jingyi Xie Xingxing Zhang Hang Su Jun Zhu CLL 47 5 0 07 Jul 2024
Learning System Dynamics without Forgetting Xikun Zhang Dongjin Song Yushan Jiang Yixin Chen Dacheng Tao AI4CE 42 2 0 30 Jun 2024
Lifelong Robot Library Learning: Bootstrapping Composable and Generalizable Skills for Embodied Control with Language Models Georgios Tziafas H. Kasaei KELM LM&Ro 49 8 0 26 Jun 2024
Towards Synchronous Memorizability and Generalizability with Site-Modulated Diffusion Replay for Cross-Site Continual Segmentation Dunyuan Xu Xi Wang Jingyang Zhang Pheng-Ann Heng MedIm CLL 115 0 0 26 Jun 2024
A Survey of Meta-features Used for Automated Selection of Algorithms for Black-box Single-objective Continuous Optimization Gjorgjina Cenikj Ana Nikolikj Gašper Petelin Niki van Stein Carola Doerr T. Eftimov 54 1 0 08 Jun 2024
Adversarially Diversified Rehearsal Memory (ADRM): Mitigating Memory Overfitting Challenge in Continual Learning Hikmat Khan Ghulam Rasool N. Bouaynaya AAML 28 0 0 20 May 2024
Preparing for Black Swans: The Antifragility Imperative for Machine Learning Ming Jin 40 2 0 18 May 2024
General Place Recognition Survey: Towards Real-World Autonomy Peng Yin Jianhao Jiao Shiqi Zhao Lingyun Xu Guoquan Huang Howie Choset Sebastian A. Scherer Jianda Han 52 7 0 08 May 2024
HFT: Half Fine-Tuning for Large Language Models Tingfeng Hui Zhenyu Zhang Shuohuan Wang Weiran Xu Yu Sun Hua Wu CLL 45 5 0 29 Apr 2024
Dynamically Anchored Prompting for Task-Imbalanced Continual Learning Chenxing Hong Yan Jin Zhiqi Kang Yizhou Chen Mengke Li Yang Lu Hanzi Wang 49 3 0 23 Apr 2024
From Matching to Generation: A Survey on Generative Information Retrieval Xiaoxi Li Jiajie Jin Yujia Zhou Yuyao Zhang Peitian Zhang Yutao Zhu Zhicheng Dou 3DV 84 47 0 23 Apr 2024
Brain-Inspired Continual Learning-Robust Feature Distillation and Re-Consolidation for Class Incremental Learning Hikmat Khan N. Bouaynaya Ghulam Rasool CLL 38 1 0 22 Apr 2024
Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained Computation Wenxuan Zhang Youssef Mohamed Guohao Li Philip Torr Adel Bibi Mohamed Elhoseiny CLL 52 5 0 19 Apr 2024
Hyperparameter Selection in Continual Learning Thomas L. Lee Sigrid Passano Hellan Linus Ericsson Elliot J. Crowley Amos Storkey CLL 68 0 0 09 Apr 2024
Towards Stable Machine Learning Model Retraining via Slowly Varying Sequences Dimitris Bertsimas V. Digalakis Yu Ma Phevos Paschalidis 35 0 0 28 Mar 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 48 9 0 27 Mar 2024
Confidence Self-Calibration for Multi-Label Class-Incremental Learning Kaile Du Yifan Zhou Fan Lyu Yuyang Li Chen Lu Guangcan Liu CLL 44 2 0 19 Mar 2024
PARMESAN: Parameter-Free Memory Search and Transduction for Dense Prediction Tasks Philip Matthias Winter M. Wimmer David Major Dimitrios Lenis Astrid Berg Theresa Neubauer Gaia Romana De Paolis Johannes Novotny Sophia Ulonska Katja Bühler 41 0 0 18 Mar 2024
Hyperparameters in Continual Learning: A Reality Check Sungmin Cha Kyunghyun Cho CLL 71 2 0 14 Mar 2024
DAM: Dynamic Adapter Merging for Continual Video QA Learning Feng Cheng Ziyang Wang Yi-Lin Sung Yan-Bo Lin Mohit Bansal Gedas Bertasius CLL MoMe 39 10 0 13 Mar 2024
A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends Abolfazl Younesi Mohsen Ansari Mohammadamin Fazli A. Ejlali Muhammad Shafique Joerg Henkel 3DV 52 45 0 23 Feb 2024
TinyCL: An Efficient Hardware Architecture for Continual Learning on Autonomous Systems Eugenio Ressa Alberto Marchisio Maurizio Martina Guido Masera Muhammad Shafique 48 0 0 15 Feb 2024