A Comprehensive Survey of Continual Learning: Theory, Method and Application

31 January 2023

Liyuan Wang

Xingxing Zhang

Hang Su

Jun Zhu

KELM

CLL

ArXiv PDF HTML

Papers citing "A Comprehensive Survey of Continual Learning: Theory, Method and Application"

50 / 169 papers shown

Title
Towards Urban General Intelligence: A Review and Outlook of Urban Foundation Models Weijiao Zhang Jindong Han Zhao Xu Hang Ni Hao Liu Hui Xiong Hui Xiong AI4CE 79 15 0 30 Jan 2024
Hierarchical Continual Reinforcement Learning via Large Language Model Chaofan Pan Xin Yang Hao Wang Wei Wei Tianrui Li 28 2 0 25 Jan 2024
EsaCL: Efficient Continual Learning of Sparse Models Weijieying Ren V. Honavar CLL 33 3 0 11 Jan 2024
Managing the unknown: a survey on Open Set Recognition and tangential areas Marcos Barcina-Blanco J. Lobo Pablo Garcia-Bringas Javier Del Ser VLM 36 2 0 14 Dec 2023
Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models Kyra Ahrens Hans Hergen Lehmann Jae Hee Lee Stefan Wermter CLL 35 7 0 13 Dec 2023
Continual Learning: Applications and the Road Forward Eli Verwimp Rahaf Aljundi Shai Ben-David Matthias Bethge Andrea Cossu ... Joost van de Weijer Bing Liu Vincenzo Lomonaco Tinne Tuytelaars Gido M. van de Ven CLL 48 45 0 20 Nov 2023
Towards a General Framework for Continual Learning with Pre-training Liyuan Wang Jingyi Xie Xingxing Zhang Hang Su Jun Zhu CLL 39 3 0 21 Oct 2023
A Unified Approach to Domain Incremental Learning with Memory: Theory and Algorithm Haizhou Shi Hao Wang CLL 34 19 0 18 Oct 2023
Overcoming Recency Bias of Normalization Statistics in Continual Learning: Balance and Adaptation Yilin Lyu Liyuan Wang Xingxing Zhang Zicheng Sun Hang Su Jun Zhu Liping Jing 34 8 0 13 Oct 2023
Chunking: Continual Learning is not just about Distribution Shift Thomas L. Lee Amos Storkey 30 1 0 03 Oct 2023
Elephant Neural Networks: Born to Be a Continual Learner Qingfeng Lan A. Rupam Mahmood CLL 56 9 0 02 Oct 2023
HPCR: Holistic Proxy-based Contrastive Replay for Online Continual Learning Huiwei Lin Shanshan Feng Baoquan Zhang Xutao Li Yew-Soon Ong CLL 50 0 0 26 Sep 2023
CaT: Balanced Continual Graph Learning with Graph Condensation Yilun Liu Ruihong Qiu Zi Huang DD 42 37 0 18 Sep 2023
Foundational Models Defining a New Era in Vision: A Survey and Outlook Muhammad Awais Muzammal Naseer Salman Khan Rao Muhammad Anwer Hisham Cholakkal M. Shah Ming Yang Fahad Shahbaz Khan VLM 38 119 0 25 Jul 2023
Continual Learning as Computationally Constrained Reinforcement Learning Saurabh Kumar Henrik Marklund Anand Srinivasa Rao Yifan Zhu Hong Jun Jeon Yueyang Liu Benjamin Van Roy CLL 32 22 0 10 Jul 2023
DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes Xilin Jiang Yinghao Aaron Li N. Mesgarani CLL 24 1 0 29 May 2023
The Ideal Continual Learner: An Agent That Never Forgets Liangzu Peng Paris V. Giampouras René Vidal CLL 110 26 0 29 Apr 2023
Asynchronous Federated Continual Learning Donald Shenaj Marco Toldo Alberto Rigon Pietro Zanuttigh FedML CLL 26 34 0 07 Apr 2023
Large-scale Pre-trained Models are Surprisingly Strong in Incremental Novel Class Discovery Mingxuan Liu Subhankar Roy Zhun Zhong N. Sebe Elisa Ricci CLL SSL 39 10 0 28 Mar 2023
Remind of the Past: Incremental Learning with Analogical Prompts Zhiheng Ma Xiaopeng Hong Beinan Liu Yabin Wang Pinyue Guo Huiyun Li CLL 34 1 0 24 Mar 2023
First Session Adaptation: A Strong Replay-Free Baseline for Class-Incremental Learning A. Panos Yuriko Kobe Daniel Olmeda Reino Rahaf Aljundi Richard Turner CLL 103 42 0 23 Mar 2023
Learning to Optimize for Reinforcement Learning Qingfeng Lan Rupam Mahmood Shuicheng Yan Zhongwen Xu OffRL 36 6 0 03 Feb 2023
Towards Label-Efficient Incremental Learning: A Survey Mert Kilickaya Joost van de Weijer Yuki M. Asano CLL 40 4 0 01 Feb 2023
A soft nearest-neighbor framework for continual semi-supervised learning Zhiqi Kang Enrico Fini Moin Nabi Elisa Ricci Alahari Karteek SSL BDL CLL 36 17 0 09 Dec 2022
Learning to Learn: How to Continuously Teach Humans and Machines Parantak Singh You Li Ankur Sikarwar Weixian Lei Daniel Gao Morgan B. Talbot Ying Sun Mike Zheng Shou Gabriel Kreiman Mengmi Zhang CLL 18 6 0 28 Nov 2022
Unveiling the Tapestry: the Interplay of Generalization and Forgetting in Continual Learning Zenglin Shi Jing Jie Ying Sun J. Lim Mengmi Zhang CLL 42 1 0 21 Nov 2022
Beyond Not-Forgetting: Continual Learning with Backward Knowledge Transfer Sen Lin Li Yang Deliang Fan Junshan Zhang CLL 116 43 0 01 Nov 2022
Continual Training of Language Models for Few-Shot Learning Zixuan Ke Haowei Lin Yijia Shao Hu Xu Lei Shu Bin Liu KELM BDL CLL 93 34 0 11 Oct 2022
Continual Learning by Modeling Intra-Class Variation L. Yu Tianyang Hu Lanqing Hong Zhen Liu Adrian Weller Weiyang Liu CLL 56 12 0 11 Oct 2022
Few-Shot Continual Active Learning by a Robot Ali Ayub C. Fendley CLL 40 29 0 09 Oct 2022
Long-Tailed Class Incremental Learning Xialei Liu Yu-Song Hu Xuezhi Cao Andrew D. Bagdanov Ke Li Mingg-Ming Cheng CLL 72 35 0 01 Oct 2022
A simple but strong baseline for online continual learning: Repeated Augmented Rehearsal Yaqian Zhang Bernhard Pfahringer E. Frank Albert Bifet N. Lim Yunzhe Jia CLL 104 41 0 28 Sep 2022
Disentangling Transfer in Continual Reinforcement Learning Maciej Wołczyk Michal Zajkac Razvan Pascanu Lukasz Kuciñski Piotr Milo's CLL 81 27 0 28 Sep 2022
Exploring Example Influence in Continual Learning Q. Sun Fan Lyu Fanhua Shang Wei Feng Liang Wan CLL 76 46 0 25 Sep 2022
Task-Agnostic Learning to Accomplish New Tasks Xianqi Zhang Xingtao Wang Xu Liu Wenrui Wang Xiaopeng Fan Debin Zhao OffRL 91 0 0 09 Sep 2022
Gradual Domain Adaptation via Normalizing Flows Shogo Sagawa H. Hino CLL OOD 22 10 0 23 Jun 2022
Continual Barlow Twins: continual self-supervised learning for remote sensing semantic segmentation V. Marsocci Simone Scardapane CLL 41 26 0 23 May 2022
TRGP: Trust Region Gradient Projection for Continual Learning Sen Lin Li Yang Deliang Fan Junshan Zhang CLL 78 74 0 07 Feb 2022
Architecture Matters in Continual Learning Seyed Iman Mirzadeh Arslan Chaudhry Dong Yin Timothy Nguyen Razvan Pascanu Dilan Görür Mehrdad Farajtabar OOD KELM 118 58 0 01 Feb 2022
Learning Fast, Learning Slow: A General Continual Learning Method based on Complementary Learning System Elahe Arani F. Sarfraz Bahram Zonooz CLL 93 123 0 29 Jan 2022
Continual Learning with Recursive Gradient Optimization Hao Liu Huaping Liu VLM CLL 88 36 0 29 Jan 2022
vCLIMB: A Novel Video Class Incremental Learning Benchmark Andrés Villa Kumail Alhamoud Juan Carlos León Alcázar Fabian Caba Heilbron Victor Escorcia Guohao Li CLL 74 32 0 23 Jan 2022
Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks Zixuan Ke Hu Xu Bing-Quan Liu CLL 247 83 0 06 Dec 2021
Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning Zixuan Ke Bing-Quan Liu Nianzu Ma Hu Xu Lei Shu CLL 192 122 0 05 Dec 2021
Towards Better Plasticity-Stability Trade-off in Incremental Learning: A Simple Linear Connector Guoliang Lin Hanlu Chu Hanjiang Lai MoMe CLL 34 44 0 15 Oct 2021
LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5 Chengwei Qin Chenyu You CLL 178 98 0 14 Oct 2021
FedSpeech: Federated Text-to-Speech with Continual Learning Ziyue Jiang Yi Ren Ming Lei Zhou Zhao FedML 101 24 0 14 Oct 2021
Representational Continuity for Unsupervised Continual Learning Divyam Madaan Jaehong Yoon Yuanchun Li Yunxin Liu Sung Ju Hwang CLL SSL 68 112 0 13 Oct 2021
Towards Continual Knowledge Learning of Language Models Joel Jang Seonghyeon Ye Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Stanley Jungkyu Choi Minjoon Seo CLL KELM 233 151 0 07 Oct 2021
Recent Advances of Continual Learning in Computer Vision: An Overview Haoxuan Qu Hossein Rahmani Li Xu Bryan M. Williams Jun Liu VLM CLL 30 73 0 23 Sep 2021