Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need

13 March 2023

Da-Wei Zhou

Han-Jia Ye

De-Chuan Zhan

Ziwei Liu

CLL

ArXiv (abs)PDF HTML

Papers citing "Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need"

50 / 85 papers shown

Title
Replay to Remember (R2R): An Efficient Uncertainty-driven Unsupervised Continual Learning Framework Using Generative Replay Sriram Mandalika Harsha Vardhan Athira Nambiar VLM 205 0 0 07 May 2025
DUKAE: DUal-level Knowledge Accumulation and Ensemble for Pre-Trained Model-Based Continual Learning Songze Li Tonghua Su Xu-Yao Zhang Qixing Xu Zhongjie Wang CLL 162 0 0 09 Apr 2025
ProtoGuard-guided PROPEL: Class-Aware Prototype Enhancement and Progressive Labeling for Incremental 3D Point Cloud Segmentation Haoyang Li Yuecong Xu Junjie Chen Kemi Ding 3DPC CLL 123 0 0 02 Apr 2025
Feature Calibration enhanced Parameter Synthesis for CLIP-based Class-incremental Learning Jiaxin Guo Xiaoguang Zhu Xiaoguang Zhu Lianlong Sun Liangyu Teng Yang Liu Di Li Wei Zhou Liang Song CLL VLM 129 1 0 24 Mar 2025
FeNeC: Enhancing Continual Learning via Feature Clustering with Neighbor- or Logit-Based Classification Kamil Książek Hubert Jastrzębski Bartosz Trojan Krzysztof Pniaczek Michał Karp Jacek Tabor CLL 232 0 0 18 Mar 2025
CLDyB: Towards Dynamic Benchmarking for Continual Learning with Pre-trained Models Shengzhuang Chen Yikai Liao Xiaoxiao Sun Kede Ma Ying Wei 120 0 0 06 Mar 2025
IncSAR: A Dual Fusion Incremental Learning Framework for SAR Target Recognition George Karantaidis Athanasios Pantsios Y. Kompatsiaris Symeon Papadopoulos CLL 142 2 0 20 Jan 2025
Integrating Dual Prototypes for Task-Wise Adaption in Pre-Trained Model-Based Class-Incremental Learning Zhiming Xu Steve Yang Baile Xu Jian Zhao Furao Shen CLL 189 0 0 26 Nov 2024
Dual Consolidation for Pre-Trained Model-Based Domain-Incremental Learning Da-Wei Zhou Zi-Wen Cai Han-Jia Ye Lijun Zhang De-Chuan Zhan CLL AI4CE 194 2 0 01 Oct 2024
Mixture of Experts Meets Prompt-Based Continual Learning Minh Le An Nguyen Huy Nguyen Trang Nguyen Trang Pham L. Ngo Nhat Ho CLL 118 14 0 23 May 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 115 11 0 27 Mar 2024
Hyperparameters in Continual Learning: A Reality Check Sungmin Cha Kyunghyun Cho CLL 128 6 0 14 Mar 2024
PILOT: A Pre-Trained Model-Based Continual Learning Toolbox Hai-Long Sun Da-Wei Zhou Han-Jia Ye De-Chuan Zhan CLL 194 34 0 13 Sep 2023
Heterogeneous Forgetting Compensation for Class-Incremental Learning Jiahua Dong Wenqi Liang Yang Cong Gan Sun CLL 94 21 0 07 Aug 2023
Learning without Forgetting for Vision-Language Models Da-Wei Zhou Yuanhan Zhang Jingyi Ning Jingyi Ning De-Chuan Zhan De-Chuan Zhan Ziwei Liu VLM CLL 134 44 0 30 May 2023
Preserving Locality in Vision Transformers for Class Incremental Learning Bowen Zheng Da-Wei Zhou Han-Jia Ye De-Chuan Zhan CLL 69 5 0 14 Apr 2023
Steering Prototypes with Prompt-tuning for Rehearsal-free Continual Learning Zhuowei Li Long Zhao Zizhao Zhang Han Zhang Diya Liu Ting Liu Dimitris N. Metaxas CLL VLM 95 21 0 16 Mar 2023
PIVOT: Prompting for Video Continual Learning Andrés Villa Juan Carlos León Alcázar Motasem Alfarra Kumail Alhamoud J. Hurtado Fabian Caba Heilbron Alvaro Soto Guohao Li VLM CLL 118 46 0 09 Dec 2022
FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformer Shibo Jie Zhi-Hong Deng 74 136 0 06 Dec 2022
Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning Dongze Lian Daquan Zhou Jiashi Feng Xinchao Wang 93 263 0 17 Oct 2022
MaPLe: Multi-modal Prompt Learning Muhammad Uzair Khattak H. Rasheed Muhammad Maaz Salman Khan Fahad Shahbaz Khan VPVLM VLM 273 569 0 06 Oct 2022
FETA: Towards Specializing Foundation Models for Expert Task Applications Amit Alfassy Assaf Arbelle Oshri Halimi Sivan Harary Roei Herzig ... Christoph Auer Kate Saenko Peter W. J. Staar Rogerio Feris Leonid Karlinsky 67 19 0 08 Sep 2022
S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learning Yabin Wang Zhiwu Huang Xiaopeng Hong CLL VLM 120 223 0 26 Jul 2022
Class-incremental Novel Class Discovery Subhankar Roy Mingxuan Liu Zhun Zhong N. Sebe Elisa Ricci CLL 71 45 0 18 Jul 2022
Benchmarking Omni-Vision Representation through the Lens of Visual Realms Yuanhan Zhang Zhen-fei Yin Jing Shao Ziwei Liu VLM 104 29 0 14 Jul 2022
Neural Prompt Search Yuanhan Zhang Kaiyang Zhou Ziwei Liu VPVLM VLM 106 152 0 09 Jun 2022
A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learning Da-Wei Zhou Qiwen Wang Han-Jia Ye De-Chuan Zhan 76 138 0 26 May 2022
CoCa: Contrastive Captioners are Image-Text Foundation Models Jiahui Yu Zirui Wang Vijay Vasudevan Legg Yeung Mojtaba Seyedhosseini Yonghui Wu VLM CLIP OffRL 186 1,309 0 04 May 2022
Data Determines Distributional Robustness in Contrastive Language Image Pre-training (CLIP) Alex Fang Gabriel Ilharco Mitchell Wortsman Yu Wan Vaishaal Shankar Achal Dave Ludwig Schmidt VLM OOD 104 146 0 03 May 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 128 502 0 10 Apr 2022
R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learning Qiankun Gao Chen Zhao Guohao Li Jian Zhang CLL 63 70 0 24 Mar 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 173 1,647 0 23 Mar 2022
Federated Class-Incremental Learning Jiahua Dong Lixu Wang Zhen Fang Gan Sun Shichao Xu Tianlin Li Qi Zhu CLL FedML 111 183 0 22 Mar 2022
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution Ananya Kumar Aditi Raghunathan Robbie Jones Tengyu Ma Percy Liang OODD 132 685 0 21 Feb 2022
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 105 796 0 16 Dec 2021
Incremental Learning in Semantic Segmentation from Image Labels Fabio Cermelli Dario Fontanel A. Tavera Marco Ciccone Barbara Caputo VLM CLL 82 49 0 03 Dec 2021
ReAct: Out-of-distribution Detection With Rectified Activations Yiyou Sun Chuan Guo Yixuan Li OODD 115 485 0 24 Nov 2021
Florence: A New Foundation Model for Computer Vision Lu Yuan Dongdong Chen Yi-Ling Chen Noel Codella Xiyang Dai ... Zhen Xiao Jianwei Yang Michael Zeng Luowei Zhou Pengchuan Zhang VLM 147 908 0 22 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 485 7,837 0 11 Nov 2021
Towards a Unified View of Parameter-Efficient Transfer Learning Junxian He Chunting Zhou Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig AAML 146 954 0 08 Oct 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 513 2,422 0 02 Sep 2021
Co-Transport for Class-Incremental Learning Da-Wei Zhou Han-Jia Ye De-Chuan Zhan CLL 112 75 0 27 Jul 2021
Neighborhood Contrastive Learning for Novel Class Discovery Zhun Zhong Enrico Fini Subhankar Roy Zhiming Luo Elisa Ricci N. Sebe 85 149 0 20 Jun 2021
How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers Andreas Steiner Alexander Kolesnikov Xiaohua Zhai Ross Wightman Jakob Uszkoreit Lucas Beyer ViT 131 637 0 18 Jun 2021
BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models Elad Ben-Zaken Shauli Ravfogel Yoav Goldberg 202 1,244 0 18 Jun 2021
Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learning James Smith Yen-Chang Hsu John C. Balloch Yilin Shen Hongxia Jin Z. Kira CLL 106 168 0 17 Jun 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 511 10,563 0 17 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 155 858 0 14 Jun 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 743 6,139 0 29 Apr 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 328 714 0 22 Apr 2021