v1v2 (latest)

HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning

7 July 2024

Liyuan Wang

Xingxing Zhang

Papers citing "HiDe-PET: Continual Learning via Hierarchical Decomposition of Parameter-Efficient Tuning"

49 / 49 papers shown

Title
Dynamic Mixture of Progressive Parameter-Efficient Expert Library for Lifelong Robot Learning Yuheng Lei Sitong Mao Shunbo Zhou Hongyuan Zhang Xuelong Li Ping Luo CLL 39 0 0 06 Jun 2025
Scalable Strategies for Continual Learning with Replay Truman Hickok CLL 84 0 0 18 May 2025
SLCA++: Unleash the Power of Sequential Fine-tuning for Continual Learning with Pre-training Gengwei Zhang Liyuan Wang Guoliang Kang Ling Chen Yunchao Wei VLM CLL 68 7 0 15 Aug 2024
KOPPA: Improving Prompt-based Continual Learning with Key-Query Orthogonal Projection and Prototype-based One-Versus-All Quyen Tran Lam C. Tran Khoat Than Toan M. Tran Dinh Q. Phung Trung Le VLM 82 6 0 26 Nov 2023
Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality Liyuan Wang Jingyi Xie Xingxing Zhang Mingyi Huang Hang Su Jun Zhu CLL 95 93 0 11 Oct 2023
Incorporating Neuro-Inspired Adaptability for Continual Learning in Artificial Intelligence Liyuan Wang Xingxing Zhang Qian Li Mingtian Zhang Hang Su Jun Zhu Yi Zhong 95 57 0 29 Aug 2023
When Prompt-based Incremental Learning Does Not Meet Strong Pretraining Yuyao Tang Yifan Peng Weiwen Zheng CLL VLM 101 34 0 21 Aug 2023
RanPAC: Random Projections and Pre-trained Models for Continual Learning Mark D Mcdonnell Dong Gong Amin Parvaneh Ehsan Abbasnejad Anton Van Den Hengel VLM CLL 120 112 0 05 Jul 2023
Improving Visual Prompt Tuning for Self-supervised Vision Transformers S. Yoo Eunji Kim Dahuin Jung Jungbeom Lee Sung-Hoon Yoon VLM 128 43 0 08 Jun 2023
DINOv2: Learning Robust Visual Features without Supervision Maxime Oquab Timothée Darcet Théo Moutakanni Huy Q. Vo Marc Szafraniec ... Hervé Jégou Julien Mairal Patrick Labatut Armand Joulin Piotr Bojanowski VLM CLIP SSL 448 3,529 0 14 Apr 2023
First Session Adaptation: A Strong Replay-Free Baseline for Class-Incremental Learning A. Panos Yuriko Kobe Daniel Olmeda Reino Rahaf Aljundi Richard Turner CLL 163 43 0 23 Mar 2023
A Unified Continual Learning Framework with General Parameter-Efficient Tuning Qiankun Gao Chen Zhao Yifan Sun Teng Xi Gang Zhang Guohao Li Shuai Liu CLL 123 98 0 17 Mar 2023
SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Model Gengwei Zhang Liyuan Wang Guoliang Kang Ling-Hao Chen Yunchao Wei CLL 88 119 0 09 Mar 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 236 712 0 31 Jan 2023
CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learning James Smith Leonid Karlinsky V. Gutta Paola Cascante-Bonilla Donghyun Kim Assaf Arbelle Yikang Shen Rogerio Feris Z. Kira CLL VPVLM VLM 106 299 0 23 Nov 2022
A Theoretical Study on Solving Continual Learning Gyuhak Kim Changnan Xiao Tatsuya Konishi Zixuan Ke Bin Liu CLL 86 78 0 04 Nov 2022
A Multi-Head Model for Continual Learning via Out-of-Distribution Replay Gyuhak Kim Zixuan Ke Bin Liu VLM CLL OODD 73 31 0 20 Aug 2022
S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learning Yabin Wang Zhiwu Huang Xiaopeng Hong CLL VLM 128 226 0 26 Jul 2022
CoSCL: Cooperation of Small Continual Learners is Stronger than a Big One Liyuan Wang Xingxing Zhang Qian Li Jun Zhu Yi Zhong CLL 81 49 0 13 Jul 2022
Out-of-Distribution Detection with Deep Nearest Neighbors Yiyou Sun Yifei Ming Xiaojin Zhu Yixuan Li OODD 216 534 0 13 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 132 504 0 10 Apr 2022
Memory Replay with Data Compression for Continual Learning Liyuan Wang Xingxing Zhang Kuo Yang L. Yu Chongxuan Li Lanqing Hong Shifeng Zhang Zhenguo Li Yi Zhong Jun Zhu 92 104 0 14 Feb 2022
An Empirical Investigation of the Role of Pre-training in Lifelong Learning Sanket Vaibhav Mehta Darshan Patil Sarath Chandar Emma Strubell CLL 148 145 0 16 Dec 2021
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 107 799 0 16 Dec 2021
AFEC: Active Forgetting of Negative Transfer in Continual Learning John Giorgi Mingtian Zhang Zhongfan Jia Qian Li Chenglong Bao Kaisheng Ma Jun Zhu Yi Zhong CLL 75 85 0 23 Oct 2021
Generalized Out-of-Distribution Detection: A Survey Jingkang Yang Kaiyang Zhou Yixuan Li Ziwei Liu 309 950 0 21 Oct 2021
Towards a Unified View of Parameter-Efficient Transfer Learning Junxian He Chunting Zhou Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig AAML 170 958 0 08 Oct 2021
Co $^2$ L: Contrastive Continual Learning Hyuntak Cha Jaeho Lee Jinwoo Shin CLL SSL VLM 141 309 0 28 Jun 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 624 10,625 0 17 Jun 2021
ImageNet-21K Pretraining for the Masses T. Ridnik Emanuel Ben-Baruch Asaf Noy Lihi Zelnik-Manor SSeg VLM CLIP 345 717 0 22 Apr 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 674 4,119 0 18 Apr 2021
Gradient Projection Memory for Continual Learning Gobinda Saha Isha Garg Kaushik Roy VLM CLL 89 292 0 17 Mar 2021
Training Networks in Null Space of Feature Covariance for Continual Learning Shipeng Wang Xiaorong Li Jian Sun Zongben Xu CLL 101 144 0 12 Mar 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li Percy Liang 254 4,328 0 01 Jan 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 734 41,796 0 22 Oct 2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization Dan Hendrycks Steven Basart Norman Mu Saurav Kadavath Frank Wang ... Samyak Parajuli Mike Guo Basel Alomair Jacob Steinhardt Justin Gilmer OOD 390 1,760 0 29 Jun 2020
Optimal Continual Learning has Perfect Memory and is NP-hard Jeremias Knoblauch Hisham Husain Tom Diethe CLL 140 105 0 09 Jun 2020
Triple Memory Networks: a Brain-Inspired Method for Continual Learning Liyuan Wang Bo Lei Qian Li Hang Su Jun Zhu Yi Zhong AAML 72 43 0 06 Mar 2020
Three scenarios for continual learning Gido M. van de Ven A. Tolias CLL 104 897 0 15 Apr 2019
Continual Lifelong Learning with Neural Networks: A Review G. I. Parisi Ronald Kemker Jose L. Part Christopher Kanan S. Wermter KELM CLL 266 2,911 0 21 Feb 2018
Overcoming catastrophic forgetting with hard attention to the task Joan Serrà Dídac Surís M. Miron Alexandros Karatzoglou CLL 152 1,086 0 04 Jan 2018
Memory Aware Synapses: Learning what (not) to forget Rahaf Aljundi F. Babiloni Mohamed Elhoseiny Marcus Rohrbach Tinne Tuytelaars KELM CLL 90 1,654 0 27 Nov 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 155 2,748 0 26 Jun 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 936 133,201 0 12 Jun 2017
Continual Learning with Deep Generative Replay Hanul Shin Jung Kwon Lee Jaehong Kim Jiwon Kim KELM CLL 91 2,092 0 24 May 2017
Learning multiple visual domains with residual adapters Sylvestre-Alvise Rebuffi Hakan Bilen Andrea Vedaldi OOD 205 941 0 22 May 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 381 7,616 0 02 Dec 2016
iCaRL: Incremental Classifier and Representation Learning Sylvestre-Alvise Rebuffi Alexander Kolesnikov G. Sperl Christoph H. Lampert CLL OOD 205 3,792 0 23 Nov 2016
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 163 2,277 0 21 Jun 2013