Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning

5 December 2021

Papers citing "Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning"

50 / 72 papers shown

Title
Parameter-Efficient Continual Fine-Tuning: A Survey Eric Nuertey Coleman Luigi Quarantiello Ziyue Liu Qinwen Yang Samrat Mukherjee J. Hurtado Vincenzo Lomonaco CLL 29 0 0 18 Apr 2025
Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generation Yifan Feng Hao Hu Xingliang Hou Shiquan Liu Shihui Ying S. Du Han Hu Yue Gao 37 0 0 30 Mar 2025
Merge then Realign: Simple and Effective Modality-Incremental Continual Learning for Multimodal LLMs Dingkun Zhang Shuhan Qi Xinyu Xiao Kehai Chen Xuan Wang CLL MoMe 61 0 0 08 Mar 2025
Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping Guannan Lai Yujie Li Xiangkun Wang J. Zhang Tianrui Li Xin Yang CLL 44 0 0 27 Feb 2025
Recurrent Knowledge Identification and Fusion for Language Model Continual Learning Yujie Feng Xujia Wang Zexin Lu Shenghong Fu Guangyuan Shi Yongxin Xu Yasha Wang Philip S. Yu Xu Chu Xiao-Ming Wu CLL KELM 41 1 0 22 Feb 2025
Achieving Upper Bound Accuracy of Joint Training in Continual Learning Saleh Momeni Bing Liu CLL 84 1 0 17 Feb 2025
Continual Learning Using a Kernel-Based Method Over Foundation Models Saleh Momeni Sahisnu Mazumder Bing-Quan Liu CLL 67 1 0 20 Dec 2024
In-context Continual Learning Assisted by an External Continual Learner Saleh Momeni Sahisnu Mazumder Zixuan Ke Bing Liu CLL 88 0 0 20 Dec 2024
Continual Task Learning through Adaptive Policy Self-Composition Shengchao Hu Yuhang Zhou Ziqing Fan Jifeng Hu Li Shen Ya-Qin Zhang Dacheng Tao OffRL 69 0 0 18 Nov 2024
Delta: A Cloud-assisted Data Enrichment Framework for On-Device Continual Learning Chen Gong Zhenzhe Zheng Fan Wu Xiaofeng Jia Guihai Chen LMTD FedML 34 2 0 24 Oct 2024
Does RoBERTa Perform Better than BERT in Continual Learning: An Attention Sink Perspective Xueying Bai Yifan Sun Niranjan Balasubramanian CLL 24 0 0 08 Oct 2024
TaSL: Continual Dialog State Tracking via Task Skill Localization and Consolidation Yujie Feng Xu Chu Yongxin Xu Guangyuan Shi Bo Liu Xiao-Ming Wu MoMe CLL 32 7 0 19 Aug 2024
Mitigate Negative Transfer with Similarity Heuristic Lifelong Prompt Tuning Chenyuan Wu Gangwei Jiang Defu Lian CLL 23 0 0 18 Jun 2024
Towards Lifelong Learning of Large Language Models: A Survey Junhao Zheng Shengjie Qiu Chengming Shi Qianli Ma KELM CLL 30 14 0 10 Jun 2024
Harnessing Neural Unit Dynamics for Effective and Scalable Class-Incremental Learning Depeng Li Tianqi Wang Junwei Chen Wei Dai Zhigang Zeng CLL 38 1 0 04 Jun 2024
Parameterizing Federated Continual Learning for Reproducible Research Bart Cox Jeroen Galjaard Aditya Shankar Jérémie Decouchant Lydia Y. Chen FedML 43 0 0 04 Jun 2024
Bridging Neuroscience and AI: Environmental Enrichment as a Model for Forward Knowledge Transfer Rajat Saxena Bruce L. McNaughton CLL 53 2 0 12 May 2024
Boosting Large Language Models with Continual Learning for Aspect-based Sentiment Analysis Xuanwen Ding Jie Zhou Liang Dou Qin Chen Yuanbin Wu Chengcai Chen Liang He KELM CLL 37 5 0 09 May 2024
A Closer Look at Classification Evaluation Metrics and a Critical Reflection of Common Evaluation Practice Juri Opitz 14 16 0 25 Apr 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 46 63 0 25 Apr 2024
Q-Tuning: Queue-based Prompt Tuning for Lifelong Few-shot Language Learning Yanhui Guo Shaoyuan Xu Jinmiao Fu Jia-Wei Liu Chaosheng Dong Bryan Wang VLM CLL 33 5 0 22 Apr 2024
Continual Learning of Range-Dependent Transmission Loss for Underwater Acoustic using Conditional Convolutional Neural Net Indu Kant Deo Akash Venkateshwaran R. Jaiman AI4CE 33 3 0 11 Apr 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 42 8 0 27 Mar 2024
InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions Yifan Wang Yafei Liu Chufan Shi Haoling Li Chen Chen H. Lu Yujiu Yang CLL 39 25 0 18 Mar 2024
HOP to the Next Tasks and Domains for Continual Learning in NLP Umberto Michieli Mete Ozay VLM 33 2 0 28 Feb 2024
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? Marco Gaido Sara Papi Matteo Negri L. Bentivogli 41 12 0 19 Feb 2024
Into the Unknown: Self-Learning Large Language Models Teddy Ferdinan Jan Kocoñ P. Kazienko 30 2 0 14 Feb 2024
EdgeOL: Efficient in-situ Online Learning on Edge Devices Sheng R. Li Geng Yuan Yawen Wu Yuezhen Dai Chao Wu Alex K. Jones Jingtong Hu Yanzhi Wang Xulong Tang 33 1 0 30 Jan 2024
Dynamic Transformer Architecture for Continual Learning of Multimodal Tasks Yuliang Cai Mohammad Rostami 33 4 0 27 Jan 2024
Towards Continual Learning Desiderata via HSIC-Bottleneck Orthogonalization and Equiangular Embedding Depeng Li Tianqi Wang Junwei Chen Qining Ren Kenji Kawaguchi Zhigang Zeng CLL 43 6 0 17 Jan 2024
Federated Continual Learning via Knowledge Fusion: A Survey Xin Yang Hao Yu Xin Gao Hao Wang Junbo Zhang Tianrui Li FedML 30 31 0 27 Dec 2023
Continual Learning through Networks Splitting and Merging with Dreaming-Meta-Weighted Model Fusion Yi Sun Xin Xu Jian Li Guanglei Xie Yifei Shi Qiang Fang CLL MoMe 26 1 0 12 Dec 2023
Continual Learning: Applications and the Road Forward Eli Verwimp Rahaf Aljundi Shai Ben-David Matthias Bethge Andrea Cossu ... J. Weijer Bing Liu Vincenzo Lomonaco Tinne Tuytelaars Gido M. van de Ven CLL 40 44 0 20 Nov 2023
Visually Grounded Continual Language Learning with Selective Specialization Kyra Ahrens Lennart Bengtson Jae Hee Lee Stefan Wermter 19 0 0 24 Oct 2023
CITB: A Benchmark for Continual Instruction Tuning Zihan Zhang Meng Fang Ling-Hao Chen Mohammad-Reza Namazi-Rad ALM CLL 44 23 0 23 Oct 2023
Lifelong Sequence Generation with Dynamic Module Expansion and Adaptation Chengwei Qin Junwon Lee Shafiq R. Joty CLL 43 12 0 15 Oct 2023
Diversifying the Mixture-of-Experts Representation for Language Models with Orthogonal Optimizer Boan Liu Liang Ding Li Shen Keqin Peng Yu Cao Dazhao Cheng Dacheng Tao MoE 36 7 0 15 Oct 2023
Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks Zixuan Ke Bing Liu Wenhan Xiong Asli Celikyilmaz Haoran Li CLL 32 5 0 13 Oct 2023
Modularity in Deep Learning: A Survey Haozhe Sun Isabelle Guyon MoMe 30 2 0 02 Oct 2023
Class Incremental Learning via Likelihood Ratio Based Task Prediction Haowei Lin Yijia Shao W. Qian Ningxin Pan Yiduo Guo Bing-Quan Liu CLL 31 13 0 26 Sep 2023
Continual Learning with Dirichlet Generative-based Rehearsal Min Zeng Wei Xue Qi-fei Liu Yi-Ting Guo CLL BDL 24 5 0 13 Sep 2023
Challenges and Opportunities of Using Transformer-Based Multi-Task Learning in NLP Through ML Lifecycle: A Survey Lovre Torbarina Tin Ferkovic Lukasz Roguski Velimir Mihelčić Bruno Šarlija Z. Kraljevic 19 5 0 16 Aug 2023
A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning Zhenyi Wang Enneng Yang Li Shen Heng-Chiao Huang KELM MU 31 47 0 16 Jul 2023
Domain-Agnostic Neural Architecture for Class Incremental Continual Learning in Document Processing Platform Mateusz Wójcik Witold Ko'sciukiewicz Mateusz Baran Tomasz Kajdanowicz Adam Gonczarek CLL 17 1 0 11 Jul 2023
Learnability and Algorithm for Continual Learning Gyuhak Kim Changnan Xiao Tatsuya Konishi Bin Liu CLL 37 24 0 22 Jun 2023
Complementary Learning Subnetworks for Parameter-Efficient Class-Incremental Learning Depeng Li Zhigang Zeng CLL 25 1 0 21 Jun 2023
Context selectivity with dynamic availability enables lifelong continual learning M. Barry W. Gerstner G. Bellec CLL 11 0 0 02 Jun 2023
Continual Task Allocation in Meta-Policy Network via Sparse Prompting Yijun Yang Tianyi Zhou Jing Jiang Guodong Long Yuhui Shi CLL OffRL 36 9 0 29 May 2023
Teamwork Is Not Always Good: An Empirical Study of Classifier Drift in Class-incremental Information Extraction Minqian Liu Lifu Huang CLL 15 9 0 26 May 2023
Active Continual Learning: On Balancing Knowledge Retention and Learnability Thuy-Trang Vu Shahram Khadivi Mahsa Ghorbanali Dinh Q. Phung Gholamreza Haffari CLL 11 3 0 06 May 2023