Rehearsal-Free Modular and Compositional Continual Learning for Language
Models

Rehearsal-Free Modular and Compositional Continual Learning for Language Models

31 March 2024

Jannik Strötgen

Hinrich Schütze

Papers citing "Rehearsal-Free Modular and Compositional Continual Learning for Language Models"

11 / 11 papers shown

Title
Recurrent Knowledge Identification and Fusion for Language Model Continual Learning Yujie Feng Xujia Wang Zexin Lu Shenghong Fu Guangyuan Shi Yongxin Xu Yasha Wang Philip S. Yu Xu Chu Xiao-Ming Wu CLL KELM 41 1 0 22 Feb 2025
Achieving Upper Bound Accuracy of Joint Training in Continual Learning Saleh Momeni Bing Liu CLL 86 1 0 17 Feb 2025
In-context Continual Learning Assisted by an External Continual Learner Saleh Momeni Sahisnu Mazumder Zixuan Ke Bing Liu CLL 96 0 0 20 Dec 2024
ModalPrompt:Dual-Modality Guided Prompt for Continual Learning of Large Multimodal Models Fanhu Zeng Fei Zhu Haiyang Guo Xu-Yao Zhang Cheng-Lin Liu VLM CLL 43 8 0 08 Oct 2024
Learning to Route for Dynamic Adapter Composition in Continual Learning with Language Models Vladimir Araujo Marie-Francine Moens Tinne Tuytelaars CLL MoMe 33 2 0 16 Aug 2024
Learn it or Leave it: Module Composition and Pruning for Continual Learning Mingyang Wang Heike Adel Lukas Lange Jannik Strötgen Hinrich Schütze CLL KELM 42 1 0 26 Jun 2024
Unlocking Continual Learning Abilities in Language Models Wenyu Du Shuang Cheng Tongxu Luo Zihan Qiu Zeyu Huang Ka Chun Cheung Reynold Cheng Jie Fu KELM CLL 51 7 0 25 Jun 2024
Towards Lifelong Learning of Large Language Models: A Survey Junhao Zheng Shengjie Qiu Chengming Shi Qianli Ma KELM CLL 32 15 0 10 Jun 2024
Orthogonal Subspace Learning for Language Model Continual Learning Xiao Wang Tianze Chen Qiming Ge Han Xia Rong Bao Rui Zheng Qi Zhang Tao Gui Xuanjing Huang CLL 122 90 0 22 Oct 2023
NLNDE at SemEval-2023 Task 12: Adaptive Pretraining and Source Language Selection for Low-Resource Multilingual Sentiment Analysis Mingyang Wang Heike Adel Lukas Lange Jannik Strötgen Hinrich Schütze 60 16 0 28 Apr 2023
LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5 Chengwei Qin Chenyu You CLL 178 98 0 14 Oct 2021