Continual Learning of Natural Language Processing Tasks: A Survey

23 November 2022

Papers citing "Continual Learning of Natural Language Processing Tasks: A Survey"

50 / 50 papers shown

Title
SEFE: Superficial and Essential Forgetting Eliminator for Multimodal Continual Instruction Tuning Jinpeng Chen Runmin Cong Yuzhi Zhao Hongzheng Yang Guangneng Hu H. Ip Sam Kwong CLL KELM 83 0 0 05 May 2025
Achieving Upper Bound Accuracy of Joint Training in Continual Learning Saleh Momeni Bing Liu CLL 84 1 0 17 Feb 2025
In-context Continual Learning Assisted by an External Continual Learner Saleh Momeni Sahisnu Mazumder Zixuan Ke Bing Liu CLL 93 0 0 20 Dec 2024
SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models Jinghan He Haiyun Guo Kuan Zhu Zihan Zhao Ming Tang J. T. Wang KELM 28 1 0 09 Nov 2024
O-Edit: Orthogonal Subspace Editing for Language Model Sequential Editing Yuchen Cai Ding Cao KELM 21 2 0 15 Oct 2024
Recent Advances of Multimodal Continual Learning: A Comprehensive Survey Dianzhi Yu Xinni Zhang Yankai Chen Aiwei Liu Yifei Zhang Philip S. Yu Irwin King VLM CLL 44 9 0 07 Oct 2024
TaSL: Continual Dialog State Tracking via Task Skill Localization and Consolidation Yujie Feng Xu Chu Yongxin Xu Guangyuan Shi Bo Liu Xiao-Ming Wu MoMe CLL 37 7 0 19 Aug 2024
Continual Learning for Temporal-Sensitive Question Answering Wanqi Yang Yunqiu Xu Yanda Li Kunze Wang Binbin Huang Ling-Hao Chen CLL 29 3 0 17 Jul 2024
Towards Understanding Multi-Task Learning (Generalization) of LLMs via Detecting and Exploring Task-Specific Neurons Yongqi Leng Deyi Xiong 39 5 0 09 Jul 2024
Unlocking Continual Learning Abilities in Language Models Wenyu Du Shuang Cheng Tongxu Luo Zihan Qiu Zeyu Huang Ka Chun Cheung Reynold Cheng Jie Fu KELM CLL 45 6 0 25 Jun 2024
ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Tasks Santosh T.Y.S.S Tuan-Quang Vuong Matthias Grabmair AILaw CLL 53 4 0 23 May 2024
Dynamic Feature Learning and Matching for Class-Incremental Learning Sunyuan Qiang Yanyan Liang Jun Wan Du Zhang CLL 38 3 0 14 May 2024
Learning To See But Forgetting To Follow: Visual Instruction Tuning Makes LLMs More Prone To Jailbreak Attacks Georgios Pantazopoulos Amit Parekh Malvina Nikandrou Alessandro Suglia 32 5 0 07 May 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 46 63 0 25 Apr 2024
From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language Models Qi He Jie Zeng Qianxi He Jiaqing Liang Yanghua Xiao 32 10 0 24 Apr 2024
Continual Learning for Smart City: A Survey Li Yang Zhipeng Luo Shi-sheng Zhang Fei Teng Tian-Jie Li HAI 30 8 0 01 Apr 2024
Rehearsal-Free Modular and Compositional Continual Learning for Language Models Mingyang Wang Heike Adel Lukas Lange Jannik Strötgen Hinrich Schütze KELM CLL 32 14 0 31 Mar 2024
InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions Yifan Wang Yafei Liu Chufan Shi Haoling Li Chen Chen H. Lu Yujiu Yang CLL 39 25 0 18 Mar 2024
Laying the Foundation First? Investigating the Generalization from Atomic Skills to Complex Reasoning Tasks Yuncheng Huang Qi He Yipei Xu Jiaqing Liang Yanghua Xiao LRM 41 1 0 14 Mar 2024
HOP to the Next Tasks and Domains for Continual Learning in NLP Umberto Michieli Mete Ozay VLM 36 2 0 28 Feb 2024
Can Similarity-Based Domain-Ordering Reduce Catastrophic Forgetting for Intent Recognition? Amogh Mannekote Xiaoyi Tian K. Boyer Bonnie J. Dorr CLL 33 1 0 21 Feb 2024
Structural Knowledge Informed Continual Multivariate Time Series Forecasting Zijie Pan Yushan Jiang Dongjin Song Sahil Garg Kashif Rasul Anderson Schneider Yuriy Nevmyvaka CLL AI4TS 40 3 0 20 Feb 2024
Class-incremental Learning for Time Series: Benchmark and Evaluation Zhongzheng Qiao Quang-Cuong Pham Zhen Cao Hoang H Le Ponnuthurai Nagaratnam Suganthan Xudong Jiang Savitha Ramasamy 40 10 0 19 Feb 2024
SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models Weixiang Zhao Shilong Wang Yulin Hu Yanyan Zhao Bing Qin Xuanyu Zhang Qing Yang Dongliang Xu Wanxiang Che KELM CLL 29 11 0 16 Jan 2024
Federated Continual Learning via Knowledge Fusion: A Survey Xin Yang Hao Yu Xin Gao Hao Wang Junbo Zhang Tianrui Li FedML 33 31 0 27 Dec 2023
Continual Learning Under Language Shift Evangelia Gogoulou Timothée Lesort Magnus Boman Joakim Nivre KELM CLL 27 3 0 02 Nov 2023
CL-MASR: A Continual Learning Benchmark for Multilingual ASR Luca Della Libera Pooneh Mousavi Salah Zaiem Cem Subakan Mirco Ravanelli AuLLM CLL 40 13 0 25 Oct 2023
Failures Pave the Way: Enhancing Large Language Models through Tuning-free Rule Accumulation Zeyuan Yang Peng Li Yang Liu LRM 30 21 0 24 Oct 2023
CITB: A Benchmark for Continual Instruction Tuning Zihan Zhang Meng Fang Ling-Hao Chen Mohammad-Reza Namazi-Rad ALM CLL 44 23 0 23 Oct 2023
Orthogonal Subspace Learning for Language Model Continual Learning Xiao Wang Tianze Chen Qiming Ge Han Xia Rong Bao Rui Zheng Qi Zhang Tao Gui Xuanjing Huang CLL 119 89 0 22 Oct 2023
Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks Zixuan Ke Bing Liu Wenhan Xiong Asli Celikyilmaz Haoran Li CLL 32 5 0 13 Oct 2023
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances Zihan Zhang Meng Fang Lingxi Chen Mohammad-Reza Namazi-Rad Jun Wang KELM 21 21 0 11 Oct 2023
Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality Liyuan Wang Jingyi Xie Xingxing Zhang Mingyi Huang Hang Su Jun Zhu CLL 22 79 0 11 Oct 2023
TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models Xiao Wang Yuan Zhang Tianze Chen Songyang Gao Senjie Jin ... Rui Zheng Yicheng Zou Tao Gui Qi Zhang Xuanjing Huang ALM LRM CLL 54 18 0 10 Oct 2023
Class Incremental Learning via Likelihood Ratio Based Task Prediction Haowei Lin Yijia Shao W. Qian Ningxin Pan Yiduo Guo Bing-Quan Liu CLL 31 13 0 26 Sep 2023
GRASP: A Rehearsal Policy for Efficient Online Continual Learning Md Yousuf Harun Jhair Gallardo Junyu Chen Christopher Kanan CLL 36 9 0 25 Aug 2023
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning Yun Luo Zhen Yang Fandong Meng Yafu Li Jie Zhou Yue Zhang CLL KELM 32 276 0 17 Aug 2023
Challenges and Opportunities of Using Transformer-Based Multi-Task Learning in NLP Through ML Lifecycle: A Survey Lovre Torbarina Tin Ferkovic Lukasz Roguski Velimir Mihelčić Bruno Šarlija Z. Kraljevic 21 5 0 16 Aug 2023
Mitigating Catastrophic Forgetting in Task-Incremental Continual Learning with Adaptive Classification Criterion Yun Luo Xiaotian Lin Zhen Yang Fandong Meng Jie Zhou Yue Zhang CLL 24 5 0 20 May 2023
Investigating Forgetting in Pre-Trained Representations Through Continual Learning Yun Luo Zhen Yang Xuefeng Bai Fandong Meng Jie Zhou Yue Zhang CLL KELM 22 16 0 10 May 2023
SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Model Gengwei Zhang Liyuan Wang Guoliang Kang Ling-Hao Chen Yunchao Wei CLL 26 106 0 09 Mar 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 38 601 0 31 Jan 2023
Beyond Not-Forgetting: Continual Learning with Backward Knowledge Transfer Sen Lin Li Yang Deliang Fan Junshan Zhang CLL 111 42 0 01 Nov 2022
Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue Ying Zhao Yinhe Zheng Zhiliang Tian Chang Gao Yu Bowen Haiyang Yu Yongbin Li Jianguo Sun N. Zhang CLL OffRL 26 12 0 14 Oct 2022
Continual Training of Language Models for Few-Shot Learning Zixuan Ke Haowei Lin Yijia Shao Hu Xu Lei Shu Bin Liu KELM BDL CLL 87 34 0 11 Oct 2022
TRGP: Trust Region Gradient Projection for Continual Learning Sen Lin Li Yang Deliang Fan Junshan Zhang CLL 78 73 0 07 Feb 2022
Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks Zixuan Ke Hu Xu Bing-Quan Liu CLL 240 83 0 06 Dec 2021
Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning Zixuan Ke Bing-Quan Liu Nianzu Ma Hu Xu Lei Shu CLL 189 122 0 05 Dec 2021
LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5 Chengwei Qin Shafiq R. Joty CLL 178 98 0 14 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,848 0 18 Apr 2021