Continual Learning for Text Classification with Information Disentanglement Based Regularization

12 April 2021

Jiaao Chen

Diyi Yang

Papers citing "Continual Learning for Text Classification with Information Disentanglement Based Regularization"

50 / 66 papers shown

Title
Reinforced Interactive Continual Learning via Real-time Noisy Human Feedback Yutao Yang Jie Zhou Junsong Li Qianjun Pan Bihao Zhan Qin Chen Xipeng Qiu Liang He CLL 29 0 0 15 May 2025
SEE: Continual Fine-tuning with Sequential Ensemble of Experts Zhilin Wang Yafu Li Xiaoye Qu Yu Cheng CLL KELM 58 0 0 09 Apr 2025
A Survey of Text Classification Under Class Distribution Shift Adriana Valentina Costache Silviu Florin Gheorghe Eduard Poesina Paul Irofti Radu Tudor Ionescu OOD VLM 60 0 0 18 Feb 2025
Achieving Upper Bound Accuracy of Joint Training in Continual Learning Saleh Momeni Bing Liu CLL 84 1 0 17 Feb 2025
Neural Networks Remember More: The Power of Parameter Isolation and Combination Biqing Zeng Zehan Li Aladdin Ayesh CLL KELM 43 0 0 16 Feb 2025
Unlocking the Power of Function Vectors for Characterizing and Mitigating Catastrophic Forgetting in Continual Instruction Tuning Gangwei Jiang Caigao Jiang Zhaoyi Li Siqiao Xue Jun-ping Zhou Linqi Song Defu Lian Yin Wei CLL MU 63 1 0 16 Feb 2025
LSEBMCL: A Latent Space Energy-Based Model for Continual Learning Xiaodi Li Dingcheng Li Rujun Gao Mahmoud Zamani Latifur Khan CLL KELM 49 0 0 09 Jan 2025
Continual Learning Using a Kernel-Based Method Over Foundation Models Saleh Momeni Sahisnu Mazumder Bing-Quan Liu CLL 78 1 0 20 Dec 2024
In-context Continual Learning Assisted by an External Continual Learner Saleh Momeni Sahisnu Mazumder Zixuan Ke Bing Liu CLL 96 0 0 20 Dec 2024
SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery Enneng Yang Li Shen Zhenyi Wang G. Guo Xingwei Wang Xiaocun Cao Jie Zhang Dacheng Tao MoMe 37 4 0 18 Oct 2024
Self-Data Distillation for Recovering Quality in Pruned Large Language Models Vithursan Thangarasa Ganesh Venkatesh Mike Lasby Nish Sinnadurai Sean Lie SyDa 38 1 0 13 Oct 2024
Does RoBERTa Perform Better than BERT in Continual Learning: An Attention Sink Perspective Xueying Bai Yifan Sun Niranjan Balasubramanian CLL 24 0 0 08 Oct 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 80 1 0 30 Jul 2024
MoE-CT: A Novel Approach For Large Language Models Training With Resistance To Catastrophic Forgetting Tianhao Li Shangjie Li Binbin Xie Deyi Xiong Baosong Yang CLL 50 3 0 25 Jun 2024
Lottery Ticket Adaptation: Mitigating Destructive Interference in LLMs Ashwinee Panda Berivan Isik Xiangyu Qi Sanmi Koyejo Tsachy Weissman Prateek Mittal MoMe 45 13 0 24 Jun 2024
Towards Lifelong Learning of Large Language Models: A Survey Junhao Zheng Shengjie Qiu Chengming Shi Qianli Ma KELM CLL 30 15 0 10 Jun 2024
HateDebias: On the Diversity and Variability of Hate Speech Debiasing Nankai Lin Hongyan Wu Zhengming Chen Zijian Li Lianxi Wang Shengyi Jiang Dong Zhou Aimin Yang 31 0 0 07 Jun 2024
HPE-CogVLM: New Head Pose Grounding Task Exploration on Vision Language Model Yu Tian Tianqi Shao Tsukasa Demizu Xuyang Wu Hsin-Tai Wu 26 3 0 04 Jun 2024
Feature Protection For Out-of-distribution Generalization Lu Tan Huei Zhou Yinxiang Huang Zeming Zheng Yujiu Yang OODD 49 0 0 25 May 2024
ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Tasks Santosh T.Y.S.S Tuan-Quang Vuong Matthias Grabmair AILaw CLL 53 4 0 23 May 2024
Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System Chen Chen Ruizhe Li Yuchen Hu Yuanyuan Chen Chengwei Qin Qiang Zhang CLL 41 2 0 16 May 2024
Q-Tuning: Queue-based Prompt Tuning for Lifelong Few-shot Language Learning Yanhui Guo Shaoyuan Xu Jinmiao Fu Jia-Wei Liu Chaosheng Dong Bryan Wang VLM CLL 33 5 0 22 Apr 2024
Towards Practical Tool Usage for Continually Learning LLMs Jerry Huang Prasanna Parthasarathi Mehdi Rezagholizadeh Sarath Chandar CLL KELM 56 4 0 14 Apr 2024
Scalable Language Model with Generalized Continual Learning Bohao Peng Zhuotao Tian Shu Liu Mingchang Yang Jiaya Jia ALM CLL KELM 35 13 0 11 Apr 2024
Rehearsal-Free Modular and Compositional Continual Learning for Language Models Mingyang Wang Heike Adel Lukas Lange Jannik Strötgen Hinrich Schütze KELM CLL 32 14 0 31 Mar 2024
Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal Jianheng Huang Leyang Cui Ante Wang Chengyi Yang Xinting Liao Linfeng Song Junfeng Yao Jinsong Su KELM CLL 37 34 0 02 Mar 2024
Balancing the Causal Effects in Class-Incremental Learning Junhao Zheng Ruiyan Wang Chongzhi Zhang Hu Feng Qianli Ma CML CLL 39 0 0 15 Feb 2024
TACIT: A Target-Agnostic Feature Disentanglement Framework for Cross-Domain Text Classification Rui Song Fausto Giunchiglia Yingji Li Mingjie Tian Hao Xu OOD 25 3 0 25 Dec 2023
Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Models Junhao Zheng Shengjie Qiu Qianli Ma 27 9 0 13 Dec 2023
CITB: A Benchmark for Continual Instruction Tuning Zihan Zhang Meng Fang Ling-Hao Chen Mohammad-Reza Namazi-Rad ALM CLL 49 23 0 23 Oct 2023
Orthogonal Subspace Learning for Language Model Continual Learning Xiao Wang Tianze Chen Qiming Ge Han Xia Rong Bao Rui Zheng Qi Zhang Tao Gui Xuanjing Huang CLL 122 90 0 22 Oct 2023
Towards Anytime Fine-tuning: Continually Pre-trained Language Models with Hypernetwork Prompt Gangwei Jiang Caigao Jiang Siqiao Xue James Y. Zhang Junqing Zhou Defu Lian Ying Wei VLM 34 7 0 19 Oct 2023
Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks Zixuan Ke Bing Liu Wenhan Xiong Asli Celikyilmaz Haoran Li CLL 32 5 0 13 Oct 2023
InfoCL: Alleviating Catastrophic Forgetting in Continual Text Classification from An Information Theoretic Perspective Yifan Song Peiyi Wang Weimin Xiong Dawei Zhu Tianyu Liu Zhifang Sui Sujian Li CLL 22 3 0 10 Oct 2023
Create and Find Flatness: Building Flat Training Spaces in Advance for Continual Learning Wenhang Shi Yiren Chen Zhe Zhao Wei Lu Kimmo Yan Xiaoyong Du CLL 38 5 0 20 Sep 2023
Mitigating the Alignment Tax of RLHF Yong Lin Hangyu Lin Wei Xiong Shizhe Diao Zeming Zheng ... Han Zhao Nan Jiang Heng Ji Yuan Yao Tong Zhang MoMe CLL 29 67 0 12 Sep 2023
Continual Learning From a Stream of APIs Enneng Yang Zhenyi Wang Li Shen Nan Yin Tongliang Liu Guibing Guo Xingwei Wang Dacheng Tao CLL 27 3 0 31 Aug 2023
GRASP: A Rehearsal Policy for Efficient Online Continual Learning Md Yousuf Harun Jhair Gallardo Junyu Chen Christopher Kanan CLL 36 9 0 25 Aug 2023
FedET: A Communication-Efficient Federated Class-Incremental Learning Framework Based on Enhanced Transformer Chenghao Liu Xiaoyang Qu Jianzong Wang Jing Xiao CLL FedML 29 25 0 27 Jun 2023
Class-Incremental Learning based on Label Generation Yijia Shao Yiduo Guo Dongyan Zhao Bin Liu CLL 32 14 0 22 Jun 2023
Lifelong Language Pretraining with Distribution-Specialized Experts Wuyang Chen Yan-Quan Zhou Nan Du Yanping Huang James Laudon Z. Chen Claire Cu KELM 23 48 0 20 May 2023
Mitigating Catastrophic Forgetting in Task-Incremental Continual Learning with Adaptive Classification Criterion Yun Luo Xiaotian Lin Zhen Yang Fandong Meng Jie Zhou Yue Zhang CLL 27 5 0 20 May 2023
RepCL: Exploring Effective Representation for Continual Text Classification Yifan Song Peiyi Wang Dawei Zhu Tianyu Liu Zhifang Sui Sujian Li CLL 16 1 0 12 May 2023
Investigating Forgetting in Pre-Trained Representations Through Continual Learning Yun Luo Zhen Yang Xuefeng Bai Fandong Meng Jie Zhou Yue Zhang CLL KELM 27 16 0 10 May 2023
Preventing Catastrophic Forgetting in Continual Learning of New Natural Language Tasks Sudipta Kar Giuseppe Castellucci Simone Filice S. Malmasi Oleg Rokhlenko CLL KELM 48 6 0 22 Feb 2023
Continual Pre-training of Language Models Zixuan Ke Yijia Shao Haowei Lin Tatsuya Konishi Gyuhak Kim Bin Liu CLL KELM 25 125 0 07 Feb 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 46 606 0 31 Jan 2023
Progressive Prompts: Continual Learning for Language Models Anastasia Razdaibiedina Yuning Mao Rui Hou Madian Khabsa M. Lewis Amjad Almahairi VLM KELM CLL 29 127 0 29 Jan 2023
Continual Learning of Natural Language Processing Tasks: A Survey Zixuan Ke Bin Liu KELM CLL VLM 29 69 0 23 Nov 2022
Exclusive Supermask Subnetwork Training for Continual Learning Prateek Yadav Joey Tianyi Zhou CLL 30 5 0 18 Oct 2022