LAMOL: LAnguage MOdeling for Lifelong Language Learning

7 September 2019

Papers citing "LAMOL: LAnguage MOdeling for Lifelong Language Learning"

50 / 55 papers shown

Title
Reinforced Interactive Continual Learning via Real-time Noisy Human Feedback Yutao Yang Jie Zhou Junsong Li Qianjun Pan Bihao Zhan Qin Chen Xipeng Qiu Liang He CLL 29 0 0 15 May 2025
Task-Core Memory Management and Consolidation for Long-term Continual Learning Tianyu Huai Jie Zhou Yuxuan Cai Qin Chen Wen Wu Xingjiao Wu Xipeng Qiu Liang He CLL 33 0 0 15 May 2025
Elastic Weight Consolidation for Full-Parameter Continual Pre-Training of Gemma2 Vytenis Šliogeris Povilas Daniušis Arturas Nakvosas CLL 40 0 0 09 May 2025
Memorization and Knowledge Injection in Gated LLMs Xu Pan Ely Hahami Zechen Zhang H. Sompolinsky KELM CLL RALM 106 1 0 30 Apr 2025
GDI-Bench: A Benchmark for General Document Intelligence with Vision and Reasoning Decoupling Siqi Li Yufan Shen Xiangnan Chen Jiayi Chen Hengwei Ju ... Licheng Wen Botian Shi Y. Liu Xinyu Cai Yu Qiao VLM ELM 96 0 0 30 Apr 2025
Achieving Upper Bound Accuracy of Joint Training in Continual Learning Saleh Momeni Bing Liu CLL 84 1 0 17 Feb 2025
LSEBMCL: A Latent Space Energy-Based Model for Continual Learning Xiaodi Li Dingcheng Li Rujun Gao Mahmoud Zamani Latifur Khan CLL KELM 49 0 0 09 Jan 2025
One VLM to Keep it Learning: Generation and Balancing for Data-free Continual Visual Question Answering Deepayan Das Davide Talon Massimiliano Mancini Yiming Wang Elisa Ricci 46 0 0 04 Nov 2024
Self-Data Distillation for Recovering Quality in Pruned Large Language Models Vithursan Thangarasa Ganesh Venkatesh Mike Lasby Nish Sinnadurai Sean Lie SyDa 38 1 0 13 Oct 2024
Drift to Remember Jin Du Xinsong Zhang Hao Shen Xun Xian Ganghua Wang Jiawei Zhang Yuhong Yang Na Li Jia Liu Jie Ding CLL 21 0 0 21 Sep 2024
Train-Attention: Meta-Learning Where to Focus in Continual Knowledge Learning Yeongbin Seo Dongha Lee Jinyoung Yeo CLL KELM 90 1 0 24 Jul 2024
Overcoming Catastrophic Forgetting by Exemplar Selection in Task-oriented Dialogue System Chen Chen Ruizhe Li Yuchen Hu Yuanyuan Chen Chengwei Qin Qiang Zhang CLL 41 2 0 16 May 2024
A Unified Replay-based Continuous Learning Framework for Spatio-Temporal Prediction on Streaming Data Hao Miao Yan Zhao Chenjuan Guo Bin Yang Kai Zheng Feiteng Huang Jiandong Xie Christian S. Jensen AI4TS CLL 44 30 0 23 Apr 2024
HOP to the Next Tasks and Domains for Continual Learning in NLP Umberto Michieli Mete Ozay VLM 39 2 0 28 Feb 2024
Investigating Continual Pretraining in Large Language Models: Insights and Implications cCaugatay Yildiz Nishaanth Kanna Ravichandran Prishruit Punia Matthias Bethge Beyza Ermis CLL KELM LRM 58 25 0 27 Feb 2024
Can LLMs Learn New Concepts Incrementally without Forgetting? Junhao Zheng Shengjie Qiu Qianli Ma CLL 35 0 0 13 Feb 2024
Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Models Junhao Zheng Shengjie Qiu Qianli Ma 27 9 0 13 Dec 2023
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models Luiza Amador Pozzobon Beyza Ermis Patrick Lewis Sara Hooker 36 20 0 11 Oct 2023
Class-Incremental Learning based on Label Generation Yijia Shao Yiduo Guo Dongyan Zhao Bin Liu CLL 32 14 0 22 Jun 2023
Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction Xin-Yue Wang Zitao Wang Wei Hu CLL BDL 31 11 0 11 May 2023
On the Creativity of Large Language Models Giorgio Franceschelli Mirco Musolesi 72 52 0 27 Mar 2023
Learning Label Modular Prompts for Text Classification in the Wild Hailin Chen Amrita Saha Chenyu You Steven C. H. Hoi OOD VLM 26 5 0 30 Nov 2022
Semi-Supervised Lifelong Language Learning Ying Zhao Yinhe Zheng Yu Bowen Zhiliang Tian Dongkyu Lee Jian Sun Haiyang Yu Yongbin Li N. Zhang CLL KELM 43 3 0 23 Nov 2022
Biologically-Inspired Continual Learning of Human Motion Sequences Joachim Ott Shihao Liu 29 0 0 02 Nov 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 127 94 0 06 Oct 2022
Continuous QA Learning with Structured Prompts Yinhe Zheng CLL 33 1 0 31 Aug 2022
Ask Question First for Enhancing Lifelong Language Learning Han Wang Ruiliu Fu Xuejun Zhang Jun Zhou Qingwei Zhao CLL 36 0 0 17 Aug 2022
How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition Jorge Armando Mendez Mendez Eric Eaton KELM CLL 32 27 0 15 Jul 2022
Fine-tuned Language Models are Continual Learners Thomas Scialom Tuhin Chakrabarty Smaranda Muresan CLL LRM 145 117 0 24 May 2022
Enhancing Continual Learning with Global Prototypes: Counteracting Negative Representation Drift Xueying Bai Jinghuan Shang Yifan Sun Niranjan Balasubramanian CLL 35 1 0 24 May 2022
Cross-lingual Lifelong Learning Meryem M'hamdi Xiang Ren Jonathan May CLL 40 8 0 23 May 2022
On Continual Model Refinement in Out-of-Distribution Data Streams Bill Yuchen Lin Sida I. Wang Xi Lin Robin Jia Lin Xiao Xiang Ren Wen-tau Yih CLL 28 29 0 04 May 2022
Continual Sequence Generation with Adaptive Compositional Modules Yanzhe Zhang Xuezhi Wang Diyi Yang KELM CLL 43 42 0 20 Mar 2022
ConTinTin: Continual Learning from Task Instructions Wenpeng Yin Jia Li Caiming Xiong CLL 29 29 0 16 Mar 2022
ELLE: Efficient Lifelong Pre-training for Emerging Data Yujia Qin Jiajie Zhang Yankai Lin Zhiyuan Liu Peng Li Maosong Sun Jie Zhou 30 67 0 12 Mar 2022
Memory Efficient Continual Learning with Transformers Beyza Ermis Giovanni Zappella Martin Wistuba Aditya Rawal Cédric Archambeau CLL 29 43 0 09 Mar 2022
Consistent Representation Learning for Continual Relation Extraction Kang Zhao Hua Xu Jian Yang Kai Gao CLL 31 50 0 05 Mar 2022
Continual Few-shot Relation Learning via Embedding Space Regularization and Data Augmentation Chengwei Qin Chenyu You BDL CLL 18 33 0 04 Mar 2022
Continual Learning of Long Topic Sequences in Neural Information Retrieval Thomas Gerald Laure Soulier CLL 43 4 0 10 Jan 2022
CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks Zixuan Ke Bing-Quan Liu Hu Xu Lei Shu CLL 31 55 0 05 Dec 2021
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora Xisen Jin Dejiao Zhang Henghui Zhu Wei Xiao Shang-Wen Li Xiaokai Wei Andrew O. Arnold Xiang Ren KELM CLL 31 111 0 16 Oct 2021
LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5 Chengwei Qin Chenyu You CLL 178 98 0 14 Oct 2021
Towards Continual Knowledge Learning of Language Models Joel Jang Seonghyeon Ye Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Stanley Jungkyu Choi Minjoon Seo CLL KELM 233 151 0 07 Oct 2021
DualNet: Continual Learning, Fast and Slow Quang Pham Chenghao Liu Guosheng Lin CLL 71 43 0 01 Oct 2021
Total Recall: a Customized Continual Learning Method for Neural Semantic Parsers Zhuang Li Lizhen Qu Gholamreza Haffari CLL 40 15 0 11 Sep 2021
Prototype-Guided Memory Replay for Continual Learning Stella Ho Ming Liu Lan Du Longxiang Gao Yong Xiang CLL 8 30 0 28 Aug 2021
Continual World: A Robotic Benchmark For Continual Reinforcement Learning Maciej Wołczyk Michal Zajkac Razvan Pascanu Lukasz Kuciñski Piotr Milo's CLL OffRL 17 89 0 23 May 2021
Continual Learning for Text Classification with Information Disentanglement Based Regularization Yufan Huang Yanzhe Zhang Jiaao Chen Xuezhi Wang Diyi Yang CLL 26 106 0 12 Apr 2021
Towards Lifelong Learning of End-to-end ASR Heng-Jui Chang Hung-yi Lee Lin-Shan Lee KELM CLL 35 34 0 04 Apr 2021
Distilled Replay: Overcoming Forgetting through Synthetic Samples Andrea Rosasco Antonio Carta Andrea Cossu Vincenzo Lomonaco D. Bacciu DD 24 47 0 29 Mar 2021