Efficient Meta Lifelong-Learning with Limited Memory

Efficient Meta Lifelong-Learning with Limited Memory

6 October 2020

Sanket Vaibhav Mehta

Barnabás Póczós

Papers citing "Efficient Meta Lifelong-Learning with Limited Memory"

17 / 17 papers shown

Title
Generate to Discriminate: Expert Routing for Continual Learning Yewon Byun Sanket Vaibhav Mehta Saurabh Garg Emma Strubell Michael Oberst Bryan Wilder Zachary Chase Lipton 83 0 0 31 Dec 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 83 3 0 30 Jul 2024
Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Models Lukas Thede Karsten Roth Olivier J. Hénaff Matthias Bethge Zeynep Akata CLL 47 5 0 13 Jun 2024
Diversifying the Mixture-of-Experts Representation for Language Models with Orthogonal Optimizer Boan Liu Liang Ding Li Shen Keqin Peng Yu Cao Dazhao Cheng Dacheng Tao MoE 36 7 0 15 Oct 2023
Model Provenance via Model DNA Xin Mu Yu Wang Yehong Zhang Jiaqi Zhang Haibo Wang Yang Xiang Yue Yu SyDa 30 0 0 04 Aug 2023
Can BERT Refrain from Forgetting on Sequential Tasks? A Probing Study Mingxu Tao Yansong Feng Dongyan Zhao CLL KELM 32 10 0 02 Mar 2023
DSI++: Updating Transformer Memory with New Documents Sanket Vaibhav Mehta Jai Gupta Yi Tay Mostafa Dehghani Vinh Q. Tran J. Rao Marc Najork Emma Strubell Donald Metzler CLL 34 39 0 19 Dec 2022
Continual Learning of Natural Language Processing Tasks: A Survey Zixuan Ke Bin Liu KELM CLL VLM 37 69 0 23 Nov 2022
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning Prakhar Gupta Cathy Jiao Yi-Ting Yeh Shikib Mehri M. Eskénazi Jeffrey P. Bigham ALM 44 47 0 25 May 2022
Continual Sequence Generation with Adaptive Compositional Modules Yanzhe Zhang Xuezhi Wang Diyi Yang KELM CLL 46 42 0 20 Mar 2022
Memory Efficient Continual Learning with Transformers Beyza Ermis Giovanni Zappella Martin Wistuba Aditya Rawal Cédric Archambeau CLL 36 43 0 09 Mar 2022
Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning Zixuan Ke Bing-Quan Liu Nianzu Ma Hu Xu Lei Shu CLL 192 122 0 05 Dec 2021
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora Xisen Jin Dejiao Zhang Henghui Zhu Wei Xiao Shang-Wen Li Xiaokai Wei Andrew O. Arnold Xiang Ren KELM CLL 31 113 0 16 Oct 2021
Prototype-Guided Memory Replay for Continual Learning Stella Ho Ming Liu Lan Du Longxiang Gao Yong Xiang CLL 13 30 0 28 Aug 2021
Continual Learning for Text Classification with Information Disentanglement Based Regularization Yufan Huang Yanzhe Zhang Jiaao Chen Xuezhi Wang Diyi Yang CLL 26 106 0 12 Apr 2021
Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation Shuhao Gu Yang Feng Wanying Xie CLL AI4CE 25 27 0 25 Mar 2021
Continual Learning in Task-Oriented Dialogue Systems Andrea Madotto Zhaojiang Lin Zhenpeng Zhou Seungwhan Moon Paul A. Crook Bing-Quan Liu Zhou Yu Eunjoon Cho Zhiguang Wang CLL 27 127 0 31 Dec 2020