Continual evaluation for lifelong learning: Identifying the stability
gap

Continual evaluation for lifelong learning: Identifying the stability gap

26 May 2022

Matthias De Lange

Gido M. van de Ven

Tinne Tuytelaars

Papers citing "Continual evaluation for lifelong learning: Identifying the stability gap"

15 / 15 papers shown

Title
Learning Dynamics in Continual Pre-Training for Large Language Models Xingjin Wang Howe Tissue Lu Wang Linjing Li D. Zeng CLL 29 0 0 12 May 2025
Mathematics of Continual Learning Liangzu Peng René Vidal CLL 70 0 0 24 Apr 2025
LeanAgent: Lifelong Learning for Formal Theorem Proving Adarsh Kumarappan Mo Tiwari Peiyang Song Robert Joseph George Chaowei Xiao Anima Anandkumar CLL LLMAG LRM 72 8 0 08 Oct 2024
Early Preparation Pays Off: New Classifier Pre-tuning for Class Incremental Semantic Segmentation Zhengyuan Xie Haiquan Lu Jia-Wen Xiao Enguang Wang Le Zhang Xialei Liu CLL 33 2 0 19 Jul 2024
AGALE: A Graph-Aware Continual Learning Evaluation Framework Tianqi Zhao Alan Hanjalic Megha Khosla 37 1 0 03 Jun 2024
Continual Learning on a Diet: Learning from Sparsely Labeled Streams Under Constrained Computation Wenxuan Zhang Youssef Mohamed Guohao Li Philip H. S. Torr Adel Bibi Mohamed Elhoseiny CLL 45 5 0 19 Apr 2024
PARMESAN: Parameter-Free Memory Search and Transduction for Dense Prediction Tasks Philip Matthias Winter M. Wimmer David Major Dimitrios Lenis Astrid Berg Theresa Neubauer Gaia Romana De Paolis Johannes Novotny Sophia Ulonska Katja Bühler 37 0 0 18 Mar 2024
Simple and Scalable Strategies to Continually Pre-train Large Language Models Adam Ibrahim Benjamin Thérien Kshitij Gupta Mats L. Richter Quentin Anthony Timothée Lesort Eugene Belilovsky Irina Rish KELM CLL 44 52 0 13 Mar 2024
Two Complementary Perspectives to Continual Learning: Ask Not Only What to Optimize, But Also How Timm Hess Tinne Tuytelaars Gido M. van de Ven 41 7 0 08 Nov 2023
A Comprehensive Empirical Evaluation on Online Continual Learning Albin Soutif--Cormerais Antonio Carta Andrea Cossu J. Hurtado Hamed Hemati Vincenzo Lomonaco Joost van de Weijer CLL 31 20 0 20 Aug 2023
Continual Pre-Training of Large Language Models: How to (re)warm your model? Kshitij Gupta Benjamin Thérien Adam Ibrahim Mats L. Richter Quentin G. Anthony Eugene Belilovsky Irina Rish Timothée Lesort KELM 26 99 0 08 Aug 2023
Learn the Time to Learn: Replay Scheduling in Continual Learning Marcus Klasson Hedvig Kjellström Chen Zhang CLL 24 9 0 18 Sep 2022
Energy-Based Models for Continual Learning Shuang Li Yilun Du Gido M. van de Ven Igor Mordatch 27 42 0 24 Nov 2020
Domain Adaptive Ensemble Learning Kaiyang Zhou Yongxin Yang Yu Qiao Tao Xiang OOD 137 273 0 16 Mar 2020
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 296 39,198 0 01 Sep 2014