Continual Learning in the Teacher-Student Setup: Impact of Task
Similarity

Continual Learning in the Teacher-Student Setup: Impact of Task Similarity

9 July 2021

Sebastian Goldt

Papers citing "Continual Learning in the Teacher-Student Setup: Impact of Task Similarity"

16 / 16 papers shown

Title
Neuroplasticity in Artificial Intelligence -- An Overview and Inspirations on Drop In & Out Learning Yupei Li M. Milling Björn Schuller AI4CE 107 0 0 27 Mar 2025
Theory on Mixture-of-Experts in Continual Learning Hongbo Li Sen-Fon Lin Lingjie Duan Yingbin Liang Ness B. Shroff MoE MoMe CLL 153 14 0 20 Feb 2025
Unlocking the Power of Function Vectors for Characterizing and Mitigating Catastrophic Forgetting in Continual Instruction Tuning Gangwei Jiang Caigao Jiang Zhaoyi Li Siqiao Xue Jun-ping Zhou Linqi Song Defu Lian Yin Wei CLL MU 63 0 0 16 Feb 2025
Understanding the Capabilities and Limitations of Weak-to-Strong Generalization Wei Yao Wenkai Yang Zhilin Wang Yankai Lin Yong Liu ELM 107 1 0 03 Feb 2025
Buffer-based Gradient Projection for Continual Federated Learning Shenghong Dai Jy-yong Sohn Yicong Chen S. Alam Ravikumar Balakrishnan Suman Banerjee N. Himayat Kangwook Lee FedML 75 2 0 03 Sep 2024
Disentangling and Mitigating the Impact of Task Similarity for Continual Learning Naoki Hiratani CLL 35 2 0 30 May 2024
Chunking: Continual Learning is not just about Distribution Shift Thomas L. Lee Amos Storkey 25 1 0 03 Oct 2023
The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions Nishil Patel Sebastian Lee Stefano Sarao Mannelli Sebastian Goldt Adrew Saxe OffRL 28 3 0 17 Jun 2023
Fixed Design Analysis of Regularization-Based Continual Learning Haoran Li Jingfeng Wu Vladimir Braverman CLL 26 9 0 17 Mar 2023
A Theoretical Study on Solving Continual Learning Gyuhak Kim Changnan Xiao Tatsuya Konishi Zixuan Ke Bin Liu CLL 24 70 0 04 Nov 2022
Task-Free Continual Learning via Online Discrepancy Distance Learning Fei Ye A. Bors CLL 24 28 0 12 Oct 2022
How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition Jorge Armando Mendez Mendez Eric Eaton KELM CLL 32 27 0 15 Jul 2022
The Effect of Task Ordering in Continual Learning Samuel J. Bell Neil D. Lawrence CLL 48 17 0 26 May 2022
Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signals Timo Flesch D. G. Nagy Andrew M. Saxe Christopher Summerfield 28 34 0 22 Mar 2022
Learning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting Ryo Karakida S. Akaho CLL 29 11 0 03 Dec 2021
Behavioral Experiments for Understanding Catastrophic Forgetting Samuel J. Bell Neil D. Lawrence 27 4 0 20 Oct 2021