The Effect of Task Ordering in Continual Learning

26 May 2022

Papers citing "The Effect of Task Ordering in Continual Learning"

31 / 31 papers shown

Title
CLDyB: Towards Dynamic Benchmarking for Continual Learning with Pre-trained Models Shengzhuang Chen Yikai Liao Xiaoxiao Sun Kede Ma Ying Wei 120 0 0 06 Mar 2025
An Empirical Investigation of the Role of Pre-training in Lifelong Learning Sanket Vaibhav Mehta Darshan Patil Sarath Chandar Emma Strubell CLL 137 144 0 16 Dec 2021
Behavioral Experiments for Understanding Catastrophic Forgetting Samuel J. Bell Neil D. Lawrence 82 4 0 20 Oct 2021
Continual Learning in the Teacher-Student Setup: Impact of Task Similarity Sebastian Lee Sebastian Goldt Andrew M. Saxe CLL 75 74 0 09 Jul 2021
Deep Learning Through the Lens of Example Difficulty R. Baldock Hartmut Maennel Behnam Neyshabur 85 161 0 17 Jun 2021
When Do Curricula Work? Xiaoxia Wu Ethan Dyer Behnam Neyshabur 68 118 0 05 Dec 2020
Estimating Example Difficulty Using Variance of Gradients Chirag Agarwal Daniel D'souza Sara Hooker 273 111 0 26 Aug 2020
Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semantics V. Ramasesh Ethan Dyer M. Raghu CLL 103 179 0 14 Jul 2020
Understanding the Role of Training Regimes in Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Razvan Pascanu H. Ghasemzadeh CLL 81 228 0 12 Jun 2020
Learning to Continually Learn Shawn L. E. Beaulieu Lapo Frati Thomas Miconi Joel Lehman Kenneth O. Stanley Jeff Clune Nick Cheney KELM CLL 87 148 0 21 Feb 2020
Using Hindsight to Anchor Past Knowledge in Continual Learning Arslan Chaudhry Albert Gordo P. Dokania Philip Torr David Lopez-Paz KELM CLL 98 237 0 19 Feb 2020
Toward Understanding Catastrophic Forgetting in Continual Learning Cuong V Nguyen Alessandro Achille Michael Lam Tal Hassner Vijay Mahadevan Stefano Soatto 70 94 0 02 Aug 2019
Meta-Learning Representations for Continual Learning Khurram Javed Martha White KELM CLL 80 320 0 29 May 2019
Similarity of Neural Network Representations Revisited Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton 143 1,435 0 01 May 2019
On The Power of Curriculum Learning in Training Deep Networks Guy Hacohen D. Weinshall ODL 80 449 0 07 Apr 2019
Efficient Lifelong Learning with A-GEM Arslan Chaudhry MarcÁurelio Ranzato Marcus Rohrbach Mohamed Elhoseiny CLL 212 1,463 0 02 Dec 2018
Towards Robust Evaluations of Continual Learning Sebastian Farquhar Y. Gal CLL 93 308 0 24 May 2018
Not All Samples Are Created Equal: Deep Learning with Importance Sampling Angelos Katharopoulos François Fleuret 108 522 0 02 Mar 2018
Curriculum Learning by Transfer Learning: Theory and Experiments with Deep Networks D. Weinshall Gad Cohen Dan Amir ODL 52 245 0 11 Feb 2018
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence Arslan Chaudhry P. Dokania Thalaiyasingam Ajanthan Philip Torr CLL 105 1,145 0 30 Jan 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 264 1,901 0 28 Dec 2017
Three Factors Influencing Minima in SGD Stanislaw Jastrzebski Zachary Kenton Devansh Arpit Nicolas Ballas Asja Fischer Yoshua Bengio Amos Storkey 78 463 0 13 Nov 2017
Measuring Catastrophic Forgetting in Neural Networks Ronald Kemker Marc McClure Angelina Abitino Tyler L. Hayes Christopher Kanan CLL 125 722 0 07 Aug 2017
Automated Curriculum Learning for Neural Networks Alex Graves Marc G. Bellemare Jacob Menick Rémi Munos Koray Kavukcuoglu 96 530 0 10 Apr 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 374 7,572 0 02 Dec 2016
Learning the Curriculum with Bayesian Optimization for Task-Specific Word Representation Learning Yulia Tsvetkov Manaal Faruqui Wang Ling B. MacWhinney Chris Dyer 91 90 0 12 May 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,510 0 10 Dec 2015
Prioritized Experience Replay Tom Schaul John Quan Ioannis Antonoglou David Silver OffRL 231 3,796 0 18 Nov 2015
Curriculum Learning of Multiple Tasks Anastasia Pentina V. Sharmanska Christoph H. Lampert 88 245 0 03 Dec 2014
Stochastic Optimization with Importance Sampling P. Zhao Tong Zhang 112 346 0 13 Jan 2014
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks Ian Goodfellow M. Berk Mirza Xia Da Aaron Courville Yoshua Bengio 159 1,455 0 21 Dec 2013