Feature Forgetting in Continual Representation Learning

Feature Forgetting in Continual Representation Learning

26 May 2022

Ji Wu

Papers citing "Feature Forgetting in Continual Representation Learning"

19 / 19 papers shown

Title
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts Nan Du Yanping Huang Andrew M. Dai Simon Tong Dmitry Lepikhin ... Kun Zhang Quoc V. Le Yonghui Wu Zhiwen Chen Claire Cui ALM MoE 189 806 0 13 Dec 2021
URLB: Unsupervised Reinforcement Learning Benchmark Michael Laskin Denis Yarats Hao Liu Kimin Lee Albert Zhan Kevin Lu Catherine Cang Lerrel Pinto Pieter Abbeel SSL OffRL 67 137 0 28 Oct 2021
Avalanche: an End-to-End Library for Continual Learning Vincenzo Lomonaco Lorenzo Pellegrini Andrea Cossu Antonio Carta G. Graffieti ... Christopher Kanan Joost van de Weijer Tinne Tuytelaars D. Bacciu Davide Maltoni BDL AI4TS 65 182 0 01 Apr 2021
Linear Mode Connectivity in Multitask and Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Dilan Görür Razvan Pascanu H. Ghasemzadeh CLL 59 141 0 09 Oct 2020
Supermasks in Superposition Mitchell Wortsman Vivek Ramanujan Rosanne Liu Aniruddha Kembhavi Mohammad Rastegari J. Yosinski Ali Farhadi SSL CLL 64 292 0 26 Jun 2020
Understanding the Role of Training Regimes in Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Razvan Pascanu H. Ghasemzadeh CLL 67 225 0 12 Jun 2020
Information-Theoretic Probing with Minimum Description Length Elena Voita Ivan Titov 68 274 0 27 Mar 2020
Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks Blake Bordelon Abdulkadir Canatar Cengiz Pehlevan 205 206 0 07 Feb 2020
Three scenarios for continual learning Gido M. van de Ven A. Tolias CLL 78 889 0 15 Apr 2019
Learning and Evaluating General Linguistic Intelligence Dani Yogatama Cyprien de Masson dÁutume Jerome T. Connor Tomás Kociský Mike Chrzanowski ... Angeliki Lazaridou Wang Ling Lei Yu Chris Dyer Phil Blunsom ELM AI4CE 141 210 0 31 Jan 2019
Efficient Lifelong Learning with A-GEM Arslan Chaudhry MarcÁurelio Ranzato Marcus Rohrbach Mohamed Elhoseiny CLL 188 1,449 0 02 Dec 2018
Towards Robust Evaluations of Continual Learning Sebastian Farquhar Y. Gal CLL 84 307 0 24 May 2018
Progress & Compress: A scalable framework for continual learning Jonathan Richard Schwarz Jelena Luketina Wojciech M. Czarnecki A. Grabska-Barwinska Yee Whye Teh Razvan Pascanu R. Hadsell CLL 108 886 0 16 May 2018
Dynamic Routing Between Capsules S. Sabour Nicholas Frosst Geoffrey E. Hinton 146 4,589 0 26 Oct 2017
Learning multiple visual domains with residual adapters Sylvestre-Alvise Rebuffi Hakan Bilen Andrea Vedaldi OOD 144 931 0 22 May 2017
PathNet: Evolution Channels Gradient Descent in Super Neural Networks Chrisantha Fernando Dylan Banarse Charles Blundell Yori Zwols David R Ha Andrei A. Rusu Alexander Pritzel Daan Wierstra 61 880 0 30 Jan 2017
Dynamic Deep Neural Networks: Optimizing Accuracy-Efficiency Trade-offs by Selective Execution Lanlan Liu Jia Deng 72 203 0 02 Jan 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 319 7,478 0 02 Dec 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 282 4,391 0 29 Jun 2016