Progress & Compress: A scalable framework for continual learning

16 May 2018

Jonathan Richard Schwarz

Jelena Luketina

Wojciech M. Czarnecki

Papers citing "Progress & Compress: A scalable framework for continual learning"

45 / 195 papers shown

Title
Continual Model-Based Reinforcement Learning with Hypernetworks Yizhou Huang Kevin Xie Homanga Bharadhwaj Florian Shkurti CLL 22 46 0 25 Sep 2020
Lifelong Policy Gradient Learning of Factored Policies for Faster Training Without Forgetting Jorge Armando Mendez Mendez Boyu Wang Eric Eaton CLL 36 38 0 14 Jul 2020
RATT: Recurrent Attention to Transient Tasks for Continual Image Captioning Riccardo Del Chiaro Bartlomiej Twardowski Andrew D. Bagdanov Joost van de Weijer CLL VLM 30 40 0 13 Jul 2020
Continual BERT: Continual Learning for Adaptive Extractive Summarization of COVID-19 Literature Jongjin Park CLL 33 15 0 07 Jul 2020
GAN Memory with No Forgetting Yulai Cong Miaoyun Zhao Jianqiao Li Sijia Wang Lawrence Carin CLL 13 116 0 13 Jun 2020
Understanding the Role of Training Regimes in Continual Learning Seyed Iman Mirzadeh Mehrdad Farajtabar Razvan Pascanu H. Ghasemzadeh CLL 21 219 0 12 Jun 2020
Transient Non-Stationarity and Generalisation in Deep Reinforcement Learning Maximilian Igl Gregory Farquhar Jelena Luketina Wendelin Boehmer Shimon Whiteson 27 84 0 10 Jun 2020
Optimal Continual Learning has Perfect Memory and is NP-hard Jeremias Knoblauch Hisham Husain Tom Diethe CLL 29 104 0 09 Jun 2020
Incremental Learning for End-to-End Automatic Speech Recognition Li Fu Xiaoxiao Li Libo Zi Zhengchen Zhang Youzheng Wu Xiaodong He Bowen Zhou CLL 40 23 0 11 May 2020
Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting Sanyuan Chen Yutai Hou Yiming Cui Wanxiang Che Ting Liu Xiangzhan Yu KELM CLL 21 212 0 27 Apr 2020
Continual Domain-Tuning for Pretrained Language Models Subendhu Rongali Abhyuday N. Jagannatha Bhanu Pratap Singh Rawat Hong-ye Yu CLL KELM 8 7 0 05 Apr 2020
Conditional Channel Gated Networks for Task-Aware Continual Learning Davide Abati Jakub M. Tomczak Tijmen Blankevoort Simone Calderara Rita Cucchiara B. Bejnordi CLL 42 184 0 31 Mar 2020
iTAML: An Incremental Task-Agnostic Meta-learning Approach Jathushan Rajasegaran Salman Khan Munawar Hayat Fahad Shahbaz Khan M. Shah CLL OOD 30 153 0 25 Mar 2020
Sample Efficient Reinforcement Learning through Learning from Demonstrations in Minecraft Christian Scheller Yanick Schraner Manfred Vogel 8 27 0 12 Mar 2020
Continuous Domain Adaptation with Variational Domain-Agnostic Feature Replay Qicheng Lao Xiang Jiang Mohammad Havaei Yoshua Bengio VLM 23 33 0 09 Mar 2020
Federated Continual Learning with Weighted Inter-client Transfer Jaehong Yoon Wonyoung Jeong Giwoong Lee Eunho Yang Sung Ju Hwang FedML 40 199 0 06 Mar 2020
Noisy Machines: Understanding Noisy Neural Networks and Enhancing Robustness to Analog Hardware Errors Using Distillation Chuteng Zhou Prad Kadambi Matthew Mattina P. Whatmough 19 35 0 14 Jan 2020
Frosting Weights for Better Continual Training Xiaofeng Zhu Feng Liu Goce Trajcevski Dingding Wang FedML AI4CE CLL 28 5 0 07 Jan 2020
A Neural Dirichlet Process Mixture Model for Task-Free Continual Learning Soochan Lee Junsoo Ha Dongsu Zhang Gunhee Kim BDL CLL 13 209 0 03 Jan 2020
Latent Replay for Real-Time Continual Learning Lorenzo Pellegrini G. Graffieti Vincenzo Lomonaco Davide Maltoni CLL 28 163 0 02 Dec 2019
OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learning Qi She Fan Feng Xinyue Hao Qihan Yang Chuanlin Lan ... Zhengwei Wang Yao Guo Yimin Zhang Fei Qiao Rosa H. M. Chan VLM 38 75 0 15 Nov 2019
Gated Linear Networks William H. Guss Tor Lattimore David Budden Avishkar Bhoopchand Christopher Mattern ... Ruslan Salakhutdinov Jianan Wang Peter Toth Simon Schmitt Marcus Hutter AI4CE 18 40 0 30 Sep 2019
Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models Cheolhyoung Lee Kyunghyun Cho Wanmo Kang MoE 249 205 0 25 Sep 2019
Efficient Continual Learning in Neural Networks with Embedding Regularization Jary Pomponi Simone Scardapane Vincenzo Lomonaco A. Uncini CLL 36 41 0 09 Sep 2019
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation Dongmin Park Seokil Hong Bohyung Han Kyoung Mu Lee AAML CLL 24 39 0 08 Aug 2019
DisCoRL: Continual Reinforcement Learning via Policy Distillation Kalifou René Traoré Hugo Caselles-Dupré Timothée Lesort Te Sun Guanghang Cai Natalia Díaz Rodríguez David Filliat OffRL 32 60 0 11 Jul 2019
Variational Federated Multi-Task Learning Luca Corinzia Ami Beuret J. M. Buhmann FedML 27 159 0 14 Jun 2019
Practical Deep Learning with Bayesian Principles Kazuki Osawa S. Swaroop Anirudh Jain Runa Eschenhagen Richard Turner Rio Yokota Mohammad Emtiyaz Khan BDL UQCV 56 240 0 06 Jun 2019
Uncertainty-guided Continual Learning with Bayesian Neural Networks Sayna Ebrahimi Mohamed Elhoseiny Trevor Darrell Marcus Rohrbach CLL BDL 21 195 0 06 Jun 2019
Episodic Memory in Lifelong Language Learning Cyprien de Masson dÁutume Sebastian Ruder Lingpeng Kong Dani Yogatama CLL KELM 34 280 0 03 Jun 2019
Uncertainty-based Continual Learning with Adaptive Regularization Hongjoon Ahn Sungmin Cha Donggyu Lee Taesup Moon BDL 24 209 0 28 May 2019
Sequential mastery of multiple visual tasks: Networks naturally learn to learn and forget to forget Guy Davidson Michael C. Mozer CLL 20 23 0 26 May 2019
An Explicitly Relational Neural Network Architecture Murray Shanahan Kyriacos Nikiforou Antonia Creswell Christos Kaplanis David Barrett M. Garnelo NAI 3DV GAN 25 68 0 24 May 2019
Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning O. Ostapenko M. Puscas T. Klein P. Jähnichen Moin Nabi CLL 60 297 0 05 Apr 2019
Class-incremental Learning via Deep Model Consolidation Junting Zhang Jie Zhang Shalini Ghosh Dawei Li Serafettin Tasci Larry Heck Heming Zhang C.-C. Jay Kuo CLL 27 334 0 19 Mar 2019
On Tiny Episodic Memories in Continual Learning Arslan Chaudhry Marcus Rohrbach Mohamed Elhoseiny Thalaiyasingam Ajanthan P. Dokania Philip Torr MarcÁurelio Ranzato CLL 52 391 0 27 Feb 2019
Pseudo-Rehearsal: Achieving Deep Reinforcement Learning without Catastrophic Forgetting C. Atkinson B. McCane Lech Szymanski Anthony Robins VLM CLL 13 102 0 06 Dec 2018
Efficient Lifelong Learning with A-GEM Arslan Chaudhry MarcÁurelio Ranzato Marcus Rohrbach Mohamed Elhoseiny CLL 93 1,425 0 02 Dec 2018
Generalization and Regularization in DQN Jesse Farebrother Marlos C. Machado Michael Bowling 25 203 0 29 Sep 2018
On Catastrophic Forgetting and Mode Collapse in Generative Adversarial Networks Hoang Thanh-Tung T. Tran GAN 18 58 0 11 Jul 2018
Self-Net: Lifelong Learning via Continual Self-Modeling Blake Camp J. Mandivarapu Rolando Estrada CLL SSL 27 16 0 25 May 2018
Towards Robust Evaluations of Continual Learning Sebastian Farquhar Y. Gal CLL 28 305 0 24 May 2018
Network Transplanting Quanshi Zhang Yu Yang Ying Nian Wu Song-Chun Zhu OOD 14 5 0 26 Apr 2018
HOUDINI: Lifelong Learning as Program Synthesis Lazar Valkov Dipak Chaudhari Akash Srivastava Charles Sutton Swarat Chaudhuri 24 78 0 31 Mar 2018
Overcoming Catastrophic Interference by Conceptors Xu He H. Jaeger BDL 26 13 0 16 Jul 2017