Overcoming catastrophic forgetting with hard attention to the task

4 January 2018

Joan Serrà

Dídac Surís

M. Miron

Alexandros Karatzoglou

CLL

ArXiv PDF HTML

Papers citing "Overcoming catastrophic forgetting with hard attention to the task"

50 / 203 papers shown

Title
An Investigation of Replay-based Approaches for Continual Learning Benedikt Bagus A. Gepperth CLL 33 33 0 15 Aug 2021
Continual Semi-Supervised Learning through Contrastive Interpolation Consistency Matteo Boschini Pietro Buzzega Lorenzo Bonicelli Angelo Porrello Simone Calderara CLL 27 40 0 14 Aug 2021
Continual Neural Mapping: Learning An Implicit Scene Representation from Sequential Observations Zike Yan Yuxin Tian Xuesong Shi Ping Guo Peng Wang H. Zha CLL 19 45 0 12 Aug 2021
Generalized Source-free Domain Adaptation Shiqi Yang Yaxing Wang Joost van de Weijer Luis Herranz Shangling Jui TTA 38 252 0 03 Aug 2021
Co $^2$ L: Contrastive Continual Learning Hyuntak Cha Jaeho Lee Jinwoo Shin CLL SSL VLM 43 291 0 28 Jun 2021
Invariant Information Bottleneck for Domain Generalization Bo-wen Li Yifei Shen Yezhen Wang Wenzhen Zhu Colorado Reed Jun Zhang Dongsheng Li Kurt Keutzer Han Zhao OOD 32 105 0 11 Jun 2021
Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning Liangqiong Qu Yuyin Zhou Paul Pu Liang Yingda Xia Feifei Wang Ehsan Adeli L. Fei-Fei D. Rubin FedML AI4CE 19 174 0 10 Jun 2021
Generative Feature-driven Image Replay for Continual Learning Kevin Thandiackal Tiziano Portenier Andrea Giovannini M. Gabrani O. Goksel CLL VLM DiffM 18 9 0 09 Jun 2021
Piggyback GAN: Efficient Lifelong Learning for Image Conditioned Generation Mengyao Zhai Lei Chen Jiawei He Megha Nawhal Frederick Tung Greg Mori CLL 38 27 0 24 Apr 2021
Class-Incremental Learning with Generative Classifiers Gido M. van de Ven Zhe Li A. Tolias BDL 50 58 0 20 Apr 2021
Overcoming Catastrophic Forgetting with Gaussian Mixture Replay Benedikt Pfülb A. Gepperth VLM BDL 18 12 0 19 Apr 2021
Continual Learning for Text Classification with Information Disentanglement Based Regularization Yufan Huang Yanzhe Zhang Jiaao Chen Xuezhi Wang Diyi Yang CLL 15 106 0 12 Apr 2021
New Insights on Reducing Abrupt Representation Change in Online Continual Learning Lucas Caccia Rahaf Aljundi Nader Asadi Tinne Tuytelaars Joelle Pineau Eugene Belilovsky CLL 21 185 0 11 Apr 2021
Replay in Deep Learning: Current Approaches and Missing Biological Elements Tyler L. Hayes G. Krishnan M. Bazhenov H. Siegelmann T. Sejnowski Christopher Kanan CLL 36 129 0 01 Apr 2021
Avalanche: an End-to-End Library for Continual Learning Vincenzo Lomonaco Lorenzo Pellegrini Andrea Cossu Antonio Carta G. Graffieti ... Christopher Kanan J. Weijer Tinne Tuytelaars D. Bacciu Davide Maltoni BDL AI4TS 28 180 0 01 Apr 2021
DER: Dynamically Expandable Representation for Class Incremental Learning Shipeng Yan Jiangwei Xie Xuming He CLL 18 434 0 31 Mar 2021
Efficient Feature Transformations for Discriminative and Generative Continual Learning Vinay K. Verma Kevin J Liang Nikhil Mehta Piyush Rai Lawrence Carin CLL 38 76 0 25 Mar 2021
Gradient Projection Memory for Continual Learning Gobinda Saha Isha Garg Kaushik Roy VLM CLL 39 266 0 17 Mar 2021
Training Networks in Null Space of Feature Covariance for Continual Learning Shipeng Wang Xiaorong Li Jian Sun Zongben Xu CLL 31 129 0 12 Mar 2021
Selective Replay Enhances Learning in Online Continual Analogical Reasoning Tyler L. Hayes Christopher Kanan CLL 16 20 0 06 Mar 2021
Towards Open World Object Detection K. J. Joseph Salman Khan F. Khan V. Balasubramanian ObjD 30 448 0 03 Mar 2021
Understanding Catastrophic Forgetting and Remembering in Continual Learning with Optimal Relevance Mapping Prakhar Kaushik Alex Gain Adam Kortylewski Alan Yuille CLL 11 68 0 22 Feb 2021
Efficient Continual Learning with Modular Networks and Task-Driven Priors Tom Véniat Ludovic Denoyer MarcÁurelio Ranzato CLL 22 97 0 23 Dec 2020
Generalized Variational Continual Learning Noel Loo S. Swaroop Richard Turner BDL CLL 33 58 0 24 Nov 2020
Energy-Based Models for Continual Learning Shuang Li Yilun Du Gido M. van de Ven Igor Mordatch 27 42 0 24 Nov 2020
Remembering for the Right Reasons: Explanations Reduce Catastrophic Forgetting Sayna Ebrahimi Suzanne Petryk Akash Gokul William Gan Joseph E. Gonzalez Marcus Rohrbach Trevor Darrell CLL 31 45 0 04 Oct 2020
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data Jonathan Pilault Amine Elhattami C. Pal CLL MoE 21 89 0 19 Sep 2020
A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learning Martin Mundt Yongjun Hong Iuliia Pliushch Visvanathan Ramesh CLL 30 146 0 03 Sep 2020
Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semantics V. Ramasesh Ethan Dyer M. Raghu CLL 24 173 0 14 Jul 2020
RATT: Recurrent Attention to Transient Tasks for Continual Image Captioning Riccardo Del Chiaro Bartlomiej Twardowski Andrew D. Bagdanov Joost van de Weijer CLL VLM 22 40 0 13 Jul 2020
Gradient-based Editing of Memory Examples for Online Task-free Continual Learning Xisen Jin Arka Sadhu Junyi Du Xiang Ren CLL KELM BDL 20 95 0 27 Jun 2020
Generalisation Guarantees for Continual Learning with Orthogonal Gradient Descent Mehdi Abbana Bennani Thang Doan Masashi Sugiyama CLL 50 61 0 21 Jun 2020
Self-Supervised Learning Aided Class-Incremental Lifelong Learning Song Zhang Gehui Shen Jinsong Huang Zhihong Deng CLL 25 14 0 10 Jun 2020
Few-Shot Class-Incremental Learning Xiaoyu Tao Xiaopeng Hong Xinyuan Chang Songlin Dong Xing Wei Yihong Gong CLL 30 403 0 23 Apr 2020
Conditional Channel Gated Networks for Task-Aware Continual Learning Davide Abati Jakub M. Tomczak Tijmen Blankevoort Simone Calderara Rita Cucchiara B. Bejnordi CLL 28 184 0 31 Mar 2020
Adversarial Continual Learning Sayna Ebrahimi Franziska Meier Roberto Calandra Trevor Darrell Marcus Rohrbach CLL VLM 152 198 0 21 Mar 2020
Lifelong Learning with Searchable Extension Units Wenjin Wang Yunqing Hu Yin Zhang KELM CLL 11 3 0 19 Mar 2020
Incremental Object Detection via Meta-Learning K. J. Joseph Jathushan Rajasegaran Salman Khan F. Khan V. Balasubramanian ObjD CLL VLM 177 98 0 17 Mar 2020
Federated Continual Learning with Weighted Inter-client Transfer Jaehong Yoon Wonyoung Jeong Giwoong Lee Eunho Yang Sung Ju Hwang FedML 34 199 0 06 Mar 2020
Frosting Weights for Better Continual Training Xiaofeng Zhu Feng Liu Goce Trajcevski Dingding Wang FedML AI4CE CLL 28 5 0 07 Jan 2020
REMIND Your Neural Network to Prevent Catastrophic Forgetting Tyler L. Hayes Kushal Kafle Robik Shrestha Manoj Acharya Christopher Kanan CLL 31 295 0 06 Oct 2019
Continual Learning by Asymmetric Loss Approximation with Single-Side Overestimation Dongmin Park Seokil Hong Bohyung Han Kyoung Mu Lee AAML CLL 18 39 0 08 Aug 2019
Overcoming Catastrophic Forgetting by Neuron-level Plasticity Control Inyoung Paik Sangjun Oh Taeyeong Kwak Injung Kim CLL 29 49 0 31 Jul 2019
Lifelong GAN: Continual Learning for Conditional Image Generation Mengyao Zhai Lei Chen Frederick Tung Jiawei He Megha Nawhal Greg Mori CLL 36 178 0 23 Jul 2019
Uncertainty-guided Continual Learning with Bayesian Neural Networks Sayna Ebrahimi Mohamed Elhoseiny Trevor Darrell Marcus Rohrbach CLL BDL 21 195 0 06 Jun 2019
Uncertainty-based Continual Learning with Adaptive Regularization Hongjoon Ahn Sungmin Cha Donggyu Lee Taesup Moon BDL 19 209 0 28 May 2019
Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning O. Ostapenko M. Puscas T. Klein P. Jähnichen Moin Nabi CLL 60 297 0 05 Apr 2019
Overcoming Catastrophic Forgetting with Unlabeled Data in the Wild Kibok Lee Kimin Lee Jinwoo Shin Honglak Lee CLL 29 201 0 29 Mar 2019
Class-incremental Learning via Deep Model Consolidation Junting Zhang Jie Zhang Shalini Ghosh Dawei Li Serafettin Tasci Larry Heck Heming Zhang C.-C. Jay Kuo CLL 13 333 0 19 Mar 2019
Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference Matthew D Riemer Ignacio Cases R. Ajemian Miao Liu Irina Rish Y. Tu Gerald Tesauro CLL 20 765 0 29 Oct 2018