Overcoming catastrophic forgetting with hard attention to the task

4 January 2018

Joan Serrà

Dídac Surís

M. Miron

Alexandros Karatzoglou

CLL

ArXiv PDF HTML

Papers citing "Overcoming catastrophic forgetting with hard attention to the task"

50 / 203 papers shown

Title
An Exploration of Data Efficiency in Intra-Dataset Task Transfer for Dialog Understanding Josiah Ross Luke Yoffe Alon Albalak William Yang Wang 30 0 0 21 Oct 2022
Continual Learning by Modeling Intra-Class Variation L. Yu Tianyang Hu Lanqing Hong Zhen Liu Adrian Weller Weiyang Liu CLL 48 12 0 11 Oct 2022
Efficient Meta-Learning for Continual Learning with Taylor Expansion Approximation Xiaohan Zou Tong Lin CLL 21 2 0 03 Oct 2022
Multiple Modes for Continual Learning Siddhartha Datta N. Shadbolt CLL MoMe 45 2 0 29 Sep 2022
Learn the Time to Learn: Replay Scheduling in Continual Learning Marcus Klasson Hedvig Kjellström Chen Zhang CLL 21 9 0 18 Sep 2022
A Multi-Head Model for Continual Learning via Out-of-Distribution Replay Gyuhak Kim Zixuan Ke Bin Liu VLM CLL OODD 17 29 0 20 Aug 2022
On the Limitations of Continual Learning for Malware Classification Mohammad Saidur Rahman Scott E. Coull M. Wright 26 13 0 13 Aug 2022
S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learning Yabin Wang Zhiwu Huang Xiaopeng Hong CLL VLM 27 208 0 26 Jul 2022
UC-OWOD: Unknown-Classified Open World Object Detection Zhi-zong Wu Yue Lu Xingyu Chen Zhengxing Wu Liwen Kang Junzhi Yu 17 55 0 23 Jul 2022
AdaptCL: Adaptive Continual Learning for Tackling Heterogeneity in Sequential Datasets Yuqing Zhao Divya Saxena Jiannong Cao CLL 18 12 0 22 Jul 2022
Don't Stop Learning: Towards Continual Learning for the CLIP Model Yuxuan Ding Lingqiao Liu Chunna Tian Jingyuan Yang Haoxuan Ding CLL VLM KELM 19 51 0 19 Jul 2022
Incremental Task Learning with Incremental Rank Updates Rakib Hyder Ken Shao Boyu Hou P. Markopoulos Ashley Prater-Bennette M. Salman Asif CLL 16 13 0 19 Jul 2022
How to Reuse and Compose Knowledge for a Lifetime of Tasks: A Survey on Continual Learning and Functional Composition Jorge Armando Mendez Mendez Eric Eaton KELM CLL 29 27 0 15 Jul 2022
E2-AEN: End-to-End Incremental Learning with Adaptively Expandable Network Guimei Cao Zhanzhan Cheng Yunlu Xu Duo Li Shiliang Pu Yi Niu Fei Wu CLL 20 2 0 14 Jul 2022
Reactive Exploration to Cope with Non-Stationarity in Lifelong Reinforcement Learning C. Steinparz Thomas Schmied Fabian Paischer Marius-Constantin Dinu Vihang Patil Angela Bitto-Nemling Hamid Eghbalzadeh Sepp Hochreiter CLL 24 11 0 12 Jul 2022
A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learning Da-Wei Zhou Qiwen Wang Han-Jia Ye De-Chuan Zhan 26 122 0 26 May 2022
Rethinking Task-Incremental Learning Baselines Md. Rejwanul Hossain P. Saha T. Chowdhury Shafin Rahman Fuad Rahman Nabeel Mohammed CLL 27 5 0 23 May 2022
Memory-efficient Reinforcement Learning with Value-based Knowledge Consolidation Qingfeng Lan Yangchen Pan Jun Luo A. R. Mahmood OffRL 24 6 0 22 May 2022
Explain to Not Forget: Defending Against Catastrophic Forgetting with XAI Sami Ede Serop Baghdadlian Leander Weber A. Nguyen Dario Zanca Wojciech Samek Sebastian Lapuschkin CLL 27 6 0 04 May 2022
CFA: Constraint-based Finetuning Approach for Generalized Few-Shot Object Detection Karim Guirguis Ahmed Hendawy George Eskandar Mohamed Abdelsamad Matthias Kayser Jürgen Beyerer 19 15 0 11 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 36 455 0 10 Apr 2022
Re-examining Distillation For Continual Object Detection Eli Verwimp Kuo Yang Sarah Parisot Hong Lanqing Steven G. McDonagh Eduardo Pérez-Pellitero Matthias De Lange Tinne Tuytelaars VLM 24 6 0 04 Apr 2022
Continual Normalization: Rethinking Batch Normalization for Online Continual Learning Quang-Cuong Pham Chenghao Liu S. Hoi BDL OnRL 38 57 0 30 Mar 2022
Energy-based Latent Aligner for Incremental Learning K. J. Joseph Salman Khan F. Khan Rao Muhammad Anwer V. Balasubramanian CLL 33 46 0 28 Mar 2022
Meta-attention for ViT-backed Continual Learning Mengqi Xue Haofei Zhang Jie Song Mingli Song CLL 22 41 0 22 Mar 2022
Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signals Timo Flesch D. G. Nagy Andrew M. Saxe Christopher Summerfield 26 34 0 22 Mar 2022
Incremental Few-Shot Learning via Implanting and Compressing Yiting Li H. Zhu Xijia Feng Zilong Cheng Jun Ma Cheng Xiang P. Vadakkepat T. Lee CLL VLM 21 2 0 19 Mar 2022
AI Autonomy : Self-Initiated Open-World Continual Learning and Adaptation Bing-Quan Liu Sahisnu Mazumder Eric Robertson Scott Grigsby CLL AI4CE 30 21 0 17 Mar 2022
ConTinTin: Continual Learning from Task Instructions Wenpeng Yin Jia Li Caiming Xiong CLL 21 29 0 16 Mar 2022
Continual Learning with Invertible Generative Models Jary Pomponi Simone Scardapane A. Uncini BDL 48 4 0 11 Feb 2022
Fortuitous Forgetting in Connectionist Networks Hattie Zhou Ankit Vani Hugo Larochelle Aaron Courville CLL 16 42 0 01 Feb 2022
Class-Incremental Continual Learning into the eXtended DER-verse Matteo Boschini Lorenzo Bonicelli Pietro Buzzega Angelo Porrello Simone Calderara CLL BDL 26 128 0 03 Jan 2022
Relational Experience Replay: Continual Learning by Adaptively Tuning Task-wise Relationship Quanziang Wang Renzhen Wang Yuexiang Li Dong Wei Kai Ma Yefeng Zheng Deyu Meng CLL 31 6 0 31 Dec 2021
Continual Learning with Knowledge Transfer for Sentiment Classification Zixuan Ke Bing-Quan Liu Hao Wang Lei Shu CLL 19 30 0 18 Dec 2021
Self-Supervised Models are Continual Learners Enrico Fini Victor G. Turrisi da Costa Xavier Alameda-Pineda Elisa Ricci Alahari Karteek Julien Mairal BDL CLL SSL 38 158 0 08 Dec 2021
Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks Zixuan Ke Hu Xu Bing-Quan Liu CLL 240 83 0 06 Dec 2021
CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks Zixuan Ke Bing-Quan Liu Hu Xu Lei Shu CLL 31 55 0 05 Dec 2021
Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning Zixuan Ke Bing-Quan Liu Nianzu Ma Hu Xu Lei Shu CLL 189 122 0 05 Dec 2021
Non-IID data and Continual Learning processes in Federated Learning: A long road ahead Marcos F. Criado F. Casado R. Iglesias Carlos V. Regueiro S. Barro FedML 36 76 0 26 Nov 2021
DyTox: Transformers for Continual Learning with DYnamic TOken eXpansion Arthur Douillard Alexandre Ramé Guillaume Couairon Matthieu Cord CLL 30 295 0 22 Nov 2021
HCV: Hierarchy-Consistency Verification for Incremental Implicitly-Refined Classification Kai Wang Xialei Liu Luis Herranz Joost van de Weijer CLL 19 4 0 21 Oct 2021
Towards Better Plasticity-Stability Trade-off in Incremental Learning: A Simple Linear Connector Guoliang Lin Hanlu Chu Hanjiang Lai MoMe CLL 29 43 0 15 Oct 2021
Avoiding Forgetting and Allowing Forward Transfer in Continual Learning via Sparse Networks Ghada Sokar D. Mocanu Mykola Pechenizkiy CLL 32 8 0 11 Oct 2021
Powerpropagation: A sparsity inducing weight reparameterisation Jonathan Richard Schwarz Siddhant M. Jayakumar Razvan Pascanu P. Latham Yee Whye Teh 90 54 0 01 Oct 2021
DualNet: Continual Learning, Fast and Slow Quang-Cuong Pham Chenghao Liu S. Hoi CLL 71 42 0 01 Oct 2021
Recent Advances of Continual Learning in Computer Vision: An Overview Haoxuan Qu Hossein Rahmani Li Xu Bryan M. Williams Jun Liu VLM CLL 25 73 0 23 Sep 2021
Total Recall: a Customized Continual Learning Method for Neural Semantic Parsers Zhuang Li Lizhen Qu Gholamreza Haffari CLL 32 15 0 11 Sep 2021
Saliency Guided Experience Packing for Replay in Continual Learning Gobinda Saha Kaushik Roy VLM KELM CLL 94 21 0 10 Sep 2021
Complementary Calibration: Boosting General Continual Learning with Collaborative Distillation and Self-Supervision Zhong Ji Jin Li Qiang Wang Zhongfei Zhang CLL 25 18 0 03 Sep 2021
Online Continual Learning with Natural Distribution Shifts: An Empirical Study with Visual Data Zhipeng Cai Ozan Sener V. Koltun CLL 20 83 0 20 Aug 2021