BiRT: Bio-inspired Replay in Vision Transformers for Continual Learning

8 May 2023

Kishaan Jeeveswaran

Prashant Shivaram Bhat

Papers citing "BiRT: Bio-inspired Replay in Vision Transformers for Continual Learning"

30 / 30 papers shown

Title
Consistency is the key to further mitigating catastrophic forgetting in continual learning Prashant Shivaram Bhat Bahram Zonooz Elahe Arani CLL 56 17 0 11 Jul 2022
Continual Learning with Transformers for Image Classification Beyza Ermis Giovanni Zappella Martin Wistuba Aditya Rawal Cédric Archambeau CLL 74 21 0 28 Jun 2022
SYNERgy between SYNaptic consolidation and Experience Replay for general continual learning F. Sarfraz Elahe Arani Bahram Zonooz CLL 59 13 0 08 Jun 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 117 501 0 10 Apr 2022
Towards Exemplar-Free Continual Learning in Vision Transformers: an Account of Attention, Functional and Weight Regularization Francesco Pelosin Saurav Jha A. Torsello Bogdan Raducanu Joost van de Weijer CLL 52 31 0 24 Mar 2022
R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learning Qiankun Gao Chen Zhao Guohao Li Jian Zhang CLL 61 70 0 24 Mar 2022
Robust Training under Label Noise by Over-parameterization Sheng Liu Zhihui Zhu Qing Qu Chong You NoLa OOD 68 109 0 28 Feb 2022
A Comprehensive Study of Vision Transformers on Dense Prediction Tasks Kishaan Jeeveswaran Senthilkumar S. Kathiresan Arnav Varma Omar Magdy Bahram Zonooz Elahe Arani ViT 39 10 0 21 Jan 2022
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 103 794 0 16 Dec 2021
Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learning James Smith Yen-Chang Hsu John C. Balloch Yilin Shen Hongxia Jin Z. Kira CLL 106 168 0 17 Jun 2021
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases Stéphane dÁscoli Hugo Touvron Matthew L. Leavitt Ari S. Morcos Giulio Biroli Levent Sagun ViT 136 834 0 19 Mar 2021
Online Continual Learning in Image Classification: An Empirical Survey Zheda Mai Ruiwen Li Jihwan Jeong David Quispe Hyunwoo J. Kim Scott Sanner VLM CLL 98 418 0 25 Jan 2021
Class-incremental learning: survey and performance evaluation on image classification Marc Masana Xialei Liu Bartlomiej Twardowski Mikel Menta Andrew D. Bagdanov Joost van de Weijer CLL 79 695 0 28 Oct 2020
Remembering for the Right Reasons: Explanations Reduce Catastrophic Forgetting Sayna Ebrahimi Suzanne Petryk Akash Gokul William Gan Joseph E. Gonzalez Marcus Rohrbach Trevor Darrell CLL 68 47 0 04 Oct 2020
Torchattacks: A PyTorch Repository for Adversarial Attacks Hoki Kim 71 207 0 24 Sep 2020
Memory-Efficient Incremental Learning Through Feature Adaptation Ahmet Iscen Jeffrey O. Zhang Svetlana Lazebnik Cordelia Schmid CLL VLM 45 164 0 01 Apr 2020
Continuous Domain Adaptation with Variational Domain-Agnostic Feature Replay Qicheng Lao Xiang Jiang Mohammad Havaei Yoshua Bengio VLM 58 33 0 09 Mar 2020
Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion Hongxu Yin Pavlo Molchanov Zhizhong Li J. Álvarez Arun Mallya Derek Hoiem N. Jha Jan Kautz 81 569 0 18 Dec 2019
REMIND Your Neural Network to Prevent Catastrophic Forgetting Tyler L. Hayes Kushal Kafle Robik Shrestha Manoj Acharya Christopher Kanan CLL 120 300 0 06 Oct 2019
Three scenarios for continual learning Gido M. van de Ven A. Tolias CLL 99 895 0 15 Apr 2019
Scalable and Order-robust Continual Learning with Additive Parameter Decomposition Jaehong Yoon Saehoon Kim Eunho Yang Sung Ju Hwang CLL 73 177 0 25 Feb 2019
Towards Robust Evaluations of Continual Learning Sebastian Farquhar Y. Gal CLL 93 308 0 24 May 2018
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence Arslan Chaudhry P. Dokania Thalaiyasingam Ajanthan Philip Torr CLL 105 1,145 0 30 Jan 2018
FearNet: Brain-Inspired Model for Incremental Learning Ronald Kemker Christopher Kanan CLL 120 480 0 28 Nov 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 131 2,738 0 26 Jun 2017
PathNet: Evolution Channels Gradient Descent in Super Neural Networks Chrisantha Fernando Dylan Banarse Charles Blundell Yori Zwols David R Ha Andrei A. Rusu Alexander Pritzel Daan Wierstra 75 881 0 30 Jan 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 374 7,572 0 02 Dec 2016
Expert Gate: Lifelong Learning with a Network of Experts Rahaf Aljundi Punarjay Chakravarty Tinne Tuytelaars CLL 93 662 0 18 Nov 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 308 4,432 0 29 Jun 2016
Progressive Neural Networks Andrei A. Rusu Neil C. Rabinowitz Guillaume Desjardins Hubert Soyer J. Kirkpatrick Koray Kavukcuoglu Razvan Pascanu R. Hadsell CLL AI4CE 81 2,464 0 15 Jun 2016