Self-Supervised Training Enhances Online Continual Learning

25 March 2021

Papers citing "Self-Supervised Training Enhances Online Continual Learning"

50 / 62 papers shown

Title
CLDyB: Towards Dynamic Benchmarking for Continual Learning with Pre-trained Models Shengzhuang Chen Yikai Liao Xiaoxiao Sun Kede Ma Ying Wei 87 0 0 06 Mar 2025
ScaleNet: An Unsupervised Representation Learning Method for Limited Information Huili Huang M. M. Roozbahani SSL 66 806 0 03 Oct 2023
Replay in Deep Learning: Current Approaches and Missing Biological Elements Tyler L. Hayes G. Krishnan M. Bazhenov H. Siegelmann T. Sejnowski Christopher Kanan CLL 55 129 0 01 Apr 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 177 2,321 0 04 Mar 2021
How Well Do Self-Supervised Models Transfer? Linus Ericsson Henry Gouk Timothy M. Hospedales SSL 70 275 0 26 Nov 2020
A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks Eden Belouadah Adrian Daniel Popescu Ioannis Kanellos CLL 34 215 0 03 Nov 2020
RODEO: Replay for Online Object Detection Manoj Acharya Tyler L. Hayes Christopher Kanan ObjD CLL 36 46 0 14 Aug 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 78 4,032 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 231 6,718 0 13 Jun 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 100 965 0 11 May 2020
Few-Shot Class-Incremental Learning Xiaoyu Tao Xiaopeng Hong Xinyuan Chang Songlin Dong Xing Wei Yihong Gong CLL 61 408 0 23 Apr 2020
How Useful is Self-Supervised Pretraining for Visual Tasks? Alejandro Newell Jia Deng SSL 35 136 0 31 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 405 3,397 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 142 18,523 0 13 Feb 2020
Modeling the Background for Incremental Learning in Semantic Segmentation Fabio Cermelli Massimiliano Mancini Samuel Rota Buló Elisa Ricci Barbara Caputo CLL VLM 28 279 0 03 Feb 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 75 11,959 0 13 Nov 2019
REMIND Your Neural Network to Prevent Catastrophic Forgetting Tyler L. Hayes Kushal Kafle Robik Shrestha Manoj Acharya Christopher Kanan CLL 91 297 0 06 Oct 2019
A continual learning survey: Defying forgetting in classification tasks Matthias De Lange Rahaf Aljundi Marc Masana Sarah Parisot Xu Jia A. Leonardis Greg Slabaugh Tinne Tuytelaars CLL KELM 20 246 0 18 Sep 2019
Lifelong Machine Learning with Deep Streaming Linear Discriminant Analysis Tyler L. Hayes Christopher Kanan CLL 31 142 0 04 Sep 2019
Incremental Learning Techniques for Semantic Segmentation Umberto Michieli Pietro Zanuttigh SSeg CLL VLM 69 234 0 31 Jul 2019
Growing a Brain: Fine-Tuning by Increasing Model Capacity Yu-Xiong Wang Deva Ramanan M. Hebert CLL 34 149 0 18 Jul 2019
Continual Learning for Robotics: Definition, Framework, Learning Strategies, Opportunities and Challenges Timothée Lesort Vincenzo Lomonaco Andrei Stoian Davide Maltoni David Filliat Natalia Díaz Rodríguez CLL 45 249 0 29 Jun 2019
Large Scale Incremental Learning Yue Wu Yinpeng Chen Lijuan Wang Yuancheng Ye Zicheng Liu Yandong Guo Y. Fu CLL 70 1,241 0 30 May 2019
Class-incremental Learning via Deep Model Consolidation Junting Zhang Jie Zhang Shalini Ghosh Dawei Li Serafettin Tasci Larry Heck Heming Zhang C.-C. Jay Kuo CLL 29 336 0 19 Mar 2019
Selective Kernel Networks Xiang Li Wenhai Wang Xiaolin Hu Jian Yang 58 2,015 0 15 Mar 2019
Efficient Lifelong Learning with A-GEM Arslan Chaudhry MarcÁurelio Ranzato Marcus Rohrbach Mohamed Elhoseiny CLL 147 1,438 0 02 Dec 2018
Learning without Memorizing Prithviraj Dhar Rajat Vikram Singh Kuan-Chuan Peng Ziyan Wu Rama Chellappa CLL 43 476 0 20 Nov 2018
Memory Efficient Experience Replay for Streaming Learning Tyler L. Hayes N. Cahill Christopher Kanan 24 229 0 16 Sep 2018
DeeSIL: Deep-Shallow Incremental Learning Eden Belouadah Adrian Daniel Popescu CLL 63 73 0 20 Aug 2018
End-to-End Incremental Learning F. M. Castro M. Marín-Jiménez Nicolás Guil Mata Cordelia Schmid Alahari Karteek CLL 63 1,149 0 25 Jul 2018
A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks Kimin Lee Kibok Lee Honglak Lee Jinwoo Shin OODD 81 2,024 0 10 Jul 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 191 10,152 0 10 Jul 2018
Online Structured Laplace Approximations For Overcoming Catastrophic Forgetting H. Ritter Aleksandar Botev David Barber BDL CLL 61 329 0 20 May 2018
Efficient parametrization of multi-domain deep neural networks Sylvestre-Alvise Rebuffi Hakan Bilen Andrea Vedaldi OOD 50 363 0 27 Mar 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 163 3,272 0 21 Mar 2018
Continual Lifelong Learning with Neural Networks: A Review G. I. Parisi Ronald Kemker Jose L. Part Christopher Kanan S. Wermter KELM CLL 103 2,854 0 21 Feb 2018
Tree-CNN: A Hierarchical Deep Convolutional Neural Network for Incremental Learning Deboleena Roy Priyadarshini Panda Kaushik Roy BDL OOD CLL 39 212 0 15 Feb 2018
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence Arslan Chaudhry P. Dokania Thalaiyasingam Ajanthan Philip Torr CLL 56 1,130 0 30 Jan 2018
Overcoming catastrophic forgetting with hard attention to the task Joan Serrà Dídac Surís M. Miron Alexandros Karatzoglou CLL 70 1,061 0 04 Jan 2018
FearNet: Brain-Inspired Model for Incremental Learning Ronald Kemker Christopher Kanan CLL 68 476 0 28 Nov 2017
Memory Aware Synapses: Learning what (not) to forget Rahaf Aljundi F. Babiloni Mohamed Elhoseiny Marcus Rohrbach Tinne Tuytelaars KELM CLL 66 1,613 0 27 Nov 2017
PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruning Arun Mallya Svetlana Lazebnik CLL 77 1,284 0 15 Nov 2017
Incremental Learning of Object Detectors without Catastrophic Forgetting K. Shmelkov Cordelia Schmid Alahari Karteek ObjD 43 515 0 23 Aug 2017
Measuring Catastrophic Forgetting in Neural Networks Ronald Kemker Marc McClure Angelina Abitino Tyler L. Hayes Christopher Kanan CLL 81 713 0 07 Aug 2017
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 60 2,684 0 26 Jun 2017
Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks Shiyu Liang Yixuan Li R. Srikant UQCV OODD 84 2,046 0 08 Jun 2017
Joint Geometrical and Statistical Alignment for Visual Domain Adaptation Jing Zhang W. Li P. Ogunbona 36 498 0 16 May 2017
Incremental Learning Through Deep Adaptation Amir Rosenfeld John K. Tsotsos CLL 31 276 0 11 May 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 194 7,410 0 02 Dec 2016
iCaRL: Incremental Classifier and Representation Learning Sylvestre-Alvise Rebuffi Alexander Kolesnikov G. Sperl Christoph H. Lampert CLL OOD 78 3,713 0 23 Nov 2016