v1v2 (latest)

Revisiting Supervision for Continual Representation Learning

22 November 2023

Daniel Marczak

Sebastian Cygert

Tomasz Trzciñski

Bartlomiej Twardowski

SSL

CLL

ArXiv (abs)PDF HTML Github (5★)

Papers citing "Revisiting Supervision for Continual Representation Learning"

31 / 31 papers shown

Title
Robust Weight Imprinting: Insights from Neural Collapse and Proxy-Based Aggregation Justus Westerhoff Golzar Atefi Mario Koddenbrock Alexei Figueroa Alexander Loser Erik Rodner Felix Alexader Gers OffRL 102 0 0 18 Mar 2025
On the Stability-Plasticity Dilemma of Class-Incremental Learning Dongwan Kim Bohyung Han CLL 56 51 0 04 Apr 2023
Knowledge Accumulation in Continually Learned Representations and the Issue of Feature Forgetting Timm Hess Eli Verwimp Gido M. van de Ven Tinne Tuytelaars CLL 88 9 0 03 Apr 2023
No Reason for No Supervision: Improved Generalization in Supervised Models Mert Bulent Sariyildiz Yannis Kalantidis Alahari Karteek Diane Larlus SSL OOD LRM 83 29 0 30 Jun 2022
Guillotine Regularization: Why removing layers is needed to improve generalization in Self-Supervised Learning Florian Bordes Randall Balestriero Q. Garrido Adrien Bardes Pascal Vincent 102 24 0 27 Jun 2022
A Closer Look at Rehearsal-Free Continual Learning James Smith Junjiao Tian Shaunak Halbe Yen-Chang Hsu Z. Kira VLM CLL 102 66 0 31 Mar 2022
Continually Learning Self-Supervised Representations with Projected Functional Regularization Alex Gomez-Villa Bartlomiej Twardowski Lu Yu Andrew D. Bagdanov Joost van de Weijer CLL SSL 54 39 0 30 Dec 2021
Self-Supervised Models are Continual Learners Enrico Fini Victor G. Turrisi da Costa Xavier Alameda-Pineda Elisa Ricci Alahari Karteek Julien Mairal BDL CLL SSL 90 166 0 08 Dec 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 120 359 0 18 Oct 2021
Representational Continuity for Unsupervised Continual Learning Divyam Madaan Jaehong Yoon Yuanchun Li Yunxin Liu Sung Ju Hwang CLL SSL 135 117 0 13 Oct 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 735 6,139 0 29 Apr 2021
A Broad Study on the Transferability of Visual Representations with Contrastive Learning Ashraful Islam Chun-Fu Chen Yikang Shen Leonid Karlinsky Richard J. Radke Rogerio Feris SSL 148 115 0 24 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 347 2,368 0 04 Mar 2021
Concept Generalization in Visual Representation Learning Mert Bulent Sariyildiz Yannis Kalantidis Diane Larlus Alahari Karteek SSL 104 50 0 10 Dec 2020
How Well Do Self-Supervised Models Transfer? Linus Ericsson Henry Gouk Timothy M. Hospedales SSL 118 278 0 26 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 258 4,076 0 20 Nov 2020
Class-incremental learning: survey and performance evaluation on image classification Marc Masana Xialei Liu Bartlomiej Twardowski Mikel Menta Andrew D. Bagdanov Joost van de Weijer CLL 79 698 0 28 Oct 2020
Prevalence of Neural Collapse during the terminal phase of deep learning training Vardan Papyan Xuemei Han D. Donoho 216 582 0 18 Aug 2020
What Should Not Be Contrastive in Contrastive Learning Tete Xiao Xiaolong Wang Alexei A. Efros Trevor Darrell SSL DRL 93 303 0 13 Aug 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 408 6,849 0 13 Jun 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 181 4,580 0 23 Apr 2020
Semantic Drift Compensation for Class-Incremental Learning Lu Yu Bartlomiej Twardowski Xialei Liu Luis Herranz Kai Wang Yongmei Cheng Shangling Jui Joost van de Weijer CLL 95 345 0 01 Apr 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 393 18,897 0 13 Feb 2020
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 182 2,412 0 13 Jun 2019
Similarity of Neural Network Representations Revisited Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton 143 1,436 0 01 May 2019
Gradient Episodic Memory for Continual Learning David Lopez-Paz MarcÁurelio Ranzato VLM CLL 133 2,743 0 26 Jun 2017
iCaRL: Incremental Classifier and Representation Learning Sylvestre-Alvise Rebuffi Alexander Kolesnikov G. Sperl Christoph H. Lampert CLL OOD 162 3,784 0 23 Nov 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 313 4,442 0 29 Jun 2016
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,637 0 01 Sep 2014
Describing Textures in the Wild Mircea Cimpoi Subhransu Maji Iasonas Kokkinos S. Mohamed Andrea Vedaldi 3DV 151 2,695 0 14 Nov 2013
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 135 2,272 0 21 Jun 2013