Online Continual Learning with Contrastive Vision Transformer

24 July 2022

Papers citing "Online Continual Learning with Contrastive Vision Transformer"

28 / 28 papers shown

Title
DualNet: Continual Learning, Fast and Slow Quang Pham Chenghao Liu Guosheng Lin CLL 116 45 0 01 Oct 2021
CoAtNet: Marrying Convolution and Attention for All Data Sizes Zihang Dai Hanxiao Liu Quoc V. Le Mingxing Tan ViT 102 1,196 0 09 Jun 2021
Layerwise Optimization by Gradient Decomposition for Continual Learning Shixiang Tang Dapeng Chen Jinguo Zhu Shijie Yu Wanli Ouyang CLL 54 65 0 17 May 2021
On Learning the Geodesic Path for Incremental Learning Christian Simon Piotr Koniusz Mehrtash Harandi CLL 55 121 0 17 Apr 2021
Escaping the Big Data Paradigm with Compact Transformers Ali Hassani Steven Walton Nikhil Shah Abulikemu Abuduweili Jiachen Li Humphrey Shi 110 462 0 12 Apr 2021
CvT: Introducing Convolutions to Vision Transformers Haiping Wu Bin Xiao Noel Codella Mengchen Liu Xiyang Dai Lu Yuan Lei Zhang ViT 128 1,901 0 29 Mar 2021
Scaling Local Self-Attention for Parameter Efficient Visual Backbones Ashish Vaswani Prajit Ramachandran A. Srinivas Niki Parmar Blake A. Hechtman Jonathon Shlens 85 398 0 23 Mar 2021
Supervised Contrastive Replay: Revisiting the Nearest Class Mean Classifier in Online Class-Incremental Continual Learning Zheda Mai Ruiwen Li Hyunwoo J. Kim Scott Sanner CLL 65 185 0 22 Mar 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir Fahad Shahbaz Khan M. Shah ViT 270 2,492 0 04 Jan 2021
Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning Beliz Gunel Jingfei Du Alexis Conneau Ves Stoyanov 58 505 0 03 Nov 2020
Rethinking Experience Replay: a Bag of Tricks for Continual Learning Pietro Buzzega Matteo Boschini Angelo Porrello Simone Calderara CLL 43 150 0 12 Oct 2020
Gradient-based Editing of Memory Examples for Online Task-free Continual Learning Xisen Jin Arka Sadhu Junyi Du Xiang Ren CLL KELM BDL 54 96 0 27 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 213 4,070 0 17 Jun 2020
Supervised Contrastive Learning Prannay Khosla Piotr Teterwak Chen Wang Aaron Sarna Yonglong Tian Phillip Isola Aaron Maschinot Ce Liu Dilip Krishnan SSL 139 4,532 0 23 Apr 2020
Dark Experience for General Continual Learning: a Strong, Simple Baseline Pietro Buzzega Matteo Boschini Angelo Porrello Davide Abati Simone Calderara BDL CLL 72 909 0 15 Apr 2020
Semantic Drift Compensation for Class-Incremental Learning Lu Yu Bartlomiej Twardowski Xialei Liu Luis Herranz Kai Wang Yongmei Cheng Shangling Jui Joost van de Weijer CLL 76 341 0 01 Apr 2020
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 153 2,395 0 13 Jun 2019
Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting Xilai Li Yingbo Zhou Tianfu Wu R. Socher Caiming Xiong CLL 68 428 0 31 Mar 2019
Video Action Transformer Network Rohit Girdhar João Carreira Carl Doersch Andrew Zisserman ViT 124 708 0 06 Dec 2018
Efficient Lifelong Learning with A-GEM Arslan Chaudhry MarcÁurelio Ranzato Marcus Rohrbach Mohamed Elhoseiny CLL 188 1,449 0 02 Dec 2018
Measuring and regularizing networks in function space Ari S. Benjamin David Rolnick Konrad Paul Kording 40 139 0 21 May 2018
Progress & Compress: A scalable framework for continual learning Jonathan Richard Schwarz Jelena Luketina Wojciech M. Czarnecki A. Grabska-Barwinska Yee Whye Teh Razvan Pascanu R. Hadsell CLL 108 886 0 16 May 2018
Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence Arslan Chaudhry P. Dokania Thalaiyasingam Ajanthan Philip Torr CLL 89 1,137 0 30 Jan 2018
Memory Aware Synapses: Learning what (not) to forget Rahaf Aljundi F. Babiloni Mohamed Elhoseiny Marcus Rohrbach Tinne Tuytelaars KELM CLL 83 1,628 0 27 Nov 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 317 7,478 0 02 Dec 2016
Expert Gate: Lifelong Learning with a Network of Experts Rahaf Aljundi Punarjay Chakravarty Tinne Tuytelaars CLL 75 658 0 18 Nov 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 282 4,391 0 29 Jun 2016
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 354 7,955 0 17 Aug 2015