How Well Do Self-Supervised Models Transfer?

26 November 2020

Linus Ericsson

Henry Gouk

Timothy M. Hospedales

SSL

ArXiv PDF HTML

Papers citing "How Well Do Self-Supervised Models Transfer?"

50 / 53 papers shown

Title
Implicit Contrastive Representation Learning with Guided Stop-gradient Byeongchan Lee Sehyun Lee SSL 205 2 0 12 Mar 2025
How Well Do Self-Supervised Methods Perform in Cross-Domain Few-Shot Learning? Yiyi Zhang Ying Zheng Xiaogang Xu Jun Wang SSL 84 4 0 28 Jan 2025
Self-supervised Benchmark Lottery on ImageNet: Do Marginal Improvements Translate to Improvements on Similar Datasets? Utku Ozbulak Esla Timothy Anzaku Solha Kang W. D. Neve J. Vankerschaver 96 0 0 28 Jan 2025
A Survey of the Self Supervised Learning Mechanisms for Vision Transformers Asifullah Khan A. Sohail Mustansar Fiaz Mehdi Hassan Tariq Habib Afridi ... Muhammad Zaigham Zaheer Kamran Ali Tangina Sultana Ziaurrehman Tanoli Naeem Akhter 164 4 0 30 Aug 2024
Understanding Self-supervised Learning with Dual Deep Networks Yuandong Tian Lantao Yu Xinlei Chen Surya Ganguli SSL 49 80 0 01 Oct 2020
Online Deep Clustering for Unsupervised Representation Learning Xiaohang Zhan Jiahao Xie Ziwei Liu Yew-Soon Ong Chen Change Loy OOD 84 186 0 18 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 210 4,065 0 17 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 121 1,612 0 15 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 325 6,773 0 13 Jun 2020
What makes instance discrimination good for transfer learning? Nanxuan Zhao Zhirong Wu Rynson W. H. Lau Stephen Lin SSL 67 170 0 11 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 84 1,323 0 20 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 129 971 0 11 May 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 443 3,422 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 312 18,686 0 13 Feb 2020
Impact of ImageNet Model Selection on Domain Adaptation Youshan Zhang Brian D. Davison FAtt OOD VLM 87 34 0 06 Feb 2020
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 90 1,451 0 04 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 342 42,299 0 03 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 153 12,050 0 13 Nov 2019
Self-labelling via simultaneous clustering and representation learning Yuki M. Asano Christian Rupprecht Andrea Vedaldi SSL 98 770 0 13 Nov 2019
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Xiaohua Zhai J. Puigcerver Alexander Kolesnikov P. Ruyssen C. Riquelme ... Michael Tschannen Marcin Michalski Olivier Bousquet Sylvain Gelly N. Houlsby SSL 71 438 0 01 Oct 2019
Fairness in Deep Learning: A Computational Perspective Mengnan Du Fan Yang Na Zou Xia Hu FaML FedML 46 230 0 23 Aug 2019
Green AI Roy Schwartz Jesse Dodge Noah A. Smith Oren Etzioni 100 1,134 0 22 Jul 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 151 2,395 0 13 Jun 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 103 1,427 0 22 May 2019
Scaling and Benchmarking Self-Supervised Visual Representation Learning Priya Goyal D. Mahajan Abhinav Gupta Ishan Misra SSL 54 397 0 03 May 2019
Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey Longlong Jing Yingli Tian SSL 108 1,697 0 16 Feb 2019
Transfusion: Understanding Transfer Learning for Medical Imaging M. Raghu Chiyuan Zhang Jon M. Kleinberg Samy Bengio MedIm 68 982 0 14 Feb 2019
Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC) Noel Codella V. Rotemberg P. Tschandl M. E. Celebi Stephen W. Dusza ... Aadi Kalloo Konstantinos Liopyris Michael Marchetti Harald Kittler Allan Halpern 88 1,184 0 09 Feb 2019
Revisiting Self-Supervised Visual Representation Learning Alexander Kolesnikov Xiaohua Zhai Lucas Beyer SSL 129 716 0 25 Jan 2019
Rethinking ImageNet Pre-training Kaiming He Ross B. Girshick Piotr Dollár VLM SSeg 118 1,083 0 21 Nov 2018
Unified Perceptual Parsing for Scene Understanding Tete Xiao Yingcheng Liu Bolei Zhou Yuning Jiang Jian Sun OCL VOS 153 1,871 0 26 Jul 2018
Deep Clustering for Unsupervised Learning of Visual Features Mathilde Caron Piotr Bojanowski Armand Joulin Matthijs Douze SSL 88 1,890 0 15 Jul 2018
Do Better ImageNet Models Transfer Better? Simon Kornblith Jonathon Shlens Quoc V. Le OOD MLT 148 1,324 0 23 May 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 166 3,450 0 05 May 2018
Toward Scalable Verification for Safety-Critical Deep Networks L. Kuper Guy Katz Justin Emile Gottschlich Kyle D. Julian Clark W. Barrett Mykel Kochenderfer 86 40 0 18 Jan 2018
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Y. Zhang Phillip Isola Alexei A. Efros Eli Shechtman Oliver Wang EGVM 327 11,734 0 11 Jan 2018
Deep Image Prior Dmitry Ulyanov Andrea Vedaldi Victor Lempitsky SupR 112 3,147 0 29 Nov 2017
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification P. Helber B. Bischke Andreas Dengel Damian Borth 120 1,806 0 31 Aug 2017
On Calibration of Modern Neural Networks Chuan Guo Geoff Pleiss Yu Sun Kilian Q. Weinberger UQCV 235 5,812 0 14 Jun 2017
Prototypical Networks for Few-shot Learning Jake C. Snell Kevin Swersky R. Zemel 265 8,114 0 15 Mar 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 113 2,569 0 12 Dec 2016
Feature Pyramid Networks for Object Detection Nayeon Lee Piotr Dollár Ross B. Girshick Kaiming He Bharath Hariharan Serge J. Belongie ObjD 437 22,040 0 09 Dec 2016
Pyramid Scene Parsing Network Hengshuang Zhao Jianping Shi Xiaojuan Qi Xiaogang Wang Jiaya Jia VOS SSeg 504 11,984 0 04 Dec 2016
Semantic Understanding of Scenes through the ADE20K Dataset Bolei Zhou Hang Zhao Xavier Puig Tete Xiao Sanja Fidler Adela Barriuso Antonio Torralba SSeg 364 1,865 0 18 Aug 2016
Using Deep Learning for Image-Based Plant Disease Detection Sharada Mohanty David P. Hughes M. Salathé 39 3,106 0 11 Apr 2016
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles M. Noroozi Paolo Favaro SSL 152 2,978 0 30 Mar 2016
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 122 3,530 0 28 Mar 2016
Learning Representations for Automatic Colorization Gustav Larsson Michael Maire Gregory Shakhnarovich VLM SSL 81 1,012 0 22 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.8K 193,426 0 10 Dec 2015
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren Kaiming He Ross B. Girshick Jian Sun AIMat ObjD 452 62,122 0 04 Jun 2015