Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning

27 October 2021

Papers citing "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning"

29 / 29 papers shown

Title
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 611 6,029 0 29 Apr 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 270 2,338 0 04 Mar 2021
MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretation Yen Nhi Truong Vu Richard Wang N. Balachandar Can Liu A. Ng Pranav Rajpurkar 52 83 0 21 Feb 2021
Big Self-Supervised Models Advance Medical Image Classification Shekoofeh Azizi Basil Mustafa Fiona Ryan Zach Beaver Jan Freyberg ... Alan Karthikesalingam Simon Kornblith Ting-Li Chen Vivek Natarajan Mohammad Norouzi SSL 103 514 0 13 Jan 2021
Self-Supervision Closes the Gap Between Weak and Strong Supervision in Histology Olivier Dehaene Axel Camara O. Moindrot Axel de Lavergne P. Courtiol 67 71 0 07 Dec 2020
Self supervised contrastive learning for digital histopathology Ozan Ciga Tony Xu Anne L. Martel SSL 148 316 0 27 Nov 2020
MoCo-CXR: MoCo Pretraining Improves Representation and Transferability of Chest X-ray Models Hari Sowrirajan Jingbo Yang A. Ng Pranav Rajpurkar 72 86 0 11 Oct 2020
What is being transferred in transfer learning? Behnam Neyshabur Hanie Sedghi Chiyuan Zhang 81 519 0 26 Aug 2020
Calibration of Neural Networks using Splines Kartik Gupta Amir M. Rahimi Thalaiyasingam Ajanthan Thomas Mensink C. Sminchisescu Leonid Sigal 60 106 0 23 Jun 2020
Contrastive learning of global and local features for medical image segmentation with limited annotations K. Chaitanya Ertunc Erdil Neerav Karani E. Konukoglu SSL 72 551 0 18 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 210 4,065 0 17 Jun 2020
Momentum Contrastive Learning for Few-Shot COVID-19 Diagnosis from Chest CT Images Xiaocong Chen Lina Yao Tao Zhou Jinming Dong Yu Zhang 55 170 0 16 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 325 6,773 0 13 Jun 2020
CheXclusion: Fairness gaps in deep chest X-ray classifiers Laleh Seyyed-Kalantari Guanxiong Liu Matthew B. A. McDermott Irene Y. Chen Marzyeh Ghassemi OOD 78 291 0 14 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 317 18,686 0 13 Feb 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 155 12,050 0 13 Nov 2019
Similarity of Neural Network Representations Revisited Simon Kornblith Mohammad Norouzi Honglak Lee Geoffrey E. Hinton 136 1,408 0 01 May 2019
A critical analysis of self-supervision, or what we can learn from a single image Yuki M. Asano Christian Rupprecht Andrea Vedaldi SSL 64 146 0 30 Apr 2019
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 282 2,661 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 278 10,253 0 10 Jul 2018
DARTS: Differentiable Architecture Search Hanxiao Liu Karen Simonyan Yiming Yang 185 4,345 0 24 Jun 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 168 3,450 0 05 May 2018
Regularizing Deep Networks by Modeling and Predicting Label Structure Mohammadreza Mostajabi Michael Maire Gregory Shakhnarovich NoLa 66 32 0 05 Apr 2018
ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases Xiaosong Wang Yifan Peng Le Lu Zhiyong Lu M. Bagheri Ronald M. Summers LM&MA 146 2,521 0 05 May 2017
Pyramid Scene Parsing Network Hengshuang Zhao Jianping Shi Xiaojuan Qi Xiaogang Wang Jiaya Jia VOS SSeg 509 11,984 0 04 Dec 2016
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles M. Noroozi Paolo Favaro SSL 154 2,978 0 30 Mar 2016
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 122 3,530 0 28 Mar 2016
Unsupervised Visual Representation Learning by Context Prediction Carl Doersch Abhinav Gupta Alexei A. Efros DRL SSL 164 2,782 0 19 May 2015
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 390 43,589 0 17 Sep 2014