Pushing the limits of self-supervised ResNets: Can we outperform supervised learning without labels on ImageNet?

13 January 2022

Papers citing "Pushing the limits of self-supervised ResNets: Can we outperform supervised learning without labels on ImageNet?"

28 / 28 papers shown

Title
A Fused Gromov-Wasserstein Approach to Subgraph Contrastive Learning Amadou S. Sangare Nicolas Dunou Jhony H. Giraldo Fragkiskos D. Malliaros SSL 62 0 0 28 Feb 2025
A Review on Discriminative Self-supervised Learning Methods in Computer Vision Nikolaos Giakoumoglou Tania Stathaki Athanasios Gkelias SSL 64 1 0 08 May 2024
Incorporating simulated spatial context information improves the effectiveness of contrastive learning models Lizhen Zhu James Z. Wang Wonseuk Lee Bradley P. Wyble 40 2 0 26 Jan 2024
Enhancing Contrastive Learning with Efficient Combinatorial Positive Pairing Jaeill Kim Duhun Hwang Eunjung Lee Jangwon Suh Jimyeong Kim Wonjong Rhee 33 0 0 11 Jan 2024
Splicing Up Your Predictions with RNA Contrastive Learning Phil Fradkin Ruian Shi Bo Wang Brendan Frey Leo J. Lee SSL 26 0 0 12 Oct 2023
MC-JEPA: A Joint-Embedding Predictive Architecture for Self-Supervised Learning of Motion and Content Features Adrien Bardes Jean Ponce Yann LeCun MDE 33 23 0 24 Jul 2023
Interventional Bag Multi-Instance Learning On Whole-Slide Pathological Images Tiancheng Lin Zhimiao Yu Hongyu Hu Yi Xu Changyi Chen 54 77 0 13 Mar 2023
Neural Algorithmic Reasoning with Causal Regularisation Beatrice Bevilacqua Kyriacos Nikiforou Borja Ibarz Ioana Bica Michela Paganini Charles Blundell Jovana Mitrović Petar Velivcković OOD CML NAI 36 26 0 20 Feb 2023
Evaluating Representations with Readout Model Switching Yazhe Li J. Bornschein Marcus Hutter 27 0 0 19 Feb 2023
Self-supervised learning of Split Invariant Equivariant representations Q. Garrido Laurent Najman Yann LeCun SSL 26 32 0 14 Feb 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 20 9 0 27 Dec 2022
Weighted Ensemble Self-Supervised Learning Yangjun Ruan Saurabh Singh Warren Morningstar Alexander A. Alemi Sergey Ioffe Ian S. Fischer Joshua V. Dillon FedML 24 15 0 18 Nov 2022
Local Manifold Augmentation for Multiview Semantic Consistency Yu Yang Wing Yin Cheung Chang-rui Liu Xiang Ji 31 1 0 05 Nov 2022
Self-Supervised Learning Through Efference Copies Franz Scherr Qinghai Guo Timoleon Moraitis 19 10 0 17 Oct 2022
RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank Q. Garrido Randall Balestriero Laurent Najman Yann LeCun SSL 48 72 0 05 Oct 2022
Where Should I Spend My FLOPS? Efficiency Evaluations of Visual Pre-training Methods Skanda Koppula Yazhe Li Evan Shelhamer Andrew Jaegle Nikhil Parthasarathy Relja Arandjelović João Carreira Olivier J. Hénaff 33 9 0 30 Sep 2022
Slimmable Networks for Contrastive Self-supervised Learning Shuai Zhao Xiaohan Wang Linchao Zhu Yi Yang 27 1 0 30 Sep 2022
Hebbian Deep Learning Without Feedback Adrien Journé Hector Garcia Rodriguez Qinghai Guo Timoleon Moraitis AAML 20 48 0 23 Sep 2022
Object discovery and representation networks Olivier J. Hénaff Skanda Koppula Evan Shelhamer Daniel Zoran Andrew Jaegle Andrew Zisserman João Carreira Relja Arandjelović 44 87 0 16 Mar 2022
Provable Stochastic Optimization for Global Contrastive Learning: Small Batch Does Not Harm Performance Zhuoning Yuan Yuexin Wu Zi-qi Qiu Xianzhi Du Lijun Zhang Denny Zhou Tianbao Yang 32 26 0 24 Feb 2022
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 41 19 0 06 Oct 2021
ResNet strikes back: An improved training procedure in timm Ross Wightman Hugo Touvron Hervé Jégou AI4TS 212 487 0 01 Oct 2021
Compressive Visual Representations Kuang-Huei Lee Anurag Arnab S. Guadarrama John F. Canny Ian S. Fischer SSL 65 48 0 27 Sep 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 188 453 0 29 Apr 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 317 5,775 0 29 Apr 2021
High-Performance Large-Scale Image Recognition Without Normalization Andrew Brock Soham De Samuel L. Smith Karen Simonyan VLM 223 512 0 11 Feb 2021
Meta Pseudo Labels Hieu H. Pham Zihang Dai Qizhe Xie Minh-Thang Luong Quoc V. Le VLM 253 656 0 23 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,371 0 09 Mar 2020