Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?

15 June 2024

Papers citing "Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?"

32 / 32 papers shown

Title
Cross-Entropy Is All You Need To Invert the Data Generating Process Patrik Reizinger Alice Bizeul Attila Juhos Julia E. Vogt Randall Balestriero Wieland Brendel David Klindt SSL OOD BDL DRL 152 4 0 29 Oct 2024
Self-Supervised Learning with an Information Maximization Criterion Serdar Ozsoy Shadi S. Hamdan Sercan O. Arik Deniz Yuret A. Erdogan SSL 45 35 0 16 Sep 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 95 41 0 13 Sep 2022
On the Pros and Cons of Momentum Encoder in Self-Supervised Visual Representation Learning T. Pham Chaoning Zhang Axi Niu Kang Zhang Chang D. Yoo 60 11 0 11 Aug 2022
Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods Randall Balestriero Yann LeCun SSL 43 130 0 23 May 2022
Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo Chaoning Zhang Kang Zhang T. Pham Axi Niu Zhinan Qiao Chang D. Yoo In So Kweon 72 56 0 30 Mar 2022
Spatial Transformer K-Means Romain Cosentino Randall Balestriero Yanis Bahroun Anirvan M. Sengupta Richard Baraniuk B. Aazhang 17 4 0 16 Feb 2022
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 106 346 0 18 Oct 2021
Parametric Scattering Networks Shanel Gauthier Benjamin Thérien Laurent Alsene-Racicot Muawiz Chaudhary Irina Rish Eugene Belilovsky Michael Eickenberg Guy Wolf 42 17 0 20 Jul 2021
ReSSL: Relational Self-Supervised Learning with Weak Augmentation Mingkai Zheng Shan You Fei Wang Chao Qian Changshui Zhang Xiaogang Wang Chang Xu 45 113 0 20 Jul 2021
Self-Supervised Learning with Kernel Dependence Maximization Yazhe Li Roman Pogodin Danica J. Sutherland Arthur Gretton SSL 43 82 0 15 Jun 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 46 306 0 08 Jun 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 381 2,638 0 04 May 2021
Understanding Hard Negatives in Noise Contrastive Estimation Wenzheng Zhang K. Stratos 37 50 0 13 Apr 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 223 2,321 0 04 Mar 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 181 282 0 12 Feb 2021
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 189 3,992 0 20 Nov 2020
SelfAugment: Automatic Augmentation Policies for Self-Supervised Learning Colorado Reed Sean L. Metzger A. Srinivas Trevor Darrell Kurt Keutzer SSL 59 49 0 16 Sep 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 276 6,718 0 13 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 75 1,313 0 20 May 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 423 3,397 0 09 Mar 2020
Self-labelling via simultaneous clustering and representation learning Yuki M. Asano Christian Rupprecht Andrea Vedaldi SSL 82 769 0 13 Nov 2019
A Comprehensive Survey on Transfer Learning Fuzhen Zhuang Zhiyuan Qi Keyu Duan Dongbo Xi Yongchun Zhu Hengshu Zhu Hui Xiong Qing He 157 4,395 0 07 Nov 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 131 2,385 0 13 Jun 2019
Unsupervised Deep Learning by Neighbourhood Discovery Jiabo Huang Qi Dong S. Gong Xiatian Zhu SSL 60 152 0 25 Apr 2019
On instabilities of deep learning in image reconstruction - Does AI come at a cost? Vegard Antun F. Renna C. Poon Ben Adcock A. Hansen 45 601 0 14 Feb 2019
Spectral Inference Networks: Unifying Deep and Spectral Learning David Pfau Stig Petersen Ashish Agarwal David Barrett Kimberly L. Stachenfeld 73 40 0 06 Jun 2018
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 435 10,281 0 16 Nov 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 631 36,599 0 25 Aug 2016
One weird trick for parallelizing convolutional neural networks A. Krizhevsky GNN 81 1,297 0 23 Apr 2014
Auto-Encoding Variational Bayes Diederik P. Kingma Max Welling BDL 367 16,962 0 20 Dec 2013
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 86 2,227 0 21 Jun 2013