Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap

25 March 2022

Papers citing "Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap"

25 / 25 papers shown

Title
Cross-Entropy Is All You Need To Invert the Data Generating Process Patrik Reizinger Alice Bizeul Attila Juhos Julia E. Vogt Randall Balestriero Wieland Brendel David Klindt SSL OOD BDL DRL 188 6 0 29 Oct 2024
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 92 10 0 28 Jun 2024
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 73 110 0 01 Nov 2021
Residual Relaxation for Multi-view Representation Learning Yifei Wang Zhengyang Geng Feng Jiang Chuming Li Yisen Wang Jiansheng Yang Zhouchen Lin 54 39 0 28 Oct 2021
Investigating the Role of Negatives in Contrastive Representation Learning Jordan T. Ash Surbhi Goel A. Krishnamurthy Dipendra Kumar Misra SSL 69 52 0 18 Jun 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 77 315 0 08 Jun 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 154 1,864 0 05 Apr 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 113 45 0 13 Feb 2021
About contrastive unsupervised representation learning for classification and its convergence Ibrahim Merad Yiyang Yu Emmanuel Bacry Stéphane Gaïffas SSL 48 1 0 02 Dec 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 253 4,054 0 20 Nov 2020
SelfAugment: Automatic Augmentation Policies for Self-Supervised Learning Colorado Reed Sean L. Metzger A. Srinivas Trevor Darrell Kurt Keutzer SSL 79 49 0 16 Sep 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 77 166 0 24 Aug 2020
Predicting What You Already Know Helps: Provable Self-Supervised Learning Jason D. Lee Qi Lei Nikunj Saunshi Jiacheng Zhuo SSL 69 188 0 03 Aug 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 371 6,806 0 13 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 100 1,329 0 20 May 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 157 1,840 0 20 May 2020
Contrastive estimation reveals topic posterior information to linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu 51 63 0 04 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 369 18,778 0 13 Feb 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 199 12,085 0 13 Nov 2019
Understanding the Limitations of Variational Mutual Information Estimators Jiaming Song Stefano Ermon SSL DRL 64 203 0 14 Oct 2019
On Variational Bounds of Mutual Information Ben Poole Sherjil Ozair Aaron van den Oord Alexander A. Alemi George Tucker SSL 104 807 0 16 May 2019
A Theoretical Analysis of Contrastive Unsupervised Representation Learning Sanjeev Arora H. Khandeparkar M. Khodak Orestis Plevrakis Nikunj Saunshi SSL 100 779 0 25 Feb 2019
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 320 2,662 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 320 10,302 0 10 Jul 2018
Scale-Invariant Convolutional Neural Networks Yichong Xu Tianjun Xiao Jiaxing Zhang Kuiyuan Yang Zheng Zhang 91 138 0 24 Nov 2014