Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss

8 June 2021

Adrien Gaidon

Papers citing "Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss"

27 / 77 papers shown

Title
Dataset Inference for Self-Supervised Models Adam Dziedzic Haonan Duan Muhammad Ahmad Kaleem Nikita Dhawan Jonas Guan Yannis Cattan Franziska Boenisch Nicolas Papernot 32 26 0 16 Sep 2022
RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence Kyungmin Lee Jinwoo Shin SSL DRL 29 10 0 12 Aug 2022
Analyzing Data-Centric Properties for Graph Contrastive Learning Puja Trivedi Ekdeep Singh Lubana Mark Heimann Danai Koutra Jayaraman J. Thiagarajan 30 11 0 04 Aug 2022
Self-supervised learning with rotation-invariant kernels Léon Zheng Gilles Puy E. Riccietti Patrick Pérez Rémi Gribonval SSL 19 2 0 28 Jul 2022
Toward a Geometrical Understanding of Self-supervised Contrastive Learning Romain Cosentino Anirvan M. Sengupta Salman Avestimehr Mahdi Soltanolkotabi Antonio Ortega Ted Willke Mariano Tepper SSL 45 17 0 13 May 2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning Zixin Wen Yuanzhi Li SSL 27 34 0 12 May 2022
Do More Negative Samples Necessarily Hurt in Contrastive Learning? Pranjal Awasthi Nishanth Dikkala Pritish Kamath 35 40 0 03 May 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 21 4 0 18 Apr 2022
Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning Mayee F. Chen Daniel Y. Fu A. Narayan Michael Zhang Zhao-quan Song Kayvon Fatahalian Christopher Ré SSL 32 47 0 15 Apr 2022
Augmentation-Free Graph Contrastive Learning with Performance Guarantee Haonan Wang Jieyu Zhang Qi Zhu Wei Huang 30 31 0 11 Apr 2022
RODD: A Self-Supervised Approach for Robust Out-of-Distribution Detection Umar Khalid Ashkan Esmaeili Nazmul Karim Nazanin Rahnavard OODD 42 12 0 06 Apr 2022
Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap Yifei Wang Qi Zhang Yisen Wang Jiansheng Yang Zhouchen Lin 27 98 0 25 Mar 2022
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 24 109 0 28 Feb 2022
Sample Efficiency of Data Augmentation Consistency Regularization Shuo Yang Yijun Dong Rachel A. Ward Inderjit S. Dhillon Sujay Sanghavi Qi Lei AAML 25 17 0 24 Feb 2022
Understanding Deep Contrastive Learning via Coordinate-wise Optimization Yuandong Tian 52 34 0 29 Jan 2022
Pushing the limits of self-supervised ResNets: Can we outperform supervised learning without labels on ImageNet? Nenad Tomašev Ioana Bica Brian McWilliams Lars Buesing Razvan Pascanu Charles Blundell Jovana Mitrović SSL 90 81 0 13 Jan 2022
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 106 0 01 Nov 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 25 338 0 18 Oct 2021
Self-supervised Learning is More Robust to Dataset Imbalance Hong Liu Jeff Z. HaoChen Adrien Gaidon Tengyu Ma OOD SSL 33 157 0 11 Oct 2021
Towards Demystifying Representation Learning with Non-contrastive Self-supervision Xiang Wang Xinlei Chen S. Du Yuandong Tian SSL 21 26 0 11 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 41 19 0 06 Oct 2021
The Power of Contrast for Feature Learning: A Theoretical Analysis Wenlong Ji Zhun Deng Ryumei Nakada James Zou Linjun Zhang SSL 53 49 0 06 Oct 2021
Why Do Pretrained Language Models Help in Downstream Tasks? An Analysis of Head and Prompt Tuning Colin Wei Sang Michael Xie Tengyu Ma 24 97 0 17 Jun 2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning Zixin Wen Yuanzhi Li SSL MLT 32 131 0 31 May 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 207 0 17 Feb 2021
For self-supervised learning, Rationality implies generalization, provably Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 58 22 0 16 Oct 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 270 3,375 0 09 Mar 2020