On the Surrogate Gap between Contrastive and Supervised Losses

6 October 2021

Papers citing "On the Surrogate Gap between Contrastive and Supervised Losses"

22 / 22 papers shown

Title
PhiNets: Brain-inspired Non-contrastive Learning Based on Temporal Prediction Hypothesis Satoki Ishikawa Makoto Yamada Han Bao Yuki Takezawa 105 0 0 23 May 2024
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Eric Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 32 69 0 12 Jan 2022
Self-Supervised Learning with Kernel Dependence Maximization Yazhe Li Roman Pogodin Danica J. Sutherland Arthur Gretton SSL 43 82 0 15 Jun 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 48 309 0 08 Jun 2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning Zixin Wen Yuanzhi Li SSL MLT 49 133 0 31 May 2021
Rethinking "Batch" in BatchNorm Yuxin Wu Justin Johnson BDL 77 66 0 17 May 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 77 45 0 13 Feb 2021
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 213 3,992 0 20 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 60 174 0 05 Nov 2020
Functional Regularization for Representation Learning: A Unified Theoretical Perspective Siddhant Garg Yingyu Liang SSL 28 19 0 06 Aug 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 191 4,051 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 308 6,718 0 13 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 80 1,313 0 20 May 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 145 12,007 0 13 Nov 2019
PAC-Bayesian Contrastive Unsupervised Representation Learning Kento Nozawa Pascal Germain Benjamin Guedj SSL BDL 34 27 0 10 Oct 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 149 490 0 31 Jul 2019
Rethinking ImageNet Pre-training Kaiming He Ross B. Girshick Piotr Dollár VLM SSeg 114 1,081 0 21 Nov 2018
Formal Limitations on the Measurement of Mutual Information David A. McAllester K. Stratos SSL 61 275 0 10 Nov 2018
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 252 8,030 0 13 Aug 2016
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 330 33,445 0 16 Oct 2013
Similarity Learning for Provably Accurate Sparse Linear Classification A. Bellet Amaury Habrard M. Sebban 49 57 0 27 Jun 2012
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 204 12,384 0 24 Jun 2012