Contrasting the landscape of contrastive and non-contrastive learning

29 March 2022

Andrej Risteski

Papers citing "Contrasting the landscape of contrastive and non-contrastive learning"

28 / 28 papers shown

Title
A Probabilistic Model for Self-Supervised Learning Maximilian Fleissner P. Esser D. Ghoshdastidar SSL BDL 96 1 0 22 Jan 2025
Localizing Memorization in SSL Vision Encoders Wenhao Wang Adam Dziedzic Michael Backes Franziska Boenisch 34 2 0 27 Sep 2024
When can we Approximate Wide Contrastive Models with Neural Tangent Kernels and Principal Component Analysis? Gautham Govind Anil P. Esser D. Ghoshdastidar 43 1 0 13 Mar 2024
Memorization in Self-Supervised Learning Improves Downstream Generalization Wenhao Wang Muhammad Ahmad Kaleem Adam Dziedzic Michael Backes Nicolas Papernot Franziska Boenisch SSL 25 9 0 19 Jan 2024
Information Flow in Self-Supervised Learning Zhiyuan Tan Jingqin Yang Weiran Huang Yang Yuan Yifan Zhang SSL 33 14 0 29 Sep 2023
Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics Han Bao SSL MLT 32 1 0 28 Sep 2023
Representation Learning Dynamics of Self-Supervised Models P. Esser Satyaki Mukherjee D. Ghoshdastidar SSL 29 3 0 05 Sep 2023
Vision-Language Dataset Distillation Xindi Wu Byron Zhang Zhiwei Deng Olga Russakovsky DD VLM 33 8 0 15 Aug 2023
A Transfer Learning Framework for Proactive Ramp Metering Performance Assessment Xiaobo Ma A. Cottam Mohammad Razaur Rahman Shaon Yao-Jan Wu 33 7 0 07 Aug 2023
On-ramp and Off-ramp Traffic Flows Estimation Based on A Data-driven Transfer Learning Framework Xiaobo Ma Abolfazl Karimpour Yao-Jan Wu 24 4 0 07 Aug 2023
Unsupervised Representation Learning for Time Series: A Review Qianwen Meng Hangwei Qian Yong Liu Yonghui Xu Zhiqi Shen Li-zhen Cui AI4TS 32 17 0 03 Aug 2023
Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Review Dan Zhang Fangfang Zhou Felix Albu Yuan-Gu Wei X. Yang Yuan Gu Qiang Li 27 19 0 01 Aug 2023
Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression Runtian Zhai Bing Liu Andrej Risteski Zico Kolter Pradeep Ravikumar SSL 28 9 0 01 Jun 2023
Matrix Information Theory for Self-Supervised Learning Yifan Zhang Zhi-Hao Tan Jingqin Yang Weiran Huang Yang Yuan SSL 48 16 0 27 May 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 37 30 0 27 Mar 2023
TriNet: stabilizing self-supervised learning from complete or slow collapse on ASR Lixin Cao Jun Wang Ben Yang Dan Su Dong Yu 18 4 0 12 Dec 2022
Implicit variance regularization in non-contrastive SSL Manu Srinath Halvagal Axel Laborieux Friedemann Zenke 44 9 0 09 Dec 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 50 20 0 02 Oct 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 83 40 0 13 Sep 2022
Analyzing Data-Centric Properties for Graph Contrastive Learning Puja Trivedi Ekdeep Singh Lubana Mark Heimann Danai Koutra Jayaraman J. Thiagarajan 30 11 0 04 Aug 2022
On the duality between contrastive and non-contrastive self-supervised learning Q. Garrido Yubei Chen Adrien Bardes Laurent Najman Yann LeCun SSL 25 89 0 03 Jun 2022
Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods Randall Balestriero Yann LeCun SSL 18 129 0 23 May 2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning Zixin Wen Yuanzhi Li SSL 27 34 0 12 May 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 21 4 0 18 Apr 2022
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 133 187 0 02 May 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 208 0 17 Feb 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 281 0 12 Feb 2021
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 250 114 0 20 Oct 2020