Toward a Geometrical Understanding of Self-supervised Contrastive
Learning

Toward a Geometrical Understanding of Self-supervised Contrastive Learning

13 May 2022

Romain Cosentino

Anirvan M. Sengupta

Salman Avestimehr

Mahdi Soltanolkotabi

Papers citing "Toward a Geometrical Understanding of Self-supervised Contrastive Learning"

11 / 11 papers shown

Title
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 35 5 0 28 Jun 2024
LDReg: Local Dimensionality Regularized Self-Supervised Learning Hanxun Huang R. Campello S. Erfani Xingjun Ma Michael E. Houle James Bailey 38 5 0 19 Jan 2024
Unraveling Projection Heads in Contrastive Learning: Insights from Expansion and Shrinkage Yu Gui Cong Ma Yiqiao Zhong 22 6 0 06 Jun 2023
Unsupervised Learning on a DIET: Datum IndEx as Target Free of Self-Supervision, Reconstruction, Projector Head Randall Balestriero 38 3 0 20 Feb 2023
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 50 20 0 02 Oct 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations Grégoire Mialon Randall Balestriero Yann LeCun 29 9 0 29 Sep 2022
The Geometry of Self-supervised Learning Models and its Impact on Transfer Learning Romain Cosentino Sarath Shekkizhar Mahdi Soltanolkotabi A. Avestimehr Antonio Ortega SSL 51 7 0 18 Sep 2022
Decoupled Contrastive Learning Chun-Hsiao Yeh Cheng-Yao Hong Yen-Chi Hsu Tyng-Luh Liu Yubei Chen Yann LeCun 180 182 0 13 Oct 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 188 454 0 29 Apr 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 317 5,785 0 29 Apr 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 281 0 12 Feb 2021