A Theoretical Study of Inductive Biases in Contrastive Learning

27 November 2022

Papers citing "A Theoretical Study of Inductive Biases in Contrastive Learning"

8 / 8 papers shown

Title
Better Representations via Adversarial Training in Pre-Training: A Theoretical Perspective Yue Xing Xiaofeng Lin Qifan Song Yi Tian Xu Belinda Zeng Guang Cheng SSL 15 0 0 26 Jan 2024
Provable Multi-instance Deep AUC Maximization with Stochastic Pooling Dixian Zhu Bokun Wang Zhi Chen Yaxing Wang Milan Sonka Xiaodong Wu Tianbao Yang 14 3 0 14 May 2023
The SSL Interplay: Augmentations, Inductive Bias, and Generalization Vivien A. Cabannes B. Kiani Randall Balestriero Yann LeCun A. Bietti SSL 11 31 0 06 Feb 2023
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 70 40 0 13 Sep 2022
TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning Yixuan Su Fangyu Liu Zaiqiao Meng Tian Lan Lei Shu Ehsan Shareghi Nigel Collier 137 57 0 07 Nov 2021
What Happens after SGD Reaches Zero Loss? --A Mathematical Framework Zhiyuan Li Tianhao Wang Sanjeev Arora MLT 85 98 0 13 Oct 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 279 0 12 Feb 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 264 3,369 0 09 Mar 2020