Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap

25 March 2022

Papers citing "Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap"

24 / 74 papers shown

Title
Spatiotemporal Self-supervised Learning for Point Clouds in the Wild Yanhao Wu Tong Zhang Wei Ke Sabine Süsstrunk Mathieu Salzmann 3DPC 25 22 0 28 Mar 2023
Contrastive Learning Is Spectral Clustering On Similarity Graph Zhi-Hao Tan Yifan Zhang Jingqin Yang Yang Yuan SSL 54 18 0 27 Mar 2023
A Message Passing Perspective on Learning Dynamics of Contrastive Learning Yifei Wang Qi Zhang Tianqi Du Jiansheng Yang Zhouchen Lin Yisen Wang SSL 29 18 0 08 Mar 2023
Towards a Unified Theoretical Understanding of Non-contrastive Learning via Rank Differential Mechanism Zhijian Zhuo Yifei Wang Jinwen Ma Yisen Wang 45 24 0 04 Mar 2023
Rethinking the Effect of Data Augmentation in Adversarial Contrastive Learning Rundong Luo Yifei Wang Yisen Wang 34 25 0 02 Mar 2023
Generalization Analysis for Contrastive Representation Learning Yunwen Lei Tianbao Yang Yiming Ying Ding-Xuan Zhou 28 8 0 24 Feb 2023
InfoNCE Loss Provably Learns Cluster-Preserving Representations Advait Parulekar Liam Collins Karthikeyan Shanmugam Aryan Mokhtari Sanjay Shakkottai SSL 34 20 0 15 Feb 2023
Evaluating Self-Supervised Learning via Risk Decomposition Yann Dubois Tatsunori Hashimoto Percy Liang 14 9 0 06 Feb 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning Jiajun Ma Tianyang Hu Wenjia Wang 17 8 0 28 Jan 2023
Feature Dropout: Revisiting the Role of Augmentations in Contrastive Learning Alex Tamkin Margalit Glasgow Xiluo He Noah D. Goodman SSL 19 7 0 16 Dec 2022
A Theoretical Study of Inductive Biases in Contrastive Learning Jeff Z. HaoChen Tengyu Ma UQCV SSL 33 31 0 27 Nov 2022
Homomorphic Self-Supervised Learning Thomas Anderson Keller Xavier Suau Luca Zappella SSL 19 2 0 15 Nov 2022
How Mask Matters: Towards Theoretical Understandings of Masked Autoencoders Qi Zhang Yifei Wang Yisen Wang 19 72 0 15 Oct 2022
An Embarrassingly Simple Backdoor Attack on Self-supervised Learning Changjiang Li Ren Pang Zhaohan Xi Tianyu Du S. Ji Yuan Yao Ting Wang AAML 31 25 0 13 Oct 2022
What shapes the loss landscape of self-supervised learning? Liu Ziyin Ekdeep Singh Lubana Masakuni Ueda Hidenori Tanaka 50 20 0 02 Oct 2022
MetaMask: Revisiting Dimensional Confounder for Self-Supervised Learning Jiangmeng Li Wenwen Qiang Yanan Zhang Wenyi Mo Changwen Zheng Bing-Huang Su Hui Xiong SSL 26 14 0 16 Sep 2022
Modeling Multiple Views via Implicitly Preserving Global Consistency and Local Complementarity Jiangmeng Li Wenwen Qiang Changwen Zheng Bing-Huang Su Farid Razzak Ji-Rong Wen Hui Xiong 29 6 0 16 Sep 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 83 40 0 13 Sep 2022
ARIEL: Adversarial Graph Contrastive Learning Shengyu Feng Baoyu Jing Yada Zhu Hanghang Tong 18 7 0 15 Aug 2022
ProtoCLIP: Prototypical Contrastive Language Image Pretraining Delong Chen Zhao Wu Fan Liu Zaiquan Yang Huaxi Huang Ying Tan Erjin Zhou VLM CLIP 27 28 0 22 Jun 2022
Evaluating Graph Generative Models with Contrastively Learned Features Hamed Shirzad Kaveh Hassani Danica J. Sutherland 14 7 0 13 Jun 2022
Integrating Prior Knowledge in Contrastive Learning with Kernel Benoit Dufumier C. Barbano Robin Louiset Edouard Duchesnay Pietro Gori SSL 19 8 0 03 Jun 2022
Augmentation Component Analysis: Modeling Similarity via the Augmentation Overlaps Lu Han Han-Jia Ye De-Chuan Zhan 11 4 0 01 Jun 2022
GATE: Graph CCA for Temporal SElf-supervised Learning for Label-efficient fMRI Analysis Liang Peng Nan Wang Jie Xu Xiao-lan Zhu Xiaoxiao Li 40 33 0 17 Mar 2022