Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap

25 March 2022

Papers citing "Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap"

50 / 74 papers shown

Title
Generalization Analysis for Contrastive Representation Learning under Non-IID Settings Nong Minh Hieu Antoine Ledent 49 0 0 08 May 2025
CIBR: Cross-modal Information Bottleneck Regularization for Robust CLIP Generalization Yingrui Ji Xi Xiao Gaofei Chen Hao Xu Chenrui Ma Lijing Zhu Aokun Liang Jiansheng Chen VLM 48 0 0 31 Mar 2025
Projection Head is Secretly an Information Bottleneck Zhuo Ouyang Kaiwen Hu Qi Zhang Yifei Wang Yisen Wang 46 0 0 01 Mar 2025
Shifting the Paradigm: A Diffeomorphism Between Time Series Data Manifolds for Achieving Shift-Invariancy in Deep Learning B. U. Demirel Christian Holz OOD AI4TS 79 0 0 27 Feb 2025
Understanding Difficult-to-learn Examples in Contrastive Learning: A Theoretical Framework for Spectral Contrastive Learning Yi-Ge Zhang Jingyi Cui Qiran Li Yisen Wang SSL 43 0 0 03 Jan 2025
Where Did Your Model Learn That? Label-free Influence for Self-supervised Learning Nidhin Harilal Amit Rege Reza Akbarian Bafghi M. Raissi C. Monteleoni TDI 43 0 0 22 Dec 2024
Rethinking Generalizability and Discriminability of Self-Supervised Learning from Evolutionary Game Theory Perspective Jiangmeng Li Zehua Zang Qirui Ji Chuxiong Sun Wenwen Qiang Junge Zhang Changwen Zheng Fuchun Sun Hui Xiong SSL 69 0 0 30 Nov 2024
Understanding the Role of Equivariance in Self-supervised Learning Yifei Wang Kaiwen Hu Sharut Gupta Ziyu Ye Yisen Wang Stefanie Jegelka SSL 44 2 0 10 Nov 2024
Cross-Entropy Is All You Need To Invert the Data Generating Process Patrik Reizinger Alice Bizeul Attila Juhos Julia E. Vogt Randall Balestriero Wieland Brendel David Klindt SSL OOD BDL DRL 102 3 0 29 Oct 2024
Localizing Memorization in SSL Vision Encoders Wenhao Wang Adam Dziedzic Michael Backes Franziska Boenisch 34 2 0 27 Sep 2024
SINDER: Repairing the Singular Defects of DINOv2 Haoqian Wang Tong Zhang Mathieu Salzmann 34 1 0 23 Jul 2024
On the Role of Discrete Tokenization in Visual Representation Learning Tianqi Du Yifei Wang Yisen Wang 49 7 0 12 Jul 2024
Look Ahead or Look Around? A Theoretical Comparison Between Autoregressive and Masked Pretraining Qi Zhang Tianqi Du Haotian Huang Yifei Wang Yisen Wang 34 3 0 01 Jul 2024
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 33 5 0 28 Jun 2024
DDA: Dimensionality Driven Augmentation Search for Contrastive Learning in Laparoscopic Surgery Yuning Zhou H. Badgery Matthew Read James Bailey Catherine E. Davey 45 1 0 03 Jun 2024
An Unsupervised Approach for Periodic Source Detection in Time Series B. U. Demirel Christian Holz AI4TS 42 1 0 01 Jun 2024
Topological Perspectives on Optimal Multimodal Embedding Spaces Abdul Aziz Abdul Rahim BDL 39 0 0 29 May 2024
A Theoretical Understanding of Self-Correction through In-context Alignment Yifei Wang Yuyang Wu Zeming Wei Stefanie Jegelka Yisen Wang LRM 38 13 0 28 May 2024
TransFusion: Contrastive Learning with Transformers Huanran Li Daniel Pimentel-Alarcón 34 0 0 27 Mar 2024
Non-negative Contrastive Learning Yifei Wang Qi Zhang Yaoyu Guo Yisen Wang 28 9 0 19 Mar 2024
Do Generated Data Always Help Contrastive Learning? Yifei Wang Jizhe Zhang Yisen Wang DiffM 27 22 0 19 Mar 2024
Unsupervised Graph Neural Architecture Search with Disentangled Self-supervision Zeyang Zhang Xin Eric Wang Ziwei Zhang Guangyao Shen Shiqi Shen Wenwu Zhu 42 12 0 08 Mar 2024
A Probabilistic Model behind Self-Supervised Learning Alice Bizeul Bernhard Schölkopf Carl Allen SSL 26 2 0 02 Feb 2024
Memorization in Self-Supervised Learning Improves Downstream Generalization Wenhao Wang Muhammad Ahmad Kaleem Adam Dziedzic Michael Backes Nicolas Papernot Franziska Boenisch SSL 19 9 0 19 Jan 2024
Rethinking Dimensional Rationale in Graph Contrastive Learning from Causal Perspective Qirui Ji Jiangmeng Li Jie Hu Rui Wang Changwen Zheng Fanjiang Xu 25 10 0 16 Dec 2023
On the Difficulty of Defending Contrastive Learning against Backdoor Attacks Changjiang Li Ren Pang Bochuan Cao Zhaohan Xi Jinghui Chen Shouling Ji Ting Wang AAML 36 6 0 14 Dec 2023
Robust Contrastive Learning With Theory Guarantee Ngoc N. Tran Lam C. Tran Hoang Phan Anh-Vu Bui Tung Pham Toan M. Tran Dinh Q. Phung Trung Le SSL NoLa 26 0 0 16 Nov 2023
Architecture Matters: Uncovering Implicit Mechanisms in Graph Contrastive Learning Xiaojun Guo Yifei Wang Zeming Wei Yisen Wang 33 11 0 05 Nov 2023
Adversarial Examples Are Not Real Features Ang Li Yifei Wang Yiwen Guo Yisen Wang 20 11 0 29 Oct 2023
Identifiable Contrastive Learning with Automatic Feature Importance Discovery Qi Zhang Yifei Wang Yisen Wang 26 12 0 29 Oct 2023
Simple and Asymmetric Graph Contrastive Learning without Augmentations Teng Xiao Huaisheng Zhu Zhengyu Chen Suhang Wang 22 31 0 29 Oct 2023
Combating Representation Learning Disparity with Geometric Harmonization Zhihan Zhou Jiangchao Yao Feng Hong Ya-Qin Zhang Bo Han Yanfeng Wang 25 12 0 26 Oct 2023
Perfect Alignment May be Poisonous to Graph Contrastive Learning Jingyu Liu Huayi Tang Yong Liu 26 2 0 06 Oct 2023
Towards Distribution-Agnostic Generalized Category Discovery Jianhong Bai Zuo-Qiang Liu Hualiang Wang Ruizhe Chen Lianrui Mu Xiaomeng Li Joey Tianyi Zhou Yang Feng Jian Wu Haoji Hu 40 9 0 02 Oct 2023
Information Flow in Self-Supervised Learning Zhiyuan Tan Jingqin Yang Weiran Huang Yang Yuan Yifan Zhang SSL 28 13 0 29 Sep 2023
Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics Han Bao SSL MLT 29 1 0 28 Sep 2023
Finding Order in Chaos: A Novel Data Augmentation Method for Time Series in Contrastive Learning B. U. Demirel Christian Holz AI4TS 24 18 0 23 Sep 2023
CAME: Contrastive Automated Model Evaluation Ru Peng Qiuyang Duan Haobo Wang Jiachen Ma Yanbo Jiang Yongjun Tu Xiu Jiang J. Zhao ELM 23 4 0 22 Aug 2023
Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detection Guodong Wang Yun Wang Jie Qin Dongming Zhang Xiuguo Bao Di Huang 33 4 0 20 Aug 2023
Unsupervised Representation Learning for Time Series: A Review Qianwen Meng Hangwei Qian Yong Liu Yonghui Xu Zhiqi Shen Li-zhen Cui AI4TS 30 17 0 03 Aug 2023
Towards the Sparseness of Projection Head in Self-Supervised Learning Zeen Song Xingzhe Su Jingyao Wang Wenwen Qiang Changwen Zheng Fuchun Sun 36 3 0 18 Jul 2023
On the Effectiveness of Out-of-Distribution Data in Self-Supervised Long-Tail Learning Jianhong Bai Zuozhu Liu Hualiang Wang Jinxiang Hao Yang Feng Huanpeng Chu Haoji Hu OODD 34 16 0 08 Jun 2023
On the Generalization of Multi-modal Contrastive Learning Qi Zhang Yifei Wang Yisen Wang 22 24 0 07 Jun 2023
Rethinking Weak Supervision in Helping Contrastive Learning Jingyi Cui Weiran Huang Yifei Wang Yisen Wang NoLa SSL 32 13 0 07 Jun 2023
Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression Runtian Zhai Bing Liu Andrej Risteski Zico Kolter Pradeep Ravikumar SSL 28 9 0 01 Jun 2023
Spectal Harmonics: Bridging Spectral Embedding and Matrix Completion in Self-Supervised Learning Marina Munkhoeva Ivan V. Oseledets SSL 28 2 0 31 May 2023
Matrix Information Theory for Self-Supervised Learning Yifan Zhang Zhi-Hao Tan Jingqin Yang Weiran Huang Yang Yuan SSL 45 16 0 27 May 2023
Sharpness & Shift-Aware Self-Supervised Learning Ngoc N. Tran S. Duong Hoang Phan Tung Pham Dinh Q. Phung Trung Le SSL 29 1 0 17 May 2023
How does Contrastive Learning Organize Images? Yunzhe Zhang Yao Lu Qi Xuan SSL 26 0 0 17 May 2023
Towards Understanding the Mechanism of Contrastive Learning via Similarity Structure: A Theoretical Analysis Hiroki Waida Yuichiro Wada Léo Andéol Takumi Nakagawa Yuhui Zhang Takafumi Kanamori SSL 21 5 0 01 Apr 2023