Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style

8 June 2021

Wieland Brendel

Francesco Locatello

Papers citing "Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style"

50 / 83 papers shown

Title
Modeling Unseen Environments with Language-guided Composable Causal Components in Reinforcement Learning Xinyue Wang Zhen Zhang OffRL CML 29 0 0 13 May 2025
On the Value of Cross-Modal Misalignment in Multimodal Representation Learning Yichao Cai Yuhang Liu Erdun Gao Tianjiao Jiang Zhen Zhang Anton van den Hengel Javen Qinfeng Shi 62 0 0 14 Apr 2025
I Predict Therefore I Am: Is Next Token Prediction Enough to Learn Human-Interpretable Concepts from Data? Yuhang Liu Dong Gong Erdun Gao Zhen Zhang Zhen Zhang Biwei Huang Anton van den Hengel Javen Qinfeng Shi Javen Qinfeng Shi 157 0 0 12 Mar 2025
DRESS: Disentangled Representation-based Self-Supervised Meta-Learning for Diverse Tasks Wei Cui Tongzi Wu Jesse C. Cresswell Yi Sui Keyvan Golestan 66 0 0 12 Mar 2025
Sanity Checking Causal Representation Learning on a Simple Real-World System Juan L. Gamella Simon Bing Jakob Runge CML 57 0 0 27 Feb 2025
Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lens Samuele Bortolotti Emanuele Marconato Paolo Morettin Andrea Passerini Stefano Teso 61 2 0 16 Feb 2025
Leveraging a Simulator for Learning Causal Representations from Post-Treatment Covariates for CATE Lokesh Nagalapatti Pranava Singhal Avishek Ghosh Sunita Sarawagi CML 81 0 0 07 Feb 2025
What is causal about causal models and representations? Frederik Hytting Jørgensen Luigi Gresele S. Weichwald CML 107 0 0 31 Jan 2025
Robust image representations with counterfactual contrastive learning Mélanie Roschewitz Fabio De Sousa Ribeiro Tian Xia G. Khara Ben Glocker OOD MedIm 49 2 0 16 Sep 2024
ST-SACLF: Style Transfer Informed Self-Attention Classifier for Bias-Aware Painting Classification Mridula Vijendran Frederick W. B. Li Jingjing Deng Hubert P. H. Shum 48 0 0 03 Aug 2024
Unifying Invariant and Variant Features for Graph Out-of-Distribution via Probability of Necessity and Sufficiency Xuexin Chen Ruichu Cai Kaitao Zheng Zhifan Jiang Zhengting Huang Zhifeng Hao Zijian Li 54 0 0 21 Jul 2024
Self-Supervised Video Representation Learning in a Heuristic Decoupled Perspective Changwen Zheng Wenwen Qiang Jianqi Zhang Changwen Zheng Jingyao Wang SSL 64 0 0 19 Jul 2024
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 35 5 0 28 Jun 2024
Learning Discrete Concepts in Latent Hierarchical Models Lingjing Kong Guan-Hong Chen Erdun Gao Eric P. Xing Yuejie Chi Anton van den Hengel 52 4 0 01 Jun 2024
Sparsity regularization via tree-structured environments for disentangled representations Elliot Layne Jason S. Hartford Sébastien Lachapelle Mathieu Blanchette Dhanya Sridhar OOD CML 33 0 0 30 May 2024
DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterization M. R. Uddin Min Xu 51 0 0 27 May 2024
Smoke and Mirrors in Causal Downstream Tasks Riccardo Cadei Lukas Lindorfer Sylvia Cremer Cordelia Schmid Francesco Locatello CML 35 3 0 27 May 2024
Learning Invariant Causal Mechanism from Vision-Language Models Changwen Zheng Siyu Zhao Xingyu Zhang Jiangmeng Li Changwen Zheng Jingyao Wang CML BDL VLM 42 0 0 24 May 2024
High-Dimension Human Value Representation in Large Language Models Samuel Cahyawijaya Delong Chen Yejin Bang Leila Khalatbari Bryan Wilie Ziwei Ji Etsuko Ishii Pascale Fung 71 5 0 11 Apr 2024
Joint Identifiability of Cross-Domain Recommendation via Hierarchical Subspace Disentanglement Jing Du Zesheng Ye Bin Guo Zhiwen Yu Lina Yao 36 1 0 06 Apr 2024
Poly-View Contrastive Learning Amitis Shidani Devon Hjelm Jason Ramapuram Russ Webb Eeshan Gunesh Dhekane Dan Busbridge VLM SSL 34 4 0 08 Mar 2024
Separating common from salient patterns with Contrastive Representation Learning Robin Louiset Edouard Duchesnay Antoine Grigis Pietro Gori SSL DRL 46 1 0 19 Feb 2024
Beyond DAGs: A Latent Partial Causal Model for Multimodal Learning Yuhang Liu Zhen Zhang Dong Gong Erdun Gao Biwei Huang Anton Van Den Hengel Anton van den Hengel Javen Qinfeng Shi Javen Qinfeng Shi 49 7 0 09 Feb 2024
LDReg: Local Dimensionality Regularized Self-Supervised Learning Hanxun Huang R. Campello S. Erfani Xingjun Ma Michael E. Houle James Bailey 38 5 0 19 Jan 2024
Towards Identifiable Unsupervised Domain Translation: A Diversified Distribution Matching Approach Sagar Shrestha Xiao Fu 23 3 0 18 Jan 2024
CLAP: Isolating Content from Style through Contrastive Learning with Augmented Prompts Yichao Cai Yuhang Liu Zhen Zhang Javen Qinfeng Shi CLIP VLM 31 5 0 28 Nov 2023
Identifying Semantic Component for Robust Molecular Property Prediction Zijian Li Zunhong Xu Ruichu Cai Zhenhui Yang Yuguang Yan Zhifeng Hao Guan-Hong Chen Kun Zhang 23 9 0 08 Nov 2023
Towards a Unified Framework of Contrastive Learning for Disentangled Representations Stefan Matthes Zhiwei Han Hao Shen 34 4 0 08 Nov 2023
Causal Representation Learning Made Identifiable by Grouping of Observational Variables H. Morioka Aapo Hyvarinen OOD CML BDL 33 9 0 24 Oct 2023
Towards the Sparseness of Projection Head in Self-Supervised Learning Changwen Zheng Xingzhe Su Wenwen Qiang Jingyao Wang Changwen Zheng Gang Hua 36 3 0 18 Jul 2023
Compositional Generalization from First Principles Thaddäus Wiedemer Prasanna Mayilvahanan Matthias Bethge Wieland Brendel OCL 25 37 0 10 Jul 2023
Conditionally Invariant Representation Learning for Disentangling Cellular Heterogeneity H. Aliee Ferdinand Kapl Soroor Hediyeh-zadeh Fabian J. Theis CML 23 6 0 02 Jul 2023
Towards Characterizing Domain Counterfactuals For Invertible Latent Causal Models Zeyu Zhou Ruqi Bai Sean Kulinski Murat Kocaoglu David I. Inouye CML 24 1 0 20 Jun 2023
Partial Identifiability for Domain Adaptation Lingjing Kong Shaoan Xie Weiran Yao Yujia Zheng Guan-Hong Chen P. Stojanov Victor Akinwande Anton van den Hengel 51 8 0 10 Jun 2023
Unraveling Projection Heads in Contrastive Learning: Insights from Expansion and Shrinkage Yu Gui Cong Ma Yiqiao Zhong 22 6 0 06 Jun 2023
Nonparametric Identifiability of Causal Representations from Unknown Interventions Julius von Kügelgen M. Besserve Wendong Liang Luigi Gresele Armin Kekić Elias Bareinboim David M. Blei Bernhard Schölkopf CML 18 56 0 01 Jun 2023
On Counterfactual Data Augmentation Under Confounding Abbavaram Gowtham Reddy Saketh Bachu Saloni Dash Charchit Sharma Amit Sharma V. Balasubramanian CML BDL 33 0 0 29 May 2023
Reverse Engineering Self-Supervised Learning Ido Ben-Shaul Ravid Shwartz-Ziv Tomer Galanti S. Dekel Yann LeCun SSL 23 34 0 24 May 2023
A Measure-Theoretic Axiomatisation of Causality Junhyung Park Simon Buchholz Bernhard Schölkopf Krikamol Muandet 38 5 0 19 May 2023
Evolutionary Augmentation Policy Optimization for Self-supervised Learning Noah Barrett Zahra Sadeghi Stan Matwin 30 3 0 02 Mar 2023
Simple Disentanglement of Style and Content in Visual Representations Lilian Ngweta Subha Maity Alex Gittens Yuekai Sun Mikhail Yurochkin CoGe DRL 32 7 0 20 Feb 2023
Self-supervised learning of Split Invariant Equivariant representations Q. Garrido Laurent Najman Yann LeCun SSL 29 32 0 14 Feb 2023
On the Interventional Kullback-Leibler Divergence J. Wildberger Siyuan Guo Arnab Bhattacharyya Bernhard Schölkopf OOD CML 31 6 0 10 Feb 2023
Emerging Synergies in Causality and Deep Generative Models: A Survey Guanglin Zhou Shaoan Xie Guang-Yuan Hao Shiming Chen Erdun Gao Xiwei Xu Chen Wang Liming Zhu Lina Yao Anton van den Hengel AI4CE 55 11 0 29 Jan 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning Jiajun Ma Tianyang Hu Wenjia Wang 17 8 0 28 Jan 2023
Causal Triplet: An Open Challenge for Intervention-centric Causal Representation Learning Yuejiang Liu Alexandre Alahi Chris Russell Max Horn Dominik Zietlow Bernhard Schölkopf Francesco Locatello CML 56 22 0 12 Jan 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 20 9 0 27 Dec 2022
Homomorphic Self-Supervised Learning Thomas Anderson Keller Xavier Suau Luca Zappella SSL 19 2 0 15 Nov 2022
More Generalized and Personalized Unsupervised Representation Learning In A Distributed System Yue Yang Jingwei Sun Ang Li H. Li Yiran Chen OOD 31 0 0 11 Nov 2022
The Robustness Limits of SoTA Vision Models to Natural Variation Mark Ibrahim Q. Garrido Ari S. Morcos Diane Bouchacourt VLM 43 16 0 24 Oct 2022