Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations

15 November 2023

Pascal Vincent

Papers citing "Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations"

35 / 35 papers shown

Title
Position: An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Research Patrik Reizinger Randall Balestriero David Klindt Wieland Brendel 182 1 0 17 Apr 2025
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 114 10 0 28 Jun 2024
Identifiability Results for Multimodal Contrastive Learning Imant Daunhawer Alice Bizeul Emanuele Palumbo Alexander Marx Julia E. Vogt 63 42 0 16 Mar 2023
Weakly Supervised Representation Learning with Sparse Perturbations Kartik Ahuja Jason S. Hartford Yoshua Bengio SSL 101 61 0 02 Jun 2022
Weakly supervised causal representation learning Johann Brehmer P. D. Haan Phillip Lippe Taco S. Cohen OOD CML 94 131 0 30 Mar 2022
Improving Transferability of Representations via Augmentation-Aware Self-Supervision Hankook Lee Kibok Lee Kimin Lee Honglak Lee Jinwoo Shin SSL 76 55 0 18 Nov 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 120 359 0 18 Oct 2021
Desiderata for Representation Learning: A Causal Perspective Yixin Wang Michael I. Jordan CML 69 84 0 08 Sep 2021
Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspective Qinjie Lyu Xiao Fu Weiran Wang Songtao Lu SSL 80 31 0 14 Jun 2021
Independent mechanism analysis, a new concept? Luigi Gresele Julius von Kügelgen Vincent Stimper Bernhard Schölkopf M. Besserve CML 80 102 0 09 Jun 2021
Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style Julius von Kügelgen Yash Sharma Luigi Gresele Wieland Brendel Bernhard Schölkopf M. Besserve Francesco Locatello 113 317 0 08 Jun 2021
When Does Contrastive Visual Representation Learning Work? Elijah Cole Xuan S. Yang Kimberly Wilber Oisin Mac Aodha Serge Belongie SSL 88 125 0 12 May 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 155 945 0 11 May 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 347 2,368 0 04 Mar 2021
How Well Do Self-Supervised Models Transfer? Linus Ericsson Henry Gouk Timothy M. Hospedales SSL 122 278 0 26 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 260 4,076 0 20 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 78 177 0 05 Nov 2020
Representation Learning via Invariant Causal Mechanisms Jovana Mitrović Brian McWilliams Jacob Walker Lars Buesing Charles Blundell CML OOD SSL 75 250 0 15 Oct 2020
What Should Not Be Contrastive in Contrastive Learning Tete Xiao Xiaolong Wang Alexei A. Efros Trevor Darrell SSL DRL 96 303 0 13 Aug 2020
Whitening for Self-Supervised Representation Learning Aleksandr Ermolov Aliaksandr Siarohin E. Sangineto N. Sebe SSL 105 316 0 13 Jul 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 423 6,849 0 13 Jun 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 514 3,449 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 398 18,913 0 13 Feb 2020
Weakly-Supervised Disentanglement Without Compromises Francesco Locatello Ben Poole Gunnar Rätsch Bernhard Schölkopf Olivier Bachem Michael Tschannen CoGe OOD DRL 246 320 0 07 Feb 2020
Normalizing Flows for Probabilistic Modeling and Inference George Papamakarios Eric T. Nalisnick Danilo Jimenez Rezende S. Mohamed Balaji Lakshminarayanan TPM AI4CE 215 1,718 0 05 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 216 12,146 0 13 Nov 2019
Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations Francesco Locatello Stefan Bauer Mario Lucic Gunnar Rätsch Sylvain Gelly Bernhard Schölkopf Olivier Bachem OOD 143 1,475 0 29 Nov 2018
Robustly Disentangled Causal Mechanisms: Validating Deep Representations for Interventional Robustness Raphael Suter Ðorðe Miladinovic Bernhard Schölkopf Stefan Bauer CML OOD DRL 141 162 0 31 Oct 2018
Large Batch Training of Convolutional Networks Yang You Igor Gitman Boris Ginsburg ODL 157 853 0 13 Aug 2017
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour Priya Goyal Piotr Dollár Ross B. Girshick P. Noordhuis Lukasz Wesolowski Aapo Kyrola Andrew Tulloch Yangqing Jia Kaiming He 3DH 130 3,688 0 08 Jun 2017
Multi-Level Variational Autoencoder: Learning Disentangled Representations from Grouped Observations Diane Bouchacourt Ryota Tomioka Sebastian Nowozin BDL OOD DRL 75 314 0 24 May 2017
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,637 0 01 Sep 2014
Describing Textures in the Wild Mircea Cimpoi Subhransu Maji Iasonas Kokkinos S. Mohamed Andrea Vedaldi 3DV 156 2,695 0 14 Nov 2013
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 135 2,274 0 21 Jun 2013
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 296 12,467 0 24 Jun 2012