Representation Learning via Non-Contrastive Mutual Information

Representation Learning via Non-Contrastive Mutual Information

23 April 2025

Bernardo Avila-Pires

Khimya Khetarpal

Dale Schuurmans

ArXiv (abs)PDF HTML

Papers citing "Representation Learning via Non-Contrastive Mutual Information"

16 / 16 papers shown

Title
Spectral Representation for Causal Estimation with Hidden Confounders Zhaolin Ren Haotian Sun Antoine Moulin Arthur Gretton Bo Dai CML 116 3 0 15 Jul 2024
The Edge of Orthogonality: A Simple View of What Makes BYOL Tick Pierre Harvey Richemond Allison C. Tam Yunhao Tang Florian Strub Bilal Piot Felix Hill SSL 76 11 0 09 Feb 2023
Understanding Self-Predictive Learning for Reinforcement Learning Yunhao Tang Z. Guo Pierre Harvey Richemond Bernardo Avila-Pires Yash Chandak ... S. Thakoor Will Dabney Bilal Piot Daniele Calandriello Michal Valko SSL 110 30 0 06 Dec 2022
Towards Demystifying Representation Learning with Non-contrastive Self-supervision Xiang Wang Xinlei Chen S. Du Yuandong Tian SSL 78 26 0 11 Oct 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 85 322 0 08 Jun 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 153 945 0 11 May 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 347 2,368 0 04 Mar 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 225 286 0 12 Feb 2021
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 260 4,076 0 20 Nov 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 99 167 0 24 Aug 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 423 6,849 0 13 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 120 1,338 0 20 May 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 395 18,897 0 13 Feb 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 216 12,136 0 13 Nov 2019
Sampling Matters in Deep Embedding Learning Chaoxia Wu R. Manmatha Alex Smola Philipp Krahenbuhl 122 924 0 23 Jun 2017
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.3K 194,641 0 10 Dec 2015