v1v2v3 (latest)

Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods

23 May 2022

Papers citing "Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods"

50 / 53 papers shown

Title
Position: An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Research Patrik Reizinger Randall Balestriero David Klindt Wieland Brendel 175 1 0 17 Apr 2025
Riemannian Optimization on Relaxed Indicator Matrix Manifold Jinghui Yuan Fangyuan Xie Feiping Nie Xuelong Li 101 0 0 26 Mar 2025
Enhancing Graph Self-Supervised Learning with Graph Interplay Xinjian Zhao Wei Pang Xiangru Jian Yaoyao Xu Chaolong Ying Tianshu Yu 203 0 0 17 Jan 2025
Cross-Entropy Is All You Need To Invert the Data Generating Process Patrik Reizinger Alice Bizeul Attila Juhos Julia E. Vogt Randall Balestriero Wieland Brendel David Klindt SSL OOD BDL DRL 209 6 0 29 Oct 2024
InfoNCE: Identifying the Gap Between Theory and Practice E. Rusak Patrik Reizinger Attila Juhos Oliver Bringmann Roland S. Zimmermann Wieland Brendel 103 10 0 28 Jun 2024
Unsupervised Multi-modal Feature Alignment for Time Series Representation Learning Cheng Liang Donghua Yang Zhiyu Liang Hongzhi Wang Zheng Liang Xiyang Zhang Jianfeng Huang AI4TS 449 2 0 09 Dec 2023
Augmentation Invariant Manifold Learning Shulei Wang 225 1 0 01 Nov 2022
Beyond Separability: Analyzing the Linear Transferability of Contrastive Representations to Related Subpopulations Jeff Z. HaoChen Colin Wei Ananya Kumar Tengyu Ma 75 39 0 06 Apr 2022
Contrasting the landscape of contrastive and non-contrastive learning Ashwini Pokle Jinjin Tian Yuchen Li Andrej Risteski SSL 88 28 0 29 Mar 2022
High Fidelity Visualization of What Your Self-Supervised Representation Knows About Florian Bordes Randall Balestriero Pascal Vincent DiffM 77 65 0 16 Dec 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 477 7,819 0 11 Nov 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 120 358 0 18 Oct 2021
Towards Demystifying Representation Learning with Non-contrastive Self-supervision Xiang Wang Xinlei Chen S. Du Yuandong Tian SSL 70 26 0 11 Oct 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 289 2,841 0 15 Jun 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 77 321 0 08 Jun 2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning Zixin Wen Yuanzhi Li SSL MLT 74 136 0 31 May 2021
Mean Shift for Self-Supervised Learning Soroush Abbasi Koohpayegani Ajinkya Tejankar Hamed Pirsiavash SSL 56 93 0 15 May 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 153 944 0 11 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 185 195 0 02 May 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 241 467 0 29 Apr 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 724 6,127 0 29 Apr 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 347 2,362 0 04 Mar 2021
Minimum-Distortion Embedding Akshay Agrawal Alnur Ali Stephen P. Boyd 59 59 0 03 Mar 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 213 286 0 12 Feb 2021
How Well Do Self-Supervised Models Transfer? Linus Ericsson Henry Gouk Timothy M. Hospedales SSL 114 278 0 26 Nov 2020
Run Away From your Teacher: Understanding BYOL by a Novel Self-Supervised Approach Haizhou Shi Dongliang Luo Siliang Tang Jian Wang Yueting Zhuang SSL 70 13 0 22 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 258 4,072 0 20 Nov 2020
On the surprising similarities between supervised and self-supervised models Robert Geirhos Kantharaju Narayanappa Benjamin Mitzkus Matthias Bethge Felix Wichmann Wieland Brendel OOD SSL DRL 116 48 0 16 Oct 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 85 167 0 24 Aug 2020
Predicting What You Already Know Helps: Provable Self-Supervised Learning Jason D. Lee Qi Lei Nikunj Saunshi Jiacheng Zhuo SSL 82 189 0 03 Aug 2020
Whitening for Self-Supervised Representation Learning Aleksandr Ermolov Aliaksandr Siarohin E. Sangineto N. Sebe SSL 96 315 0 13 Jul 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 299 5,837 0 20 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 398 6,837 0 13 Jun 2020
Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Tasks Like Hui M. Belkin UQCV AAML VLM 48 172 0 12 Jun 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 162 1,855 0 20 May 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 387 18,866 0 13 Feb 2020
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 108 1,458 0 04 Dec 2019
Generalized Clustering by Learning to Optimize Expected Normalized Cuts Azade Nazi W. Hang Anna Goldie Sujith Ravi Azalia Mirhoseini OOD 60 4 0 16 Oct 2019
Scaling and Benchmarking Self-Supervised Visual Representation Learning Priya Goyal D. Mahajan Abhinav Gupta Ishan Misra SSL 75 397 0 03 May 2019
A Theoretical Analysis of Contrastive Unsupervised Representation Learning Sanjeev Arora H. Khandeparkar M. Khodak Orestis Plevrakis Nikunj Saunshi SSL 103 784 0 25 Feb 2019
Breaking the Softmax Bottleneck via Learnable Monotonic Pointwise Non-linearities O. Ganea Sylvain Gelly Gary Bécigneul Aliaksei Severyn 60 18 0 21 Feb 2019
Self-Supervised Video Representation Learning with Space-Time Cubic Puzzles Dahun Kim Donghyeon Cho In So Kweon SSL 88 349 0 24 Nov 2018
Spectral Inference Networks: Unifying Deep and Spectral Learning David Pfau Stig Petersen Ashish Agarwal David Barrett Kimberly L. Stachenfeld 103 40 0 06 Jun 2018
Self-supervised Learning of Geometrically Stable Features Through Probabilistic Introspection David Novotny Samuel Albanie Diane Larlus Andrea Vedaldi SSL 83 65 0 04 Apr 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 264 3,298 0 21 Mar 2018
Breaking the Softmax Bottleneck: A High-Rank RNN Language Model Zhilin Yang Zihang Dai Ruslan Salakhutdinov William W. Cohen BDL 71 372 0 10 Nov 2017
A Tutorial on Canonical Correlation Methods Viivi Uurtio J. Monteiro J. Kandola John Shawe-Taylor D. Fernández-Reyes Juho Rousu CML 65 107 0 07 Nov 2017
Network Embedding as Matrix Factorization: Unifying DeepWalk, LINE, PTE, and node2vec J. Qiu Yuxiao Dong Hao Ma Jian Li Kuansan Wang Jie Tang 85 918 0 09 Oct 2017
Time-Contrastive Networks: Self-Supervised Learning from Video P. Sermanet Corey Lynch Yevgen Chebotar Jasmine Hsu Eric Jang S. Schaal Sergey Levine SSL 105 830 0 23 Apr 2017
WarpNet: Weakly Supervised Matching for Single-view Reconstruction Angjoo Kanazawa David Jacobs Manmohan Chandraker 62 161 0 19 Apr 2016