Deciphering the Projection Head: Representation Evaluation
Self-supervised Learning

Deciphering the Projection Head: Representation Evaluation Self-supervised Learning

28 January 2023

Tianyang Hu

Papers citing "Deciphering the Projection Head: Representation Evaluation Self-supervised Learning"

10 / 10 papers shown

Title
Projection Head is Secretly an Information Bottleneck Zhuo Ouyang Kaiwen Hu Qi Zhang Yifei Wang Yisen Wang 51 1 0 01 Mar 2025
Towards evolution of Deep Neural Networks through contrastive Self-Supervised learning Adriano Vinhas João Correia Penousal Machado SSL 29 1 0 20 Jun 2024
The Surprising Effectiveness of Skip-Tuning in Diffusion Sampling Jiajun Ma Shuchen Xue Tianyang Hu Wei Cao Zhaoqiang Liu Zhenguo Li Zhi-Ming Ma Kenji Kawaguchi 48 5 0 23 Feb 2024
Understanding Collapse in Non-Contrastive Siamese Representation Learning Alexander C. Li Alexei A. Efros Deepak Pathak SSL 53 33 0 29 Sep 2022
Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embedding Tianyang Hu Zhili Liu Fengwei Zhou Wei Cao Weiran Huang SSL 47 26 0 30 May 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 311 7,457 0 11 Nov 2021
Decoupled Contrastive Learning Chun-Hsiao Yeh Cheng-Yao Hong Yen-Chi Hsu Tyng-Luh Liu Yubei Chen Yann LeCun 183 183 0 13 Oct 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 356 5,811 0 29 Apr 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 281 0 12 Feb 2021
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 273 3,375 0 09 Mar 2020