Do Self-Supervised and Supervised Methods Learn Similar Visual
Representations?

Do Self-Supervised and Supervised Methods Learn Similar Visual Representations?

1 October 2021

Tom George Grigg

Jason Ramapuram

Papers citing "Do Self-Supervised and Supervised Methods Learn Similar Visual Representations?"

19 / 19 papers shown

Title
Using Self-supervised Learning Can Improve Model Fairness Sofia Yfantidou Dimitris Spathis Marios Constantinides Athena Vakali Daniele Quercia F. Kawsar 59 4 0 04 Jun 2024
Evaluating Fairness in Self-supervised and Supervised Models for Sequential Data Sofia Yfantidou Dimitris Spathis Marios Constantinides Athena Vakali Daniele Quercia F. Kawsar 50 2 0 03 Jan 2024
ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy Kirill Vishniakov Zhiqiang Shen Zhuang Liu CLIP 42 16 0 15 Nov 2023
Heuristic Vision Pre-Training with Self-Supervised and Supervised Multi-Task Learning Zhiming Qian VLM SSL 16 0 0 11 Oct 2023
Similarity of Neural Network Models: A Survey of Functional and Representational Measures Max Klabunde Tobias Schumacher M. Strohmaier Florian Lemmerich 52 64 0 10 May 2023
Objectives Matter: Understanding the Impact of Self-Supervised Objectives on Vision Transformer Representations Shashank Shekhar Florian Bordes Pascal Vincent Ari S. Morcos 18 10 0 25 Apr 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 32 29 0 27 Mar 2023
Self-Supervised Pre-Training for Deep Image Prior-Based Robust PET Image Denoising Yuya Onishi F. Hashimoto K. Ote K. Matsubara M. Ibaraki MedIm 19 11 0 27 Feb 2023
Teaching Matters: Investigating the Role of Supervision in Vision Transformers Matthew Walmer Saksham Suri Kamal Gupta Abhinav Shrivastava 35 33 0 07 Dec 2022
Reliability of CKA as a Similarity Measure in Deep Learning Mohammad-Javad Davari Stefan Horoi A. Natik Guillaume Lajoie Guy Wolf Eugene Belilovsky AAML 84 36 0 28 Oct 2022
Understanding Robust Learning through the Lens of Representation Similarities Christian Cianfarani A. Bhagoji Vikash Sehwag Ben Y. Zhao Prateek Mittal Haitao Zheng OOD 19 16 0 20 Jun 2022
Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning M. Gwilliam Abhinav Shrivastava SSL 76 19 1 16 Jun 2022
Self-Supervised Speech Representation Learning: A Review Abdel-rahman Mohamed Hung-yi Lee Lasse Borgholt Jakob Drachmann Havtorn Joakim Edin ... Shang-Wen Li Karen Livescu Lars Maaløe Tara N. Sainath Shinji Watanabe SSL AI4TS 128 349 0 21 May 2022
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features N. Kalibhat Kanika Narang Hamed Firooz Maziar Sanjabi S. Feizi SSL 31 7 0 03 Mar 2022
Assessing the State of Self-Supervised Human Activity Recognition using Wearables H. Haresamudram Irfan Essa Thomas Plötz SSL 34 85 0 22 Feb 2022
Understanding Cross-Domain Few-Shot Learning Based on Domain Similarity and Few-Shot Difficulty Jaehoon Oh Sungnyun Kim Namgyu Ho Jin-Hwa Kim Hwanjun Song Se-Young Yun 22 34 0 01 Feb 2022
StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets Axel Sauer Katja Schwarz Andreas Geiger 182 489 0 01 Feb 2022
No One Representation to Rule Them All: Overlapping Features of Training Methods Raphael Gontijo-Lopes Yann N. Dauphin E. D. Cubuk 20 60 0 20 Oct 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 317 5,775 0 29 Apr 2021