Objectives Matter: Understanding the Impact of Self-Supervised
Objectives on Vision Transformer Representations

Objectives Matter: Understanding the Impact of Self-Supervised Objectives on Vision Transformer Representations

25 April 2023

Shashank Shekhar

Pascal Vincent

Papers citing "Objectives Matter: Understanding the Impact of Self-Supervised Objectives on Vision Transformer Representations"

13 / 13 papers shown

Title
Perception Encoder: The best visual embeddings are not at the output of the network Daniel Bolya Po-Yao (Bernie) Huang Peize Sun Jang Hyun Cho Andrea Madotto ... Shiyu Dong Nikhila Ravi Daniel Li Piotr Dollár Christoph Feichtenhofer ObjD VOS 103 1 0 17 Apr 2025
LiFT: A Surprisingly Simple Lightweight Feature Transform for Dense ViT Descriptors Saksham Suri Matthew Walmer Kamal Gupta Abhinav Shrivastava 41 4 0 21 Mar 2024
Exploring scalable medical image encoders beyond text supervision Fernando Pérez-García Harshita Sharma Sam Bond-Taylor Kenza Bouzid Valentina Salvatelli ... Maria T. A. Wetscherek Noel C. F. Codella Stephanie L. Hyland Javier Alvarez-Valle Ozan Oktay LM&MA MedIm 50 26 0 19 Jan 2024
Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis Yafei Hu Quanting Xie Vidhi Jain Jonathan M Francis Jay Patrikar ... Xiaolong Wang Sebastian A. Scherer Z. Kira Fei Xia Yonatan Bisk LM&Ro AI4CE 37 63 0 14 Dec 2023
Multi-entity Video Transformers for Fine-Grained Video Representation Learning Matthew Walmer Rose Kanjirathinkal Kai Sheng Tai Keyur Muzumdar Taipeng Tian Abhinav Shrivastava ViT 31 0 0 17 Nov 2023
ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy Kirill Vishniakov Zhiqiang Shen Zhuang Liu CLIP 42 16 0 15 Nov 2023
Virchow: A Million-Slide Digital Pathology Foundation Model Eugene Vorontsov Alican Bozkurt Adam Casson George Shaikovski Michal Zelechowski ... Razik Yousfi Christopher Kanan David Klimstra B. Rothrock Thomas J. Fuchs MedIm 13 82 0 14 Sep 2023
A Multidimensional Analysis of Social Biases in Vision Transformers Jannik Brinkmann Paul Swoboda Christian Bartelt 24 6 0 03 Aug 2023
AnyLoc: Towards Universal Visual Place Recognition Nikhil Varma Keetha Avneesh Mishra Jay Karhade Krishna Murthy Jatavallabhula Sebastian Scherer Madhava Krishna Sourav Garg 33 117 0 01 Aug 2023
What Do Self-Supervised Vision Transformers Learn? Namuk Park Wonjae Kim Byeongho Heo Taekyung Kim Sangdoo Yun SSL 71 76 1 01 May 2023
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 308 7,457 0 11 Nov 2021
Intriguing Properties of Vision Transformers Muzammal Naseer Kanchana Ranasinghe Salman Khan Munawar Hayat Fahad Shahbaz Khan Ming-Hsuan Yang ViT 265 621 0 21 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 356 5,811 0 29 Apr 2021