RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank

5 October 2022

Papers citing "RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank"

50 / 59 papers shown

Title
An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Research Patrik Reizinger Randall Balestriero David Klindt Wieland Brendel 40 0 0 17 Apr 2025
CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation Hariprasath Govindarajan Maciej K. Wozniak Marvin Klingner Camille Maurice B. R. Kiran S. Yogamani 55 0 0 12 Mar 2025
Video Representation Learning with Joint-Embedding Predictive Architectures Katrina Drozdov Ravid Shwartz-Ziv Yann LeCun AI4TS 82 1 0 14 Dec 2024
Does Representation Matter? Exploring Intermediate Layers in Large Language Models Oscar Skean Md Rifat Arefin Yann LeCun Ravid Shwartz-Ziv 81 7 0 12 Dec 2024
Preventing Model Collapse in Deep Canonical Correlation Analysis by Noise Regularization Junlin He Jinxiao Du Susu Xu Wei Ma 26 0 0 01 Nov 2024
HEX: Hierarchical Emergence Exploitation in Self-Supervised Algorithms Kiran Kokilepersaud Seulgi Kim Mohit Prabhushankar Ghassan AlRegib 33 0 0 30 Oct 2024
Adaptive Diffusion Terrain Generator for Autonomous Uneven Terrain Navigation Youwei Yu Junhong Xu Lantao Liu 36 3 0 14 Oct 2024
Self-Supervised Anomaly Detection in the Wild: Favor Joint Embeddings Methods Daniel Otero Rafael Mateus Randall Balestriero 28 0 0 05 Oct 2024
PHI-S: Distribution Balancing for Label-Free Multi-Teacher Distillation Mike Ranzinger Jon Barker Greg Heinrich Pavlo Molchanov Bryan Catanzaro Andrew Tao 39 5 0 02 Oct 2024
Evaluating Deep Regression Models for WSI-Based Gene-Expression Prediction Fredrik K. Gustafsson Mattias Rantalainen 27 0 0 01 Oct 2024
Exploring Information-Theoretic Metrics Associated with Neural Collapse in Supervised Training Kun Song Zhiquan Tan Bochao Zou Jiansheng Chen Huimin Ma Weiran Huang 42 0 0 25 Sep 2024
Towards Automatic Assessment of Self-Supervised Speech Models using Rank Zakaria Aldeneh Vimal Thilak Takuya Higuchi B. Theobald Tatiana Likhomanenko SSL 75 0 0 16 Sep 2024
Train Till You Drop: Towards Stable and Robust Source-free Unsupervised 3D Domain Adaptation Björn Michele Alexandre Boulch Tuan-Hung Vu Gilles Puy Renaud Marlet Nicolas Courty TTA 36 0 0 06 Sep 2024
Multistain Pretraining for Slide Representation Learning in Pathology Guillaume Jaume Anurag J. Vaidya Andrew Zhang Andrew H. Song Richard J. Chen S. Sahai Dandan Mo Emilio Madrigal L. Le Faisal Mahmood 33 12 0 05 Aug 2024
Measuring What Matters: Intrinsic Distance Preservation as a Robust Metric for Embedding Quality Steven N. Hart R. Maulik 27 0 0 31 Jul 2024
Multi-modal Masked Siamese Network Improves Chest X-Ray Representation Learning Saeed Shurrab Alejandro Guerra-Manzanares Farah E. Shamout 31 1 0 05 Jul 2024
HEST-1k: A Dataset for Spatial Transcriptomics and Histology Image Analysis Guillaume Jaume Paul Doucet Andrew H. Song Ming Y. Lu Cristina Almagro-Pérez ... Anurag J. Vaidya Richard J. Chen Drew F. K. Williamson Ahrong Kim Faisal Mahmood 49 29 0 23 Jun 2024
Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations? Mark Ibrahim David Klindt Randall Balestriero SSL 56 2 1 15 Jun 2024
Taxes Are All You Need: Integration of Taxonomical Hierarchy Relationships into the Contrastive Loss Kiran Kokilepersaud Yavuz Yarici Mohit Prabhushankar Ghassan AlRegib 43 2 0 10 Jun 2024
Unveiling the Dynamics of Information Interplay in Supervised Learning Kun Song Zhiquan Tan Bochao Zou Huimin Ma Weiran Huang 35 1 0 06 Jun 2024
Transcriptomics-guided Slide Representation Learning in Computational Pathology Guillaume Jaume Lukas Oldenburg Anurag J. Vaidya Richard J. Chen Drew F. K. Williamson Thomas Peeters Andrew H. Song Faisal Mahmood 47 25 0 19 May 2024
Unveiling Key Aspects of Fine-Tuning in Sentence Embeddings: A Representation Rank Analysis Euna Jung Jaeill Kim Jungmin Ko Jinwoo Park Wonjong Rhee 52 0 0 18 May 2024
Towards Large-Scale Training of Pathology Foundation Models kaiko.ai N. Aben Edwin D. de Jong Ioannis Gatopoulos Nicolas Kanzig Mikhail Karasikov Axel Lagré Roman Moser J. Doorn Fei Tang MedIm AI4CE 37 9 0 24 Mar 2024
Improving Forward Compatibility in Class Incremental Learning by Increasing Representation Rank and Feature Richness Jaeill Kim Wonseok Lee Moonjung Eo Wonjong Rhee CLL 44 0 0 22 Mar 2024
Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress Ameya Prabhu Vishaal Udandarao Philip H. S. Torr Matthias Bethge Adel Bibi Samuel Albanie 42 5 0 29 Feb 2024
Which Model to Transfer? A Survey on Transferability Estimation Yuhe Ding Bo Jiang Aijing Yu Aihua Zheng Jian Liang 45 4 0 23 Feb 2024
Learning by Reconstruction Produces Uninformative Features For Perception Randall Balestriero Yann LeCun 19 20 0 17 Feb 2024
Scalable Graph Self-Supervised Learning Ali Saheb Pasand Reza Moravej Mahdi Biparva Raika Karimi Ali Ghodsi SSL 16 0 0 14 Feb 2024
WERank: Towards Rank Degradation Prevention for Self-Supervised Learning Using Weight Regularization Ali Saheb Pasand Reza Moravej Mahdi Biparva Ali Ghodsi 39 2 0 14 Feb 2024
Few and Fewer: Learning Better from Few Examples Using Fewer Base Classes Raphael Lafargue Yassir Bendou Bastien Pasdeloup J. Diguet Ian Reid Vincent Gripon Jack Valmadre 39 0 0 29 Jan 2024
LDReg: Local Dimensionality Regularized Self-Supervised Learning Hanxun Huang R. Campello S. Erfani Xingjun Ma Michael E. Houle James Bailey 38 5 0 19 Jan 2024
Large-scale Training of Foundation Models for Wearable Biosignals Salar Abbaspourazad Oussama Elachqar Andrew C. Miller S. Emrani Udhyakumar Nallasamy Ian Shapiro 23 31 0 08 Dec 2023
LiDAR: Sensing Linear Probing Performance in Joint Embedding SSL Architectures Vimal Thilak Chen Huang Omid Saremi Laurent Dinh Hanlin Goh Preetum Nakkiran Josh Susskind Etai Littwin 23 7 0 07 Dec 2023
FroSSL: Frobenius Norm Minimization for Efficient Multiview Self-Supervised Learning Oscar Skean A. Dhakal Nathan Jacobs Luis Gonzalo Sánchez Giraldo 31 0 0 04 Oct 2023
Information Flow in Self-Supervised Learning Zhiyuan Tan Jingqin Yang Weiran Huang Yang Yuan Yifan Zhang SSL 30 14 0 29 Sep 2023
Better Practices for Domain Adaptation Linus Ericsson Da Li Timothy M. Hospedales AI4CE TTA 29 4 0 07 Sep 2023
Speech Self-Supervised Representations Benchmarking: a Case for Larger Probing Heads Salah Zaiem Youcef Kemiche Titouan Parcollet S. Essid Mirco Ravanelli SSL 27 11 0 28 Aug 2023
Identifying Interpretable Subspaces in Image Representations N. Kalibhat S. Bhardwaj Bayan Bruss Hamed Firooz Maziar Sanjabi S. Feizi FAtt 42 26 0 20 Jul 2023
On the Importance of Feature Decorrelation for Unsupervised Representation Learning in Reinforcement Learning Hojoon Lee Ko-tik Lee Dongyoon Hwang Hyunho Lee ByungKun Lee Jaegul Choo SSL OOD 26 5 0 09 Jun 2023
Speech Self-Supervised Representation Benchmarking: Are We Doing it Right? Salah Zaiem Youcef Kemiche Titouan Parcollet S. Essid Mirco Ravanelli SSL 14 23 0 01 Jun 2023
Unsupervised Embedding Quality Evaluation Anton Tsitsulin Marina Munkhoeva Bryan Perozzi SSL 6 6 0 26 May 2023
Estimating class separability of text embeddings with persistent homology Kostis Gourgoulias Najah F. Ghalyan Maxime Labonne Yash Satsangi Sean J. Moran Joseph Sabelja 30 0 0 24 May 2023
Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Training Utku Ozbulak Hyun Jung Lee Beril Boga Esla Timothy Anzaku Ho-min Park Arnout Van Messem W. D. Neve J. Vankerschaver DiffM 26 36 0 23 May 2023
A Cookbook of Self-Supervised Learning Randall Balestriero Mark Ibrahim Vlad Sobal Ari S. Morcos Shashank Shekhar ... Pierre Fernandez Amir Bar Hamed Pirsiavash Yann LeCun Micah Goldblum SyDa FedML SSL 44 273 0 24 Apr 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 34 30 0 27 Mar 2023
Unsupervised Learning on a DIET: Datum IndEx as Target Free of Self-Supervision, Reconstruction, Projector Head Randall Balestriero 38 3 0 20 Feb 2023
The SSL Interplay: Augmentations, Inductive Bias, and Generalization Vivien A. Cabannes B. Kiani Randall Balestriero Yann LeCun A. Bietti SSL 19 31 0 06 Feb 2023
Vision Learners Meet Web Image-Text Pairs Bingchen Zhao Quan Cui Hao Wu Osamu Yoshie Cheng Yang Oisin Mac Aodha VLM 24 5 0 17 Jan 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 31 124 0 13 Jan 2023
Understanding Collapse in Non-Contrastive Siamese Representation Learning Alexander C. Li Alexei A. Efros Deepak Pathak SSL 45 33 0 29 Sep 2022