Leveraging Unlabeled Data to Predict Out-of-Distribution Performance

Leveraging Unlabeled Data to Predict Out-of-Distribution Performance

11 January 2022

Sivaraman Balakrishnan

Zachary Chase Lipton

Behnam Neyshabur

Papers citing "Leveraging Unlabeled Data to Predict Out-of-Distribution Performance"

18 / 18 papers shown

Title
Incremental Uncertainty-aware Performance Monitoring with Active Labeling Intervention Alexander Koebler Thomas Decker Ingo Thon Volker Tresp Florian Buettner 29 0 0 11 May 2025
Performance Estimation in Binary Classification Using Calibrated Confidence Juhani Kivimäki Jakub Białek W. Kuberski J. Nurminen 50 0 0 08 May 2025
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 40 0 0 14 Jun 2024
Leveraging Gradients for Unsupervised Accuracy Estimation under Distribution Shift Renchunzi Xie Ambroise Odonnat Vasilii Feofanov I. Redko Jianfeng Zhang Bo An UQCV 80 1 0 17 Jan 2024
Estimating Model Performance Under Covariate Shift Without Labels Jakub Bialek W. Kuberski Nikolaos Perrakis Albert Bifet 39 2 0 16 Jan 2024
Learning Diverse Features in Vision Transformers for Improved Generalization A. Nicolicioiu Andrei Liviu Nicolicioiu B. Alexe Damien Teney 33 3 0 30 Aug 2023
Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn OOD 19 5 0 19 Jun 2023
Estimating Large Language Model Capabilities without Labeled Test Data Harvey Yiyun Fu Qinyuan Ye Albert Xu Xiang Ren Robin Jia 21 8 0 24 May 2023
A Bag-of-Prototypes Representation for Dataset-Level Applications Wei-Chih Tu Weijian Deng Tom Gedeon Liang Zheng 38 9 0 23 Mar 2023
Demystifying Disagreement-on-the-Line in High Dimensions Dong-Hwan Lee Behrad Moniri Xinmeng Huang Yan Sun Hamed Hassani 21 8 0 31 Jan 2023
Leveraging Unlabeled Data to Track Memorization Mahsa Forouzesh Hanie Sedghi Patrick Thiran NoLa TDI 34 4 0 08 Dec 2022
Explanation Shift: Detecting distribution shifts on tabular data via the explanation space Carlos Mougan Klaus Broelemann Gjergji Kasneci T. Tiropanis Steffen Staab FAtt 27 7 0 22 Oct 2022
Estimating Model Performance under Domain Shifts with Class-Specific Confidence Scores Zeju Li Konstantinos Kamnitsas Mobarakol Islam Chen Chen Ben Glocker 30 9 0 20 Jul 2022
On the Strong Correlation Between Model Invariance and Generalization Weijian Deng Stephen Gould Liang Zheng OOD 32 16 0 14 Jul 2022
Estimating Test Performance for AI Medical Devices under Distribution Shift with Conformal Prediction Charles Lu Syed Rakin Ahmed Praveer Singh Jayashree Kalpathy-Cramer OOD 25 5 0 12 Jul 2022
A Note on "Assessing Generalization of SGD via Disagreement" Andreas Kirsch Y. Gal FedML UQCV 26 15 0 03 Feb 2022
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,661 0 05 Dec 2016
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 125 577 0 27 Feb 2015