Measuring Calibration in Deep Learning

2 April 2019

Jeremy Nixon

Michael W. Dusenberry

Papers citing "Measuring Calibration in Deep Learning"

50 / 310 papers shown

Title
Towards Unbiased Calibration using Meta-Regularization Cheng Wang Jacek Golebiowski 39 1 0 27 Mar 2023
Reliability in Semantic Segmentation: Are We on the Right Track? Pau de Jorge Riccardo Volpi Philip Torr Grégory Rogez UQCV 26 19 0 20 Mar 2023
Calibration of Neural Networks Ruslan Vasilev A. Dýakonov 15 8 0 19 Mar 2023
Validation of uncertainty quantification metrics: a primer based on the consistency and adaptivity concepts P. Pernot 15 6 0 13 Mar 2023
Machine learning for sports betting: should model selection be based on accuracy or calibration? Conor Walsh Alok Joshi 23 1 0 10 Mar 2023
Adaptive Calibrator Ensemble for Model Calibration under Distribution Shift Yu-Hui Zou Weijian Deng Liang Zheng OODD 25 2 0 09 Mar 2023
Rethinking Confidence Calibration for Failure Prediction Fei Zhu Zhen Cheng Xu-Yao Zhang Cheng-Lin Liu UQCV 22 39 0 06 Mar 2023
A Survey on Uncertainty Quantification Methods for Deep Learning Wenchong He Zhe Jiang Tingsong Xiao Zelin Xu Yukun Li BDL UQCV AI4CE 27 19 0 26 Feb 2023
What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifiers Ido Galil Mohammed Dabbah Ran El-Yaniv UQCV 38 25 0 23 Feb 2023
Distilling Calibrated Student from an Uncalibrated Teacher Ishan Mishra Sethu Vamsi Krishna Deepak Mishra FedML 40 2 0 22 Feb 2023
Calibrating the Rigged Lottery: Making All Tickets Reliable Bowen Lei Ruqi Zhang Dongkuan Xu Bani Mallick UQCV 27 7 0 18 Feb 2023
On (assessing) the fairness of risk score models Eike Petersen M. Ganz Sune Holm Aasa Feragen FaML 28 20 0 17 Feb 2023
Calibrating a Deep Neural Network with Its Predecessors Linwei Tao Minjing Dong Daochang Liu Changming Sun Chang Xu BDL UQCV 16 5 0 13 Feb 2023
Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels Zifu Wang Xuefei Ning Matthew B. Blaschko VLM 39 12 0 11 Feb 2023
On the Richness of Calibration Benedikt Höltgen Robert C. Williamson 13 9 0 08 Feb 2023
Long Horizon Temperature Scaling Andy Shih Dorsa Sadigh Stefano Ermon DiffM 29 14 0 07 Feb 2023
Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications Chengyu Dong OOD UQCV BDL AI4CE 44 0 0 02 Feb 2023
Weakly Supervised Joint Whole-Slide Segmentation and Classification in Prostate Cancer Pushpak Pati Guillaume Jaume Zeineb Ayadi Kevin Thandiackal Behzad Bozorgtabar M. Gabrani O. Goksel 20 17 0 07 Jan 2023
Benchmarking common uncertainty estimation methods with histopathological images under domain shift and label noise H. A. Mehrtens Alexander Kurz Tabea-Clara Bucher T. Brinker OOD UQCV 205 11 0 03 Jan 2023
DDSupport: Language Learning Support System that Displays Differences and Distances from Model Speech Kazuki Kawamura Jun Rekimoto 38 0 0 08 Dec 2022
Investigating Deep Learning Model Calibration for Classification Problems in Mechanics S. Mohammadzadeh Peerasait Prachaseree Emma Lejeune AI4CE 39 2 0 01 Dec 2022
A Unifying Theory of Distance from Calibration Jarosław Błasiok Parikshit Gopalan Lunjia Hu Preetum Nakkiran 31 33 0 30 Nov 2022
Predicting adverse outcomes following catheter ablation treatment for atrial fibrillation J. Quiroz D. Brieger Louisa R Jorm R. Sy B. Hsu B. Gallego 30 0 0 22 Nov 2022
Layer-Stack Temperature Scaling Amr Khalifa Michael C. Mozer Hanie Sedghi Behnam Neyshabur Ibrahim M. Alabdulmohsin 81 2 0 18 Nov 2022
Introduction and Exemplars of Uncertainty Decomposition Shuo Chen UD UQCV PER 35 0 0 17 Nov 2022
UATTA-ENS: Uncertainty Aware Test Time Augmented Ensemble for PIRC Diabetic Retinopathy Detection Pratinav Seth Adil Mehmood Khan Ananya Gupta Saurabh Mishra Akshat Bhandhari 31 0 0 06 Nov 2022
Behavioral Intention Prediction in Driving Scenes: A Survey Jianwu Fang Fan Wang Jianru Xue Tat-Seng Chua 65 44 0 01 Nov 2022
A Close Look into the Calibration of Pre-trained Language Models Yangyi Chen Lifan Yuan Ganqu Cui Zhiyuan Liu Heng Ji 48 44 0 31 Oct 2022
Stop Measuring Calibration When Humans Disagree Joris Baan Wilker Aziz Barbara Plank Raquel Fernández 29 53 0 28 Oct 2022
Useful Confidence Measures: Beyond the Max Score G. Yona Amir Feder Itay Laish 81 5 0 25 Oct 2022
Confidence-Calibrated Face and Kinship Verification Min Xu Ximiao Zhang Xiuzhuang Zhou CVBM 37 4 0 25 Oct 2022
Exploring Predictive Uncertainty and Calibration in NLP: A Study on the Impact of Method & Data Scarcity Dennis Ulmer J. Frellsen Christian Hardmeier 200 22 0 20 Oct 2022
On the calibration of underrepresented classes in LiDAR-based semantic segmentation M. Dreissig Florian Piewak Joschka Boedecker 33 1 0 13 Oct 2022
Can Calibration Improve Sample Prioritization? Ganesh Tata Gautham Krishna Gudur Gopinath Chennupati Mohammad Emtiyaz Khan 11 0 0 12 Oct 2022
On the Importance of Calibration in Semi-supervised Learning Charlotte Loh Rumen Dangovski Shivchander Sudalairaj Seung-Jun Han Ligong Han Leonid Karlinsky Marin Soljacic Akash Srivastava 29 6 0 10 Oct 2022
Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysis Benjamin Lambert Florence Forbes A. Tucholka Senan Doyle Harmonie Dehaene M. Dojat 34 81 0 05 Oct 2022
The Calibration Generalization Gap Annabelle Carrell Neil Rohit Mallinar James Lucas Preetum Nakkiran UQCV 34 18 0 05 Oct 2022
MEDFAIR: Benchmarking Fairness for Medical Imaging Yongshuo Zong Yongxin Yang Timothy M. Hospedales OOD 81 59 0 04 Oct 2022
Predictive Inference with Feature Conformal Prediction Jiaye Teng Chuan Wen Dinghuai Zhang Yoshua Bengio Yang Gao Yang Yuan 34 26 0 01 Oct 2022
Neural Clamping: Joint Input Perturbation and Temperature Scaling for Neural Network Calibration Yu Tang Pin-Yu Chen Tsung-Yi Ho 31 5 0 23 Sep 2022
Analysis and Comparison of Classification Metrics Luciana Ferrer 31 19 0 12 Sep 2022
Active Learning and Novel Model Calibration Measurements for Automated Visual Inspection in Manufacturing Jože M. Rožanec Luka Bizjak Elena Trajkova Patrik Zajec Jelle Keizer B. Fortuna Dunja Mladenić 26 11 0 12 Sep 2022
GRASP: A Goodness-of-Fit Test for Classification Learning Adel Javanmard M. Mehrabi 17 0 0 05 Sep 2022
A Principled Evaluation Protocol for Comparative Investigation of the Effectiveness of DNN Classification Models on Similar-but-non-identical Datasets Esla Timothy Anzaku Haohan Wang Arnout Van Messem W. D. Neve 41 2 0 05 Sep 2022
Calibrated Selective Classification Adam Fisch Tommi Jaakkola Regina Barzilay 34 17 0 25 Aug 2022
Repair Is Nearly Generation: Multilingual Program Repair with LLMs Harshit Joshi J. Cambronero Sumit Gulwani Vu Le Ivan Radicek Gust Verbruggen LRM 28 125 0 24 Aug 2022
Deep Learning for Choice Modeling Zhongze Cai Hanrui Wang Kalyan Talluri Xiaocheng Li 29 7 0 19 Aug 2022
Interpretable Uncertainty Quantification in AI for HEP Thomas Y. Chen B. Dey A. Ghosh Michael Kagan Brian D. Nord Nesar Ramachandra 38 7 0 05 Aug 2022
Improved post-hoc probability calibration for out-of-domain MRI segmentation Cheng Ouyang Shuo Wang Chong Chen Zeju Li Wenjia Bai Bernhard Kainz Daniel Rueckert UQCV MedIm 21 4 0 04 Aug 2022
Adaptive Temperature Scaling for Robust Calibration of Deep Neural Networks Sérgio A. Balanya Juan Maroñas Daniel Ramos OOD 43 14 0 31 Jul 2022