Measuring Calibration in Deep Learning

2 April 2019

Jeremy Nixon

Michael W. Dusenberry

Papers citing "Measuring Calibration in Deep Learning"

50 / 310 papers shown

Title
Are vision language models robust to uncertain inputs? Xi Wang Eric Nalisnick AAML VLM 19 0 0 17 May 2025
Calibration and Uncertainty for multiRater Volume Assessment in multiorgan Segmentation (CURVAS) challenge results Meritxell Riera-Marin S. Ko Julia Rodriguez-Comas Matthias Stefan May Zhaohong Pan ... Anton Aubanell Andreu Antolin Javier Garcia-Lopez M. A. G. Ballester Adrian Galdran UQCV 51 0 0 13 May 2025
Performance Estimation in Binary Classification Using Calibrated Confidence Juhani Kivimäki Jakub Białek W. Kuberski J. Nurminen 55 0 0 08 May 2025
Position: Epistemic Artificial Intelligence is Essential for Machine Learning Models to Know When They Do Not Know Shireen Kudukkil Manchingal Fabio Cuzzolin 63 0 0 08 May 2025
Always Tell Me The Odds: Fine-grained Conditional Probability Estimation Liaoyaqi Wang Zhengping Jiang Anqi Liu Benjamin Van Durme 63 0 0 02 May 2025
Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review Toghrul Abbasli Kentaroh Toyoda Yuan Wang Leon Witt Muhammad Asif Ali Yukai Miao Dan Li Qingsong Wei UQCV 94 0 0 25 Apr 2025
On the calibration of Just-in-time Defect Prediction Xhulja Shahini Jone Bartel Klaus Pohl 23 0 0 16 Apr 2025
Beyond Accuracy: What Matters in Designing Well-Behaved Models? Robin Hesse Doğukan Bağcı Bernt Schiele Simone Schaub-Meyer Stefan Roth VLM 64 0 0 21 Mar 2025
Uncertainty Distillation: Teaching Language Models to Express Semantic Confidence Sophia Hager David Mueller Kevin Duh Nicholas Andrews 72 0 0 18 Mar 2025
Mixed-feature Logistic Regression Robust to Distribution Shifts Qingshi Sun Nathan Justin A. Gómez P. Vayanos OOD 55 0 0 15 Mar 2025
O-TPT: Orthogonality Constraints for Calibrating Test-time Prompt Tuning in Vision-Language Models Ashshak Sharifdeen Muhammad Akhtar Munir Sanoojan Baliah Salman Khan M. H. Khan VLM 59 0 0 15 Mar 2025
A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice Eric Heim Oren Wright David Shriver OOD FaML 73 0 0 01 Mar 2025
Optimizing Estimators of Squared Calibration Errors in Classification Sebastian G. Gruber Francis Bach 77 1 0 24 Feb 2025
Can ChatGPT Diagnose Alzheimer's Disease? Quoc Toan Nguyen Linh Le Xuan-The Tran T. Do Chin-Teng Lin LM&MA 314 0 0 10 Feb 2025
Technical report on label-informed logit redistribution for better domain generalization in low-shot classification with foundation models Behraj Khan T. Syed 225 1 0 29 Jan 2025
Predictable Artificial Intelligence Lexin Zhou Pablo Antonio Moreno Casares Fernando Martínez-Plumed John Burden Ryan Burnell ... Seán Ó hÉigeartaigh Danaja Rutar Wout Schellaert Konstantinos Voudouris José Hernández-Orallo 56 2 0 08 Jan 2025
Uncertainty quantification for improving radiomic-based models in radiation pneumonitis prediction Chanon Puttanawarut Romen Samuel Wabina Nat Sirirutbunkajorn AI4CE 46 0 0 27 Dec 2024
Combining Priors with Experience: Confidence Calibration Based on Binomial Process Modeling Jinzong Dong Zhaohui Jiang Dong Pan Haoyang Yu 66 0 0 14 Dec 2024
Enhancing Trust in Large Language Models with Uncertainty-Aware Fine-Tuning R. Krishnan Piyush Khanna Omesh Tickoo HILM 72 1 0 03 Dec 2024
Exponential Moving Average of Weights in Deep Learning: Dynamics and Benefits Daniel Morales-Brotons Thijs Vogels Hadrien Hendrikx 129 17 0 27 Nov 2024
Labels in Extremes: How Well Calibrated are Extreme Multi-label Classifiers? Nasib Ullah Erik Schultheis Jinbin Zhang Rohit Babbar 36 0 0 06 Nov 2024
Confidence Calibration of Classifiers with Many Classes Adrien LeCoz Stéphane Herbin Faouzi Adjed UQCV 44 1 0 05 Nov 2024
Rethinking the Uncertainty: A Critical Review and Analysis in the Era of Large Language Models Mohammad Beigi Sijia Wang Ying Shen Zihao Lin Adithya Kulkarni ... Ming Jin Jin-Hee Cho Dawei Zhou Chang-Tien Lu Lifu Huang 36 1 0 26 Oct 2024
Calibration of Ordinal Regression Networks Daehwan Kim Haejun Chung Ikbeom Jang UQCV 26 0 0 21 Oct 2024
The Bayesian Confidence (BACON) Estimator for Deep Neural Networks Patrick D. Kee Max J. Brown Jonathan C. Rice Christian A. Howell UQCV 29 0 0 16 Oct 2024
Consistency Calibration: Improving Uncertainty Calibration via Consistency among Perturbed Neighbors Linwei Tao Haolan Guo Minjing Dong Chang Xu UQCV AAML 32 2 0 16 Oct 2024
Sampling from Bayesian Neural Network Posteriors with Symmetric Minibatch Splitting Langevin Dynamics Daniel Paulin P. Whalley Neil K. Chada B. Leimkuhler BDL 52 4 0 14 Oct 2024
Understanding Human Activity with Uncertainty Measure for Novelty in Graph Convolutional Networks Hao Xing Darius Burschka 31 1 0 10 Oct 2024
Fill In The Gaps: Model Calibration and Generalization with Synthetic Data Yang Ba M. Mancenido Rong Pan SyDa 26 1 0 07 Oct 2024
Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models Shuoyuan Wang Yixuan Li Hongxin Wei VLM 61 2 0 03 Oct 2024
A Survey on the Honesty of Large Language Models Siheng Li Cheng Yang Taiqiang Wu Chufan Shi Yuji Zhang ... Jie Zhou Yujiu Yang Ngai Wong Xixin Wu Wai Lam HILM 37 5 0 27 Sep 2024
SAUC: Sparsity-Aware Uncertainty Calibration for Spatiotemporal Prediction with Graph Neural Networks Dingyi Zhuang Yuheng Bu Guang Wang Shenhao Wang Jinhua Zhao BDL 40 1 0 13 Sep 2024
Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation P. Mody Nicolas F. Chaves-de-Plaza Chinmay Rao Eleftheria Astrenidou M. de Ridder N. Hoekstra Klaus Hildebrandt Marius Staring UQCV 27 0 0 05 Sep 2024
Does Alignment Tuning Really Break LLMs' Internal Confidence? Hongseok Oh Wonseok Hwang 49 0 0 31 Aug 2024
A conformalized learning of a prediction set with applications to medical imaging classification Roy Hirsch Jacob Goldberger MedIm 29 0 0 09 Aug 2024
Dual-View Pyramid Pooling in Deep Neural Networks for Improved Medical Image Classification and Confidence Calibration Xiaoqing Zhang Qiushi Nie Zunjie Xiao Jilu Zhao Xiao Wu Pengxin Guo Runzhi Li Jin Liu Yanjie Wei Yi-Lun Pan 44 0 0 06 Aug 2024
Evaluating Posterior Probabilities: Decision Theory, Proper Scoring Rules, and Calibration Luciana Ferrer Daniel Ramos UQCV 33 4 0 05 Aug 2024
A Decision-driven Methodology for Designing Uncertainty-aware AI Self-Assessment Charles Oredola Vladimir Leung Adnan Ashraf Eric Heim I-Jeng Wang 51 1 0 02 Aug 2024
STAMP: Outlier-Aware Test-Time Adaptation with Stable Memory Replay Yongcan Yu Lijun Sheng Ran He Jian Liang TTA 57 2 0 22 Jul 2024
Achieving Well-Informed Decision-Making in Drug Discovery: A Comprehensive Calibration Study using Neural Network-Based Structure-Activity Models Hannah Rosa Friesacher Ola Engkvist Lewis H. Mervin Yves Moreau Adam Arany 39 0 0 19 Jul 2024
Domain-specific or Uncertainty-aware models: Does it really make a difference for biomedical text classification? Aman Sinha Timothee Mickus Marianne Clausel Mathieu Constant X. Coubez 47 0 0 17 Jul 2024
Uncertainty Calibration with Energy Based Instance-wise Scaling in the Wild Dataset Mijoo Kim Junseok Kwon UQCV 30 1 0 17 Jul 2024
On the Calibration of Epistemic Uncertainty: Principles, Paradoxes and Conflictual Loss Mohammed Fellaji Frédéric Pennerath Brieuc Conan-Guez Miguel Couceiro UQCV 51 1 0 16 Jul 2024
Dynamic Correlation Learning and Regularization for Multi-Label Confidence Calibration Tianshui Chen Weihang Wang Tao Pu Jinghui Qin Zhijing Yang Jie Liu Liang Lin 29 6 0 09 Jul 2024
Accessible, At-Home Detection of Parkinson's Disease via Multi-task Video Analysis Md. Saiful Islam Tariq Adnan Jan Freyberg Sangwu Lee Abdelrahman Abdelkader ... Cathe Schwartz Karen Jaffe Ruth B. Schneider E. R. Dorsey Ehsan Hoque 77 0 0 21 Jun 2024
Evidential Uncertainty Sets in Deep Classifiers Using Conformal Prediction Hamed Karimi Reza Samavi BDL EDL UQCV 45 1 0 16 Jun 2024
Flexible Heteroscedastic Count Regression with Deep Double Poisson Networks Spencer Young Porter Jenkins Lonchao Da Jeff Dotson Hua Wei UQCV BDL 49 2 0 13 Jun 2024
Reassessing How to Compare and Improve the Calibration of Machine Learning Models M. Chidambaram Rong Ge 74 1 0 06 Jun 2024
Decoupling of neural network calibration measures D. Wolf Prasannavenkatesh Balaji Alexander Braun Markus Ulrich UQCV 44 3 0 04 Jun 2024
On Calibration of Object Detectors: Pitfalls, Evaluation and Baselines Selim Kuzucu Kemal Oksuz Jonathan Sadeghi P. Dokania 46 4 0 30 May 2024