Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration

28 October 2019

Meelis Kull

Miquel Perelló Nieto

Markus Kängsepp

Telmo de Menezes e Silva Filho

Papers citing "Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration"

50 / 86 papers shown

Title
Restoring Calibration for Aligned Large Language Models: A Calibration-Aware Fine-Tuning Approach Jiancong Xiao Bojian Hou Zhanliang Wang Ruochen Jin Q. Long Weijie Su Li Shen 32 0 0 04 May 2025
Three Types of Calibration with Properties and their Semantic and Formal Relationships Rabanus Derr Jessie Finocchiaro Robert C. Williamson 38 0 0 25 Apr 2025
Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review Toghrul Abbasli Kentaroh Toyoda Yuan Wang Leon Witt Muhammad Asif Ali Yukai Miao Dan Li Qingsong Wei UQCV 92 0 0 25 Apr 2025
MBCT: Tree-Based Feature-Aware Binning for Individual Uncertainty Calibration Siguang Huang Yunli Wang Lili Mou Huayue Zhang Ziru Xu Chuan Yu Bo Zheng 60 15 0 13 Mar 2025
Similarity-Distance-Magnitude Universal Verification Allen Schmaltz UQCV AAML 149 0 0 27 Feb 2025
Optimizing Estimators of Squared Calibration Errors in Classification Sebastian G. Gruber Francis Bach 77 1 0 24 Feb 2025
Large Language Model Confidence Estimation via Black-Box Access Tejaswini Pedapati Amit Dhurandhar Soumya Ghosh Soham Dan P. Sattigeri 89 3 0 21 Feb 2025
Understanding the Capabilities and Limitations of Weak-to-Strong Generalization Wei Yao Wenkai Yang Zhilin Wang Yankai Lin Yong Liu ELM 107 1 0 03 Feb 2025
Rethinking Early Stopping: Refine, Then Calibrate Eugene Berta David Holzmüller Michael I. Jordan Francis Bach 67 0 0 31 Jan 2025
Combining Priors with Experience: Confidence Calibration Based on Binomial Process Modeling Jinzong Dong Zhaohui Jiang Dong Pan Haoyang Yu 61 0 0 14 Dec 2024
Confidence Calibration of Classifiers with Many Classes Adrien LeCoz Stéphane Herbin Faouzi Adjed UQCV 37 1 0 05 Nov 2024
GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networks Dingyi Zhuang Chonghe Jiang Yunhan Zheng Shenhao Wang Jinhua Zhao UQCV 39 0 0 12 Oct 2024
Calibrating Expressions of Certainty Peiqi Wang Barbara D. Lam Yingcheng Liu Ameneh Asgari-Targhi Rameswar Panda W. Wells Tina Kapur Polina Golland 34 1 0 06 Oct 2024
SAUC: Sparsity-Aware Uncertainty Calibration for Spatiotemporal Prediction with Graph Neural Networks Dingyi Zhuang Yuheng Bu Guang Wang Shenhao Wang Jinhua Zhao BDL 34 1 0 13 Sep 2024
Reassessing How to Compare and Improve the Calibration of Machine Learning Models M. Chidambaram Rong Ge 74 1 0 06 Jun 2024
Decoupling of neural network calibration measures D. Wolf Prasannavenkatesh Balaji Alexander Braun Markus Ulrich UQCV 44 3 0 04 Jun 2024
Optimizing Calibration by Gaining Aware of Prediction Correctness Yuchi Liu Lei Wang Yuli Zou James Zou Liang Zheng UQCV 44 1 0 19 Apr 2024
Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding Lingdong Kong Xiang Xu Jun Cen Wenwei Zhang Liang Pan Kai-xiang Chen Ziwei Liu 50 5 0 25 Mar 2024
Revisiting Confidence Estimation: Towards Reliable Failure Prediction Fei Zhu Xu-Yao Zhang Zhen Cheng Cheng-Lin Liu UQCV 49 10 0 05 Mar 2024
AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems Clara Punzi Roberto Pellungrini Mattia Setzu F. Giannotti D. Pedreschi 25 5 0 09 Feb 2024
Prevalidated ridge regression is a highly-efficient drop-in replacement for logistic regression for high-dimensional data Angus Dempster Geoffrey I. Webb Daniel F. Schmidt 29 0 0 28 Jan 2024
Inadequacy of common stochastic neural networks for reliable clinical decision support Adrian Lindenmeyer Malte Blattmann S. Franke Thomas Neumuth Daniel Schneider BDL 35 1 0 24 Jan 2024
Towards Interpretable Classification of Leukocytes based on Deep Learning S. Röhrl Johannes Groll M. Lengl Simon Schumann C. Klenk D. Heim Martin Knopp Oliver Hayden Klaus Diepold 27 2 0 24 Nov 2023
A Baseline Analysis of Reward Models' Ability To Accurately Analyze Foundation Models Under Distribution Shift Will LeVine Benjamin Pikus Tony Chen Sean Hendryx 36 8 0 21 Nov 2023
Temperature-scaling surprisal estimates improve fit to human reading times -- but does it do so for the "right reasons"? Tong Liu Iza vSkrjanec Vera Demberg 42 5 0 15 Nov 2023
Do We Still Need Non-Maximum Suppression? Accurate Confidence Estimates and Implicit Duplication Modeling with IoU-Aware Calibration Johannes Gilg Torben Teepe Fabian Herzog Philipp Wolters Gerhard Rigoll 13 1 0 06 Sep 2023
A Theoretical and Practical Framework for Evaluating Uncertainty Calibration in Object Detection Pedro Conde Rui L. Lopes C. Premebida UQCV 13 1 0 01 Sep 2023
Model Calibration in Dense Classification with Adaptive Label Perturbation Jiawei Liu Changkun Ye Shanpeng Wang Rui-Qing Cui Jing Zhang Kai Zhang Nick Barnes 47 5 0 25 Jul 2023
Set Learning for Accurate and Calibrated Models Lukas Muttenthaler Robert A. Vandermeulen Qiuyi Zhang Thomas Unterthiner Klaus-Robert Muller 34 2 0 05 Jul 2023
Scaling of Class-wise Training Losses for Post-hoc Calibration Seungjin Jung Seung-Woo Seo Yonghyun Jeong Jongwon Choi 29 3 0 19 Jun 2023
On the Limitations of Temperature Scaling for Distributions with Overlaps Muthuraman Chidambaram Rong Ge UQCV 37 4 0 01 Jun 2023
Dual Focal Loss for Calibration Linwei Tao Minjing Dong Chang Xu UQCV 44 26 0 23 May 2023
Minimum-Risk Recalibration of Classifiers Zeyu Sun Dogyoon Song Alfred Hero 32 5 0 18 May 2023
Transfer Knowledge from Head to Tail: Uncertainty Calibration under Long-tailed Distribution Jiahao Chen Bingyue Su 32 11 0 13 Apr 2023
Approaching Test Time Augmentation in the Context of Uncertainty Calibration for Deep Neural Networks Pedro Conde T. Barros Rui L. Lopes C. Premebida U. J. Nunes UQCV 24 7 0 11 Apr 2023
Rethinking Confidence Calibration for Failure Prediction Fei Zhu Zhen Cheng Xu-Yao Zhang Cheng-Lin Liu UQCV 19 39 0 06 Mar 2023
Calibrating a Deep Neural Network with Its Predecessors Linwei Tao Minjing Dong Daochang Liu Changming Sun Chang Xu BDL UQCV 12 5 0 13 Feb 2023
Beyond In-Domain Scenarios: Robust Density-Aware Calibration Christian Tomani Futa Waseda Yuesong Shen Daniel Cremers UQCV 31 4 0 10 Feb 2023
Uncertainty Estimation based on Geometric Separation Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 25 0 0 11 Jan 2023
Annealing Double-Head: An Architecture for Online Calibration of Deep Neural Networks Erdong Guo D. Draper Maria de Iorio 35 0 0 27 Dec 2022
Post-hoc Uncertainty Learning using a Dirichlet Meta-Model Maohao Shen Yuheng Bu P. Sattigeri S. Ghosh Subhro Das G. Wornell UQCV OOD BDL 13 31 0 14 Dec 2022
NCTV: Neural Clamping Toolkit and Visualization for Neural Network Calibration Lei Hsiung Yu Tang Pin-Yu Chen Tsung-Yi Ho 14 2 0 29 Nov 2022
AdaFocal: Calibration-aware Adaptive Focal Loss Arindam Ghosh Thomas Schaaf Matthew R. Gormley FedML UQCV 23 25 0 21 Nov 2022
Layer-Stack Temperature Scaling Amr Khalifa Michael C. Mozer Hanie Sedghi Behnam Neyshabur Ibrahim M. Alabdulmohsin 78 2 0 18 Nov 2022
Stop Measuring Calibration When Humans Disagree Joris Baan Wilker Aziz Barbara Plank Raquel Fernández 24 53 0 28 Oct 2022
Calibration tests beyond classification David Widmann Fredrik Lindsten Dave Zachariah 30 17 0 21 Oct 2022
Class-wise and reduced calibration methods Michael Panchenko Anes Benmerzoug Miguel de Benito Delgado 16 0 0 07 Oct 2022
Variable-Based Calibration for Machine Learning Classifiers Mark Kelly Padhraic Smyth 22 4 0 30 Sep 2022
Neural Clamping: Joint Input Perturbation and Temperature Scaling for Neural Network Calibration Yu Tang Pin-Yu Chen Tsung-Yi Ho 20 5 0 23 Sep 2022
Towards Improving Calibration in Object Detection Under Domain Shift Muhammad Akhtar Munir M. H. Khan M. Sarfraz Mohsen Ali 19 22 0 15 Sep 2022