Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration

28 October 2019

Meelis Kull

Miquel Perelló Nieto

Markus Kängsepp

Telmo de Menezes e Silva Filho

Papers citing "Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration"

36 / 86 papers shown

Title
Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Survey S. Sun AI4CE 35 10 0 08 Sep 2022
Calibrated Selective Classification Adam Fisch Tommi Jaakkola Regina Barzilay 29 16 0 25 Aug 2022
Sample-dependent Adaptive Temperature Scaling for Improved Calibration Thomas Joy Francesco Pinto Ser-Nam Lim Philip Torr P. Dokania UQCV 27 30 0 13 Jul 2022
Forecasting Future World Events with Neural Networks Andy Zou Tristan Xiao Ryan Jia Joe Kwon Mantas Mazeika Richard Li Dawn Song Jacob Steinhardt Owain Evans Dan Hendrycks 30 22 0 30 Jun 2022
SLOVA: Uncertainty Estimation Using Single Label One-Vs-All Classifier Bartosz Wójcik J. Grela Marek Śmieja Krzysztof Misztal Jacek Tabor UQCV 33 4 0 28 Jun 2022
On Calibrated Model Uncertainty in Deep Learning Biraja Ghoshal A. Tucker UQCV MedIm 25 10 0 15 Jun 2022
A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration R. Hebbalaguppe Jatin Prakash Neelabh Madan Chetan Arora UQCV 25 42 0 25 Mar 2022
On the Usefulness of the Fit-on-the-Test View on Evaluating Calibration of Classifiers Markus Kängsepp Kaspar Valk Meelis Kull 32 3 0 16 Mar 2022
T-Cal: An optimal test for the calibration of predictive models Donghwan Lee Xinmeng Huang Hamed Hassani Yan Sun 22 20 0 03 Mar 2022
Low-Degree Multicalibration Parikshit Gopalan Michael P. Kim M. Singhal Shengjia Zhao FaML UQCV 22 37 0 02 Mar 2022
Confidence Calibration for Object Detection and Segmentation Fabian Küppers Anselm Haselhoff Jan Kronenberger Jonas Schneider UQCV 22 4 0 25 Feb 2022
Reducing Overconfidence Predictions for Autonomous Driving Perception Gledson Melotti C. Premebida Jordan J. Bird Diego Resende Faria Nuno Gonccalves 13 7 0 16 Feb 2022
Calibrated Learning to Defer with One-vs-All Classifiers Rajeev Verma Eric Nalisnick 21 42 0 08 Feb 2022
Deep Probability Estimation Sheng Liu Aakash Kaku Weicheng Zhu M. Leibovich S. Mohan ... Haoxiang Huang L. Zanna N. Razavian Jonathan Niles-Weed C. Fernandez‐Granda UQCV OOD 28 14 0 21 Nov 2021
Exploring Covariate and Concept Shift for Detection and Calibration of Out-of-Distribution Data Junjiao Tian Yen-Change Hsu Yilin Shen Hongxia Jin Z. Kira OODD 19 6 0 28 Oct 2021
Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration Gavin Kerrigan Padhraic Smyth M. Steyvers 30 46 0 29 Sep 2021
Self Training with Ensemble of Teacher Models Soumyadeep Ghosh Sanjay Kumar Janu Verma Awanish Kumar 25 3 0 17 Jul 2021
Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibration Shengjia Zhao Michael P. Kim Roshni Sahoo Tengyu Ma Stefano Ermon 20 55 0 12 Jul 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 59 1,111 0 07 Jul 2021
Improving Uncertainty Calibration of Deep Neural Networks via Truth Discovery and Geometric Optimization Chunwei Ma Ziyun Huang Jiayi Xian Mingchen Gao Jinhui Xu UQCV 33 14 0 25 Jun 2021
Graceful Degradation and Related Fields J. Dymond 31 4 0 21 Jun 2021
Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error Ondrej Bohdal Yongxin Yang Timothy M. Hospedales UQCV OOD 43 21 0 17 Jun 2021
On Deep Neural Network Calibration by Regularization and its Impact on Refinement Aditya Singh Alessandro Bay B. Sengupta Andrea Mirabile AAML 27 2 0 17 Jun 2021
FairCal: Fairness Calibration for Face Verification Tiago Salvador Stephanie Cairns Vikram S. Voleti Noah Marshall Adam M. Oberman FaML 30 20 0 07 Jun 2021
Meta-Cal: Well-controlled Post-hoc Calibration by Ranking Xingchen Ma Matthew B. Blaschko 25 34 0 10 May 2021
Learning to Cascade: Confidence Calibration for Improving the Accuracy and Computational Cost of Cascade Inference Systems Shohei Enomoto Takeharu Eda UQCV 46 17 0 15 Apr 2021
SCRIB: Set-classifier with Class-specific Risk Bounds for Blackbox Models Zhen Lin Cao Xiao Lucas Glass M. P. M. Brandon Westover Jimeng Sun BDL 29 11 0 05 Mar 2021
Distribution-free uncertainty quantification for classification under label shift Aleksandr Podkopaev Aaditya Ramdas UQCV 19 84 0 04 Mar 2021
Local Calibration: Metrics and Recalibration Rachel Luo Aadyot Bhatnagar Yu Bai Shengjia Zhao Huan Wang Caiming Xiong Silvio Savarese Stefano Ermon Edward Schmerling Marco Pavone 21 14 0 22 Feb 2021
Know Your Limits: Uncertainty Estimation with ReLU Classifiers Fails at Reliable OOD Detection Dennis Ulmer Giovanni Cina OODD 35 31 0 09 Dec 2020
Improving Calibration through the Relationship with Adversarial Robustness Yao Qin Xuezhi Wang Alex Beutel Ed H. Chi AAML 37 25 0 29 Jun 2020
Calibration of Model Uncertainty for Dropout Variational Inference M. Laves Sontje Ihler Karl-Philipp Kortmann T. Ortmaier BDL UQCV 32 18 0 20 Jun 2020
Calibrating Deep Neural Network Classifiers on Out-of-Distribution Datasets Zhihui Shao Jianyi Yang Shaolei Ren OODD 35 11 0 16 Jun 2020
Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning Jize Zhang B. Kailkhura T. Y. Han UQCV 30 219 0 16 Mar 2020
Calibrating Deep Neural Networks using Focal Loss Jishnu Mukhoti Viveka Kulharia Amartya Sanyal Stuart Golodetz Philip Torr P. Dokania UQCV 56 444 0 21 Feb 2020
Verified Uncertainty Calibration Ananya Kumar Percy Liang Tengyu Ma 22 346 0 23 Sep 2019