Measuring Calibration in Deep Learning

2 April 2019

Jeremy Nixon

Michael W. Dusenberry

Papers citing "Measuring Calibration in Deep Learning"

50 / 310 papers shown

Title
Credal Wrapper of Model Averaging for Uncertainty Estimation in Classification Kaizheng Wang Fabio Cuzzolin Keivan K1 Shariatmadar David Moens Hans Hallez UQCV BDL 88 0 0 23 May 2024
Just rotate it! Uncertainty estimation in closed-source models via multiple queries Konstantinos Pitas Julyan Arbel UQCV 37 0 0 22 May 2024
Towards Certification of Uncertainty Calibration under Adversarial Attacks Cornelius Emde Francesco Pinto Thomas Lukasiewicz Philip Torr Adel Bibi AAML 50 0 0 22 May 2024
Mask-TS Net: Mask Temperature Scaling Uncertainty Calibration for Polyp Segmentation Yudian Zhang Chenhao Xu Kaiye Xu Haijiang Zhu 51 0 0 09 May 2024
Selective Classification Under Distribution Shifts Hengyue Liang Le Peng Ju Sun UQCV 45 2 0 08 May 2024
The Role of Predictive Uncertainty and Diversity in Embodied AI and Robot Learning Ransalu Senanayake 37 8 0 06 May 2024
Error-Driven Uncertainty Aware Training Pedro Mendes Paolo Romano David Garlan UQCV 31 0 0 02 May 2024
When Quantization Affects Confidence of Large Language Models? Irina Proskurina Luc Brun Guillaume Metzler Julien Velcin MQ 49 2 0 01 May 2024
ABCD: Trust enhanced Attention based Convolutional Autoencoder for Risk Assessment Sarala Naidu Ning Xi 27 3 0 24 Apr 2024
Optimizing Calibration by Gaining Aware of Prediction Correctness Yuchi Liu Lei Wang Yuli Zou James Zou Liang Zheng UQCV 49 1 0 19 Apr 2024
VCC-INFUSE: Towards Accurate and Efficient Selection of Unlabeled Examples in Semi-supervised Learning Shijie Fang Qianhan Feng Tong Lin 33 0 0 18 Apr 2024
Consistency and Uncertainty: Identifying Unreliable Responses From Black-Box Vision-Language Models for Selective Visual Question Answering Zaid Khan Yun Fu AAML 39 8 0 16 Apr 2024
Uncertainty in Language Models: Assessment through Rank-Calibration Xinmeng Huang Shuo Li Mengxin Yu Matteo Sesia Hamed Hassani Insup Lee Osbert Bastani Yan Sun 43 16 0 04 Apr 2024
Bayesian Exploration of Pre-trained Models for Low-shot Image Classification Yibo Miao Yu Lei Feng Zhou Zhijie Deng VLM UQCV BDL 51 2 0 30 Mar 2024
Embracing Unknown Step by Step: Towards Reliable Sparse Training in Real World Bowen Lei Dongkuan Xu Ruqi Zhang Bani Mallick UQCV 49 0 0 29 Mar 2024
Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding Lingdong Kong Xiang Xu Jun Cen Wenwei Zhang Liang Pan Kai-xiang Chen Ziwei Liu 53 5 0 25 Mar 2024
Analysing Diffusion Segmentation for Medical Images Mathias Öttl Siyuan Mei Frauke Wilm Jana Steenpass M. Rübner ... Matthias W. Beckmann Peter Fasching Andreas Maier R. Erber Katharina Breininger MedIm 37 1 0 21 Mar 2024
Class and Region-Adaptive Constraints for Network Calibration Balamurali Murugesan Julio Silva-Rodríguez Ismail Ben Ayed Jose Dolz 41 1 0 19 Mar 2024
Confidence-Aware Multi-Field Model Calibration Yuang Zhao Chuhan Wu Qinglin Jia Hong Zhu Jia Yan Libin Zong Linxuan Zhang Zhenhua Dong Muyu Zhang 40 1 0 27 Feb 2024
Predict the Next Word: Humans exhibit uncertainty in this task and language models _____ Evgenia Ilia Wilker Aziz 37 2 0 27 Feb 2024
Interpreting Predictive Probabilities: Model Confidence or Human Label Variation? Joris Baan Raquel Fernández Barbara Plank Wilker Aziz 56 10 0 25 Feb 2024
Calibration of Deep Learning Classification Models in fNIRS Zhihao Cao Zizhou Luo 40 1 0 23 Feb 2024
Testing Calibration in Nearly-Linear Time Lunjia Hu A. Jambulapati Kevin Tian Chutong Yang 37 0 0 20 Feb 2024
How Flawed Is ECE? An Analysis via Logit Smoothing Muthu Chidambaram Holden Lee Colin McSwiggen Semon Rezchikov UQCV 25 3 0 15 Feb 2024
Domain-adaptive and Subgroup-specific Cascaded Temperature Regression for Out-of-distribution Calibration Jiexin Wang Jiahao Chen Fuchun Sun UQCV 22 0 0 14 Feb 2024
On Temperature Scaling and Conformal Prediction of Deep Classifiers Lahav Dabah Tom Tirer 45 1 0 08 Feb 2024
Open-Vocabulary Calibration for Fine-tuned CLIP Shuoyuan Wang Jindong Wang Guoqing Wang Bob Zhang Kaiyang Zhou Hongxin Wei VLM 40 6 0 07 Feb 2024
Calibration and Correctness of Language Models for Code Claudio Spiess David Gros Kunal Suresh Pai Michael Pradel Md Rafiqul Islam Rabin Amin Alipour Susmit Jha Prem Devanbu Toufique Ahmed 68 19 0 03 Feb 2024
Towards Understanding Variants of Invariant Risk Minimization through the Lens of Calibration Kotaro Yoshida Hiroki Naganuma 68 1 0 31 Jan 2024
A Benchmark Dataset for Tornado Detection and Prediction using Full-Resolution Polarimetric Weather Radar Data Mark S. Veillette J. Kurdzo P. M. Stepanian John Y. N. Cho S. Samsi Joseph McDonald 21 0 0 26 Jan 2024
Neighbor-Aware Calibration of Segmentation Networks with Penalty-Based Constraints Balamurali Murugesan Sukesh Adiga Vasudeva Bingyuan Liu H. Lombaert Ismail Ben Ayed Jose Dolz UQCV 47 5 0 25 Jan 2024
MOReGIn: Multi-Objective Recommendation at the Global and Individual Levels Elizabeth Gómez David Contreras Ludovico Boratto Maria Salamó 147 2 0 23 Jan 2024
Learning Shortcuts: On the Misleading Promise of NLU in Language Models Geetanjali Bihani Julia Taylor Rayz 33 3 0 17 Jan 2024
Evaluating the Utility of Conformal Prediction Sets for AI-Advised Image Labeling Dongping Zhang Angelos Chatzimparmpas Negar Kamali Jessica Hullman 39 7 0 16 Jan 2024
Calibration Attacks: A Comprehensive Study of Adversarial Attacks on Model Confidence Stephen Obadinma Xiaodan Zhu Hongyu Guo AAML 19 1 0 05 Jan 2024
How to Overcome Curse-of-Dimensionality for Out-of-Distribution Detection? Soumya Suvra Ghosal Yiyou Sun Yixuan Li OODD 30 11 0 22 Dec 2023
Scaling Up Bayesian Neural Networks with Neural Networks Zahra Moslemi Yang Meng Shiwei Lan Babak Shahbaba BDL 22 1 0 19 Dec 2023
Consistent and Asymptotically Unbiased Estimation of Proper Calibration Errors Teodora Popordanoska Sebastian G. Gruber A. Tiulpin Florian Buettner Matthew B. Blaschko 33 3 0 14 Dec 2023
Estimating calibration error under label shift without labels Teodora Popordanoska Gorjan Radevski Tinne Tuytelaars Matthew B. Blaschko 27 1 0 14 Dec 2023
An Ambiguity Measure for Recognizing the Unknowns in Deep Learning Roozbeh Yousefzadeh AAML UQCV 33 0 0 11 Dec 2023
A Study on the Calibration of In-context Learning Hanlin Zhang Yi-Fan Zhang Yaodong Yu Dhruv Madeka Dean Phillips Foster Eric Xing Hima Lakkaraju Sham Kakade 36 15 0 07 Dec 2023
Enhancing Post-Hoc Explanation Benchmark Reliability for Image Classification T. Gomez Harold Mouchère FAtt 27 0 0 29 Nov 2023
Calibrated Language Models Must Hallucinate Adam Tauman Kalai Santosh Vempala HILM 30 76 0 24 Nov 2023
On the Calibration of Large Language Models and Alignment Chiwei Zhu Benfeng Xu Quan Wang Yongdong Zhang Zhendong Mao 82 34 0 22 Nov 2023
On the Overconfidence Problem in Semantic 3D Mapping J. M. C. Marques Albert Zhai Shenlong Wang Kris K. Hauser 3DPC 31 5 0 16 Nov 2023
A Survey of Confidence Estimation and Calibration in Large Language Models Jiahui Geng Fengyu Cai Yuxia Wang Heinz Koeppl Preslav Nakov Iryna Gurevych UQCV 46 56 0 14 Nov 2023
NPCL: Neural Processes for Uncertainty-Aware Continual Learning Saurav Jha Dong Gong He Zhao Lina Yao CLL BDL 36 12 0 30 Oct 2023
Generalizing to Unseen Domains in Diabetic Retinopathy Classification Chamuditha Jayanga Galappaththige Gayal Kuruppu Muhammad Haris Khan OOD 31 7 0 26 Oct 2023
MaxEnt Loss: Constrained Maximum Entropy for Calibration under Out-of-Distribution Shift Dexter Neo Stefan Winkler Tsuhan Chen OODD 24 3 0 26 Oct 2023
It's an Alignment, Not a Trade-off: Revisiting Bias and Variance in Deep Models Lin Chen Michal Lukasik Wittawat Jitkrittum Chong You Sanjiv Kumar 45 2 0 13 Oct 2023