Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning

16 March 2020

Papers citing "Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning"

50 / 51 papers shown

Title
MBCT: Tree-Based Feature-Aware Binning for Individual Uncertainty Calibration Siguang Huang Yunli Wang Lili Mou Huayue Zhang Ziru Xu Chuan Yu Bo Zheng 60 15 0 13 Mar 2025
Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreement Junyu Lu Kai Ma Kaichun Wang Kelaiti Xiao Roy Ka-Wei Lee Bo Xu Liang Yang Hongfei Lin 51 0 0 10 Feb 2025
Optical aberrations in autonomous driving: Physics-informed parameterized temperature scaling for neural network uncertainty calibration D. Wolf Alexander Braun Markus Ulrich 89 0 0 18 Dec 2024
Combining Priors with Experience: Confidence Calibration Based on Binomial Process Modeling Jinzong Dong Zhaohui Jiang Dong Pan Haoyang Yu 61 0 0 14 Dec 2024
Confidence Calibration of Classifiers with Many Classes Adrien LeCoz Stéphane Herbin Faouzi Adjed UQCV 37 1 0 05 Nov 2024
Taming Overconfidence in LLMs: Reward Calibration in RLHF Jixuan Leng Chengsong Huang Banghua Zhu Jiaxin Huang 34 7 0 13 Oct 2024
GETS: Ensemble Temperature Scaling for Calibration in Graph Neural Networks Dingyi Zhuang Chonghe Jiang Yunhan Zheng Shenhao Wang Jinhua Zhao UQCV 39 0 0 12 Oct 2024
Calibrating Expressions of Certainty Peiqi Wang Barbara D. Lam Yingcheng Liu Ameneh Asgari-Targhi Rameswar Panda W. Wells Tina Kapur Polina Golland 34 1 0 06 Oct 2024
Reassessing How to Compare and Improve the Calibration of Machine Learning Models M. Chidambaram Rong Ge 74 1 0 06 Jun 2024
CONFINE: Conformal Prediction for Interpretable Neural Networks Linhui Huang S. Lala N. Jha 68 2 0 01 Jun 2024
Conditional Shift-Robust Conformal Prediction for Graph Neural Network Akansha Agrawal UQCV 53 1 0 20 May 2024
Optimizing Calibration by Gaining Aware of Prediction Correctness Yuchi Liu Lei Wang Yuli Zou James Zou Liang Zheng UQCV 44 1 0 19 Apr 2024
Embracing Unknown Step by Step: Towards Reliable Sparse Training in Real World Bowen Lei Dongkuan Xu Ruqi Zhang Bani Mallick UQCV 36 0 0 29 Mar 2024
Class and Region-Adaptive Constraints for Network Calibration Balamurali Murugesan Julio Silva-Rodríguez Ismail Ben Ayed Jose Dolz 36 1 0 19 Mar 2024
Accuracy-Preserving Calibration via Statistical Modeling on Probability Simplex Yasushi Esaki Akihiro Nakamura Keisuke Kawano Ryoko Tokuhisa Takuro Kutsuna 43 0 0 21 Feb 2024
Overconfident and Unconfident AI Hinder Human-AI Collaboration Jingshu Li Yitian Yang Renwen Zhang Yi-Chieh Lee 37 1 0 12 Feb 2024
Model Calibration in Dense Classification with Adaptive Label Perturbation Jiawei Liu Changkun Ye Shanpeng Wang Rui-Qing Cui Jing Zhang Kai Zhang Nick Barnes 47 5 0 25 Jul 2023
Scaling of Class-wise Training Losses for Post-hoc Calibration Seungjin Jung Seung-Woo Seo Yonghyun Jeong Jongwon Choi 29 3 0 19 Jun 2023
Trustworthy Sensor Fusion against Inaudible Command Attacks in Advanced Driver-Assistance System Jiwei Guan Lei Pan Chen Wang Shui Yu Longxiang Gao Xi Zheng AAML 19 3 0 30 May 2023
Dual Focal Loss for Calibration Linwei Tao Minjing Dong Chang Xu UQCV 41 26 0 23 May 2023
Minimum-Risk Recalibration of Classifiers Zeyu Sun Dogyoon Song Alfred Hero 32 5 0 18 May 2023
Calibration Error Estimation Using Fuzzy Binning Geetanjali Bihani Julia Taylor Rayz 95 2 0 30 Apr 2023
Transfer Knowledge from Head to Tail: Uncertainty Calibration under Long-tailed Distribution Jiahao Chen Bingyue Su 32 11 0 13 Apr 2023
Beyond In-Domain Scenarios: Robust Density-Aware Calibration Christian Tomani Futa Waseda Yuesong Shen Daniel Cremers UQCV 31 4 0 10 Feb 2023
Uncertainty Estimation based on Geometric Separation Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 25 0 0 11 Jan 2023
A Survey of Mix-based Data Augmentation: Taxonomy, Methods, Applications, and Explainability Chengtai Cao Fan Zhou Yurou Dai Jianping Wang Kunpeng Zhang AAML 24 28 0 21 Dec 2022
Investigating Deep Learning Model Calibration for Classification Problems in Mechanics S. Mohammadzadeh Peerasait Prachaseree Emma Lejeune AI4CE 34 2 0 01 Dec 2022
A Unifying Theory of Distance from Calibration Jarosław Błasiok Parikshit Gopalan Lunjia Hu Preetum Nakkiran 31 32 0 30 Nov 2022
AdaFocal: Calibration-aware Adaptive Focal Loss Arindam Ghosh Thomas Schaaf Matthew R. Gormley FedML UQCV 23 25 0 21 Nov 2022
To Softmax, or not to Softmax: that is the question when applying Active Learning for Transformer Models Julius Gonsior C. Falkenberg Silvio Magino Anja Reusch Maik Thiele Wolfgang Lehner UQCV 36 7 0 06 Oct 2022
Adaptive Temperature Scaling for Robust Calibration of Deep Neural Networks Sérgio A. Balanya Juan Maroñas Daniel Ramos OOD 35 13 0 31 Jul 2022
BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networks Uddeshya Upadhyay Shyamgopal Karthik Yanbei Chen Massimiliano Mancini Zeynep Akata UQCV BDL 35 22 0 14 Jul 2022
SLOVA: Uncertainty Estimation Using Single Label One-Vs-All Classifier Bartosz Wójcik J. Grela Marek Śmieja Krzysztof Misztal Jacek Tabor UQCV 33 4 0 28 Jun 2022
On the Usefulness of the Fit-on-the-Test View on Evaluating Calibration of Classifiers Markus Kängsepp Kaspar Valk Meelis Kull 27 3 0 16 Mar 2022
T-Cal: An optimal test for the calibration of predictive models Donghwan Lee Xinmeng Huang Hamed Hassani Yan Sun 22 20 0 03 Mar 2022
Reducing Overconfidence Predictions for Autonomous Driving Perception Gledson Melotti C. Premebida Jordan J. Bird Diego Resende Faria Nuno Gonccalves 8 7 0 16 Feb 2022
Metrics for saliency map evaluation of deep learning explanation methods T. Gomez Thomas Fréour Harold Mouchère XAI FAtt 69 41 0 31 Jan 2022
The Devil is in the Margin: Margin-based Label Smoothing for Network Calibration Bingyuan Liu Ismail Ben Ayed Adrian Galdran Jose Dolz UQCV 24 65 0 30 Nov 2021
Deep Probability Estimation Sheng Liu Aakash Kaku Weicheng Zhu M. Leibovich S. Mohan ... Haoxiang Huang L. Zanna N. Razavian Jonathan Niles-Weed C. Fernandez‐Granda UQCV OOD 28 14 0 21 Nov 2021
Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration Gavin Kerrigan Padhraic Smyth M. Steyvers 24 46 0 29 Sep 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 38 1,109 0 07 Jul 2021
Improving Uncertainty Calibration of Deep Neural Networks via Truth Discovery and Geometric Optimization Chunwei Ma Ziyun Huang Jiayi Xian Mingchen Gao Jinhui Xu UQCV 25 14 0 25 Jun 2021
Towards Consistent Predictive Confidence through Fitted Ensembles Navid Kardan Ankit Sharma Kenneth O. Stanley FedML OODD 16 8 0 22 Jun 2021
Meta-Cal: Well-controlled Post-hoc Calibration by Ranking Xingchen Ma Matthew B. Blaschko 22 34 0 10 May 2021
Local Calibration: Metrics and Recalibration Rachel Luo Aadyot Bhatnagar Yu Bai Shengjia Zhao Huan Wang Caiming Xiong Silvio Savarese Stefano Ermon Edward Schmerling Marco Pavone 19 14 0 22 Feb 2021
Probabilistic Neighbourhood Component Analysis: Sample Efficient Uncertainty Estimation in Deep Learning Ankur Mallick Chaitanya Dwivedi B. Kailkhura Gauri Joshi T. Y. Han UQCV BDL 37 6 0 18 Jul 2020
Improving Calibration through the Relationship with Adversarial Robustness Yao Qin Xuezhi Wang Alex Beutel Ed H. Chi AAML 32 25 0 29 Jun 2020
Distribution-free binary classification: prediction sets, confidence intervals and calibration Chirag Gupta A. Podkopaev Aaditya Ramdas UQCV 30 79 0 18 Jun 2020
A Survey on Deep Learning in Medical Image Analysis G. Litjens Thijs Kooi B. Bejnordi A. Setio F. Ciompi Mohsen Ghafoorian Jeroen van der Laak Bram van Ginneken C. I. Sánchez OOD 295 10,618 0 19 Feb 2017
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,661 0 05 Dec 2016