Measuring Calibration in Deep Learning

2 April 2019

Jeremy Nixon

Michael W. Dusenberry

Papers citing "Measuring Calibration in Deep Learning"

50 / 310 papers shown

Title
Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentation Victor Besnier Andrei Bursuc David Picard Alexandre Briot UQCV 24 48 0 03 Aug 2021
Soft Calibration Objectives for Neural Networks A. Karandikar Nicholas Cain Dustin Tran Balaji Lakshminarayanan Jonathon Shlens Michael C. Mozer Becca Roelofs UQCV 25 85 0 30 Jul 2021
Class-Incremental Domain Adaptation with Smoothing and Calibration for Surgical Report Generation Mengya Xu Mobarakol Islam C. Lim Hongliang Ren MedIm 13 32 0 23 Jul 2021
Top-label calibration and multiclass-to-binary reductions Chirag Gupta Aaditya Ramdas 25 35 0 18 Jul 2021
Differentially private training of neural networks with Langevin dynamics for calibrated predictive uncertainty Moritz Knolle Alexander Ziller Dmitrii Usynin R. Braren Marcus R. Makowski Daniel Rueckert Georgios Kaissis UQCV 44 2 0 09 Jul 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 66 1,112 0 07 Jul 2021
Scene Uncertainty and the Wellington Posterior of Deterministic Image Classifiers Stephanie Tsuei Aditya Golatkar Stefano Soatto UQCV 29 0 0 25 Jun 2021
Assessing Generalization of SGD via Disagreement Yiding Jiang Vaishnavh Nagarajan Christina Baek J. Zico Kolter 67 108 0 25 Jun 2021
Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error Ondrej Bohdal Yongxin Yang Timothy M. Hospedales UQCV OOD 45 21 0 17 Jun 2021
On Deep Neural Network Calibration by Regularization and its Impact on Refinement Aditya Singh Alessandro Bay B. Sengupta Andrea Mirabile AAML 27 2 0 17 Jun 2021
Revisiting the Calibration of Modern Neural Networks Matthias Minderer Josip Djolonga Rob Romijnders F. Hubis Xiaohua Zhai N. Houlsby Dustin Tran Mario Lucic UQCV 51 358 0 15 Jun 2021
Vertical Federated Learning without Revealing Intersection Membership Jiankai Sun Xin Yang Yuanshun Yao Aonan Zhang Weihao Gao Junyuan Xie Chong-Jun Wang FedML 31 37 0 10 Jun 2021
Frustratingly Easy Uncertainty Estimation for Distribution Shift Tiago Salvador Vikram S. Voleti Alexander Iannantuono Adam M. Oberman OOD UQCV 20 1 0 07 Jun 2021
FairCal: Fairness Calibration for Face Verification Tiago Salvador Stephanie Cairns Vikram S. Voleti Noah Marshall Adam M. Oberman FaML 30 19 0 07 Jun 2021
Greedy Bayesian Posterior Approximation with Deep Ensembles A. Tiulpin Matthew B. Blaschko UQCV FedML 36 4 0 29 May 2021
Spatially Varying Label Smoothing: Capturing Uncertainty from Expert Annotations Mobarakol Islam Ben Glocker UQCV 16 45 0 12 Apr 2021
Learning Domain Adaptation with Model Calibration for Surgical Report Generation in Robotic Surgery Mengya Xu Mobarakol Islam C. Lim Hongliang Ren OOD MedIm 37 29 0 31 Mar 2021
MixMo: Mixing Multiple Inputs for Multiple Outputs via Deep Subnetworks Alexandre Ramé Rémy Sun Matthieu Cord UQCV 37 60 0 10 Mar 2021
Confidence Calibration with Bounded Error Using Transformations Sooyong Jang Radoslav Ivanov Insup Lee James Weimer UQCV 16 3 0 25 Feb 2021
Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibration Christian Tomani Daniel Cremers Florian Buettner UQCV 21 34 0 24 Feb 2021
Local Calibration: Metrics and Recalibration Rachel Luo Aadyot Bhatnagar Yu Bai Shengjia Zhao Huan Wang Caiming Xiong Silvio Savarese Stefano Ermon Edward Schmerling Marco Pavone 27 14 0 22 Feb 2021
On Calibration and Out-of-domain Generalization Yoav Wald Amir Feder D. Greenfeld Uri Shalit OODD 30 153 0 20 Feb 2021
Label Leakage and Protection in Two-party Split Learning Oscar Li Jiankai Sun Xin Yang Weihao Gao Hongyi Zhang Junyuan Xie Virginia Smith Chong-Jun Wang FedML 134 139 0 17 Feb 2021
Don't Just Blame Over-parametrization for Over-confidence: Theoretical Analysis of Calibration in Binary Classification Yu Bai Song Mei Haiquan Wang Caiming Xiong 17 42 0 15 Feb 2021
When and How Mixup Improves Calibration Linjun Zhang Zhun Deng Kenji Kawaguchi James Zou UQCV 36 67 0 11 Feb 2021
Deep Cox Mixtures for Survival Regression Chirag Nagpal Steve Yadlowsky Negar Rostamzadeh Katherine A. Heller CML 44 59 0 16 Jan 2021
DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation Alexandre Ramé Matthieu Cord FedML 56 51 0 14 Jan 2021
Should Ensemble Members Be Calibrated? Xixin Wu Mark Gales UQCV 28 12 0 13 Jan 2021
Shallow Bayesian Meta Learning for Real-World Few-Shot Recognition Xueting Zhang Debin Meng Henry Gouk Timothy M. Hospedales BDL UQCV 39 68 0 08 Jan 2021
On Calibration of Scene-Text Recognition Models Ron Slossberg Oron Anschel Amir Markovitz Ron Litman Aviad Aberdam Shahar Tsiper Shai Mazor Jon Wu R. Manmatha 32 13 0 23 Dec 2020
Mitigating Bias in Calibration Error Estimation Rebecca Roelofs Nicholas Cain Jonathon Shlens Michael C. Mozer 33 94 0 15 Dec 2020
Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty Umang Bhatt Javier Antorán Yunfeng Zhang Q. V. Liao P. Sattigeri ... L. Nachman R. Chunara Madhulika Srikumar Adrian Weller Alice Xiang 22 247 0 15 Nov 2020
Extracting Chemical-Protein Interactions via Calibrated Deep Neural Network and Self-training Dongha Choi Hyunju Lee 17 5 0 04 Nov 2020
Reducing Confusion in Active Learning for Part-Of-Speech Tagging Aditi Chaudhary Antonios Anastasopoulos Zaid A. W. Sheikh Graham Neubig 19 18 0 02 Nov 2020
Combining Ensembles and Data Augmentation can Harm your Calibration Yeming Wen Ghassen Jerfel Rafael Muller Michael W. Dusenberry Jasper Snoek Balaji Lakshminarayanan Dustin Tran UQCV 32 63 0 19 Oct 2020
Learning Calibrated Uncertainties for Domain Shift: A Distributionally Robust Learning Approach Haoxu Wang Zhiding Yu Yisong Yue Anima Anandkumar Anqi Liu Junchi Yan OOD UQCV 18 4 0 08 Oct 2020
Ask-n-Learn: Active Learning via Reliable Gradient Representations for Image Classification Bindya Venkatesh Jayaraman J. Thiagarajan 11 4 0 30 Sep 2020
Uncertainty Sets for Image Classifiers using Conformal Prediction Anastasios Nikolas Angelopoulos Stephen Bates Jitendra Malik Michael I. Jordan UQCV 42 317 0 29 Sep 2020
Local Temperature Scaling for Probability Calibration Zhipeng Ding Xu Han Peirong Liu Marc Niethammer 19 77 0 12 Aug 2020
Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Users Laurent Valentin Jospin Wray Buntine F. Boussaïd Hamid Laga Bennamoun OOD BDL UQCV 29 611 0 14 Jul 2020
Hyperparameter Ensembles for Robustness and Uncertainty Quantification F. Wenzel Jasper Snoek Dustin Tran Rodolphe Jenatton UQCV 33 204 0 24 Jun 2020
Multi-Class Uncertainty Calibration via Mutual Information Maximization-based Binning Kanil Patel William H. Beluch Binh Yang Michael Pfeiffer Dan Zhang UQCV 24 34 0 23 Jun 2020
Calibration of Neural Networks using Splines Kartik Gupta Amir M. Rahimi Thalaiyasingam Ajanthan Thomas Mensink C. Sminchisescu Richard I. Hartley 28 106 0 23 Jun 2020
Calibration of Model Uncertainty for Dropout Variational Inference M. Laves Sontje Ihler Karl-Philipp Kortmann T. Ortmaier BDL UQCV 32 18 0 20 Jun 2020
Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awareness Jeremiah Zhe Liu Zi Lin Shreyas Padhy Dustin Tran Tania Bedrax-Weiss Balaji Lakshminarayanan UQCV BDL 37 437 0 17 Jun 2020
Depth Uncertainty in Neural Networks Javier Antorán J. Allingham José Miguel Hernández-Lobato UQCV OOD BDL 46 100 0 15 Jun 2020
Designing Accurate Emulators for Scientific Processes using Calibration-Driven Deep Models Jayaraman J. Thiagarajan Bindya Venkatesh Rushil Anirudh P. Bremer J. Gaffney G. Anderson B. Spears 18 21 0 05 May 2020
Physarum Powered Differentiable Linear Programming Layers and Applications Zihang Meng Sathya Ravi Vikas Singh 30 5 0 30 Apr 2020
Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning Jize Zhang B. Kailkhura T. Y. Han UQCV 30 219 0 16 Mar 2020
Intra Order-preserving Functions for Calibration of Multi-Class Neural Networks Amir M. Rahimi Amirreza Shaban Ching-An Cheng Richard I. Hartley Byron Boots UQCV 16 68 0 15 Mar 2020