Revisiting the Calibration of Modern Neural Networks

15 June 2021

Papers citing "Revisiting the Calibration of Modern Neural Networks"

50 / 254 papers shown

Title
Why is the video analytics accuracy fluctuating, and what can we do about it? Sibendu Paul Kunal Rao G. Coviello Murugan Sankaradas Oliver Po Y. C. Hu S. Chakradhar AAML 6 3 0 23 Aug 2022
Joint Optimization of Ranking and Calibration with Contextualized Hybrid Model Xiang-Rong Sheng Jingyue Gao Yueyao Cheng Siran Yang Shuguang Han Hongbo Deng Yuning Jiang Jian Xu Bo Zheng 8 26 0 12 Aug 2022
Adaptive Temperature Scaling for Robust Calibration of Deep Neural Networks Sérgio A. Balanya Juan Maroñas Daniel Ramos OOD 35 13 0 31 Jul 2022
An Impartial Take to the CNN vs Transformer Robustness Contest Francesco Pinto Philip H. S. Torr P. Dokania UQCV AAML 30 48 0 22 Jul 2022
Assaying Out-Of-Distribution Generalization in Transfer Learning F. Wenzel Andrea Dittadi Peter V. Gehler Carl-Johann Simon-Gabriel Max Horn ... Chris Russell Thomas Brox Bernt Schiele Bernhard Schölkopf Francesco Locatello OOD OODD AAML 60 71 0 19 Jul 2022
Plex: Towards Reliability using Pretrained Large Model Extensions Dustin Tran J. Liu Michael W. Dusenberry Du Phan Mark Collier ... D. Sculley Y. Gal Zoubin Ghahramani Jasper Snoek Balaji Lakshminarayanan VLM 39 124 0 15 Jul 2022
Estimating Test Performance for AI Medical Devices under Distribution Shift with Conformal Prediction Charles Lu Syed Rakin Ahmed Praveer Singh Jayashree Kalpathy-Cramer OOD 25 5 0 12 Jul 2022
Language Models (Mostly) Know What They Know Saurav Kadavath Tom Conerly Amanda Askell T. Henighan Dawn Drain ... Nicholas Joseph Benjamin Mann Sam McCandlish C. Olah Jared Kaplan ELM 47 712 0 11 Jul 2022
Improving Trustworthiness of AI Disease Severity Rating in Medical Imaging with Ordinal Conformal Prediction Sets Charles Lu Anastasios Nikolas Angelopoulos S. Pomerantz 11 29 0 05 Jul 2022
Incorporating functional summary information in Bayesian neural networks using a Dirichlet process likelihood approach Vishnu Raj Tianyu Cui Markus Heinonen Pekka Marttinen UQCV BDL 25 1 0 04 Jul 2022
ProSelfLC: Progressive Self Label Correction Towards A Low-Temperature Entropy State Xinshao Wang Yang Hua Elyor Kodirov S. Mukherjee David A. Clifton N. Robertson 19 6 0 30 Jun 2022
Forecasting Future World Events with Neural Networks Andy Zou Tristan Xiao Ryan Jia Joe Kwon Mantas Mazeika Richard Li Dawn Song Jacob Steinhardt Owain Evans Dan Hendrycks 30 22 0 30 Jun 2022
Uncertainty Calibration for Deep Audio Classifiers Tong Ye Shijing Si Jianzong Wang Ning Cheng Jing Xiao UQCV 16 0 0 27 Jun 2022
Towards Better Selective Classification Leo Feng Mohamed Osama Ahmed Hossein Hajimirsadeghi A. Abdi 19 22 0 17 Jun 2022
Adapting Self-Supervised Vision Transformers by Probing Attention-Conditioned Masking Consistency Viraj Prabhu Sriram Yenamandra Aaditya K. Singh Judy Hoffman 36 14 0 16 Jun 2022
COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognition M. Tellamekala Shahin Amiriparian Björn W. Schuller Elisabeth André T. Giesbrecht M. Valstar 26 25 0 12 Jun 2022
Evaluating Aleatoric Uncertainty via Conditional Generative Models Ziyi Huang H. Lam Haofeng Zhang PER UD 22 5 0 09 Jun 2022
Robust Calibration with Multi-domain Temperature Scaling Yaodong Yu Stephen Bates Yi Ma Michael I. Jordan OOD UQCV 26 33 0 06 Jun 2022
Teaching Models to Express Their Uncertainty in Words Stephanie C. Lin Jacob Hilton Owain Evans OOD 17 363 0 28 May 2022
Re-Examining Calibration: The Case of Question Answering Chenglei Si Chen Zhao Sewon Min Jordan L. Boyd-Graber 61 30 0 25 May 2022
Linear Algorithms for Robust and Scalable Nonparametric Multiclass Probability Estimation Liyun Zeng Hao Helen Zhang 17 2 0 25 May 2022
Calibration of Natural Language Understanding Models with Venn--ABERS Predictors Patrizio Giovannotti 38 6 0 21 May 2022
A General Framework for quantifying Aleatoric and Epistemic uncertainty in Graph Neural Networks Sai Munikoti D. Agarwal Laya Das Balasubramaniam Natarajan BDL UD 31 13 0 20 May 2022
Evaluating Uncertainty Calibration for Open-Set Recognition Zongyao Lyu Nolan B. Gutierrez William J. Beksi UQCV 35 1 0 15 May 2022
Distinction Maximization Loss: Efficiently Improving Out-of-Distribution Detection and Uncertainty Estimation by Replacing the Loss and Calibrating David Macêdo Cleber Zanchettin Teresa B Ludermir UQCV 28 4 0 12 May 2022
Calibrating for Class Weights by Modeling Machine Learning Andrew Caplin Daniel Martin Philip Marx 19 1 0 10 May 2022
Multimodal Detection of Unknown Objects on Roads for Autonomous Driving Daniel Bogdoll Enrico Eisen Maximilian Nitsche Christin Scheib J. Marius Zöllner 20 12 0 03 May 2022
It's DONE: Direct ONE-shot learning with quantile weight imprinting Kazufumi Hosoda Keigo Nishida S. Seno Tomohiro Mashita H. Kashioka I. Ohzawa 22 2 0 28 Apr 2022
A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration R. Hebbalaguppe Jatin Prakash Neelabh Madan Chetan Arora UQCV 25 42 0 25 Mar 2022
Better Uncertainty Calibration via Proper Scores for Classification and Beyond Sebastian G. Gruber Florian Buettner UQCV 11 45 0 15 Mar 2022
Ensembles of Vision Transformers as a New Paradigm for Automated Classification in Ecology S. Kyathanahally T. Hardeman M. Reyes E. Merz T. Bulas P. Brun F. Pomati Marco Baity-Jesi 27 15 0 03 Mar 2022
No-Regret Learning with Unbounded Losses: The Case of Logarithmic Pooling Eric Neyman Tim Roughgarden 13 5 0 22 Feb 2022
How Do Vision Transformers Work? Namuk Park Songkuk Kim ViT 41 465 0 14 Feb 2022
Hidden Heterogeneity: When to Choose Similarity-Based Calibration K. Wagstaff Thomas G. Dietterich 21 1 0 03 Feb 2022
A Comprehensive Study of Vision Transformers on Dense Prediction Tasks Kishaan Jeeveswaran Senthilkumar S. Kathiresan Arnav Varma Omar Magdy Bahram Zonooz Elahe Arani ViT 27 10 0 21 Jan 2022
Invariant Representation Driven Neural Classifier for Anti-QCD Jet Tagging Taoli Cheng Aaron Courville 22 6 0 18 Jan 2022
Improving the Behaviour of Vision Transformers with Token-consistent Stochastic Layers Nikola Popovic D. Paudel Thomas Probst Luc Van Gool 34 1 0 30 Dec 2021
On the Value of ML Models Fabio Casati Pierre-Andre Noel Jie Yang 21 7 0 13 Dec 2021
ExCon: Explanation-driven Supervised Contrastive Learning for Image Classification Zhibo Zhang Jongseong Jang C. Trabelsi Ruiwen Li Scott Sanner Yeonjeong Jeong Dongsub Shim 14 4 0 28 Nov 2021
Deep Probability Estimation Sheng Liu Aakash Kaku Weicheng Zhu M. Leibovich S. Mohan ... Haoxiang Huang L. Zanna N. Razavian Jonathan Niles-Weed C. Fernandez‐Granda UQCV OOD 28 14 0 21 Nov 2021
Open-Set Recognition: a Good Closed-Set Classifier is All You Need? S. Vaze Kai Han Andrea Vedaldi Andrew Zisserman BDL 169 405 0 12 Oct 2021
Estimating the confidence of speech spoofing countermeasure Xin Wang Junichi Yamagishi 28 7 0 10 Oct 2021
Sparse MoEs meet Efficient Ensembles J. Allingham F. Wenzel Zelda E. Mariet Basil Mustafa J. Puigcerver ... Balaji Lakshminarayanan Jasper Snoek Dustin Tran Carlos Riquelme Ruiz Rodolphe Jenatton MoE 46 21 0 07 Oct 2021
Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimation Dennis Ulmer Christian Hardmeier J. Frellsen BDL UQCV UD EDL PER 48 48 0 06 Oct 2021
Localizing Objects with Self-Supervised Transformers and no Labels Oriane Siméoni Gilles Puy Huy V. Vo Simon Roburin Spyros Gidaris Andrei Bursuc P. Pérez Renaud Marlet Jean Ponce ViT 180 196 0 29 Sep 2021
A Tale Of Two Long Tails Daniel D'souza Zach Nussbaum Chirag Agarwal Sara Hooker 29 22 0 27 Jul 2021
Differentially Private Bayesian Neural Networks on Accuracy, Privacy and Reliability Qiyiwen Zhang Zhiqi Bu Kan Chen Qi Long BDL UQCV 19 11 0 18 Jul 2021
Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error Ondrej Bohdal Yongxin Yang Timothy M. Hospedales UQCV OOD 43 21 0 17 Jun 2021
Exploring the Limits of Out-of-Distribution Detection Stanislav Fort Jie Jessie Ren Balaji Lakshminarayanan 24 325 0 06 Jun 2021
Enhanced Isotropy Maximization Loss: Seamless and High-Performance Out-of-Distribution Detection Simply Replacing the SoftMax Loss David Macêdo Teresa B Ludermir OODD 21 12 0 30 May 2021