Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,043 papers shown

Title
Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks Shaun Li AI4CE 51 0 0 03 Jan 2022
Impact of class imbalance on chest x-ray classifiers: towards better evaluation practices for discrimination and calibration performance Candelaria Mosquera Luciana Ferrer Diego H. Milone D.R. Luna Enzo Ferrante 24 3 0 23 Dec 2021
Latent Time Neural Ordinary Differential Equations Srinivas Anumasa P. K. Srijith BDL 24 5 0 23 Dec 2021
Maximum Entropy on Erroneous Predictions (MEEP): Improving model calibration for medical image segmentation Agostina J. Larrazabal Cesar E. Martínez Jose Dolz Enzo Ferrante 24 15 0 22 Dec 2021
Classifier Calibration: A survey on how to assess and improve predicted class probabilities Telmo de Menezes e Silva Filho Hao Song Miquel Perelló Nieto Raúl Santos-Rodríguez Meelis Kull Peter A. Flach 40 79 0 20 Dec 2021
Benchmarking Uncertainty Quantification on Biosignal Classification Tasks under Dataset Shift Tong Xia Jing Han Cecilia Mascolo OOD 24 11 0 16 Dec 2021
Sample-Efficient Reinforcement Learning via Conservative Model-Based Actor-Critic Zhihai Wang Jie Wang Qi Zhou Bin Li Houqiang Li 27 30 0 16 Dec 2021
Measure and Improve Robustness in NLP Models: A Survey Xuezhi Wang Haohan Wang Diyi Yang 139 131 0 15 Dec 2021
On The Reliability Of Machine Learning Applications In Manufacturing Environments Nicolas Jourdan S. Sen E. J. Husom Enrique Garcia-Ceja Tobias Biegel J. Metternich OOD 30 9 0 13 Dec 2021
Eigenspace Restructuring: a Principle of Space and Frequency in Neural Networks Lechao Xiao 39 22 0 10 Dec 2021
PixMix: Dreamlike Pictures Comprehensively Improve Safety Measures Dan Hendrycks Andy Zou Mantas Mazeika Leonard Tang Bo Li D. Song Jacob Steinhardt UQCV 25 137 0 09 Dec 2021
On the Effectiveness of Mode Exploration in Bayesian Model Averaging for Neural Networks J. Holodnak Allan B. Wollaber UQCV BDL 19 0 0 07 Dec 2021
Benchmark for Out-of-Distribution Detection in Deep Reinforcement Learning Aaqib Parvez Mohammed Matias Valdenegro-Toro OOD OffRL 24 10 0 05 Dec 2021
Why Calibration Error is Wrong Given Model Uncertainty: Using Posterior Predictive Checks with Deep Learning Achintya Gopal UQCV 32 1 0 02 Dec 2021
The Devil is in the Margin: Margin-based Label Smoothing for Network Calibration Bingyuan Liu Ismail Ben Ayed Adrian Galdran Jose Dolz UQCV 28 65 0 30 Nov 2021
ExCon: Explanation-driven Supervised Contrastive Learning for Image Classification Zhibo Zhang Jongseong Jang C. Trabelsi Ruiwen Li Scott Sanner Yeonjeong Jeong Dongsub Shim 14 4 0 28 Nov 2021
Country-wide Retrieval of Forest Structure From Optical and SAR Satellite Imagery With Deep Ensembles Alexander Becker S. Russo Stefano Puliti Nico Lang Konrad Schindler Jan Dirk Wegner 35 40 0 25 Nov 2021
Robust Object Detection with Multi-input Multi-output Faster R-CNN Sebastian Cygert A. Czyżewski ObjD 20 1 0 25 Nov 2021
Transferability Metrics for Selecting Source Model Ensembles A. Agostinelli J. Uijlings Thomas Mensink V. Ferrari 15 23 0 25 Nov 2021
Reliable Graph Neural Networks for Drug Discovery Under Distributional Shift Kehang Han Balaji Lakshminarayanan J. Liu OOD GNN 19 33 0 25 Nov 2021
Towards Fewer Annotations: Active Learning via Region Impurity and Prediction Uncertainty for Domain Adaptive Semantic Segmentation Binhui Xie Longhui Yuan Shuang Li Chi Harold Liu Xinjing Cheng UQCV 34 89 0 25 Nov 2021
ReAct: Out-of-distribution Detection With Rectified Activations Yiyou Sun Chuan Guo Yixuan Li OODD 43 457 0 24 Nov 2021
DAPPER: Label-Free Performance Estimation after Personalization for Heterogeneous Mobile Sensing Taesik Gong Yewon Kim Adiba Orzikulova Yunxin Liu Sung Ju Hwang Jinwoo Shin Sung-Ju Lee 27 8 0 22 Nov 2021
DICE: Leveraging Sparsification for Out-of-Distribution Detection Yiyou Sun Yixuan Li OODD 38 152 0 18 Nov 2021
Selective Ensembles for Consistent Predictions Emily Black Klas Leino Matt Fredrikson 20 21 0 16 Nov 2021
On Efficient Uncertainty Estimation for Resource-Constrained Mobile Applications J. Rock Tiago Azevedo R. D. Jong Daniel Ruiz-Munoz Partha P. Maji UQCV 35 5 0 11 Nov 2021
Trustworthy Multimodal Regression with Mixture of Normal-inverse Gamma Distributions Huan Ma Zongbo Han Changqing Zhang Huazhu Fu Qiufeng Wang Q. Hu EDL UQCV 79 42 0 11 Nov 2021
Mixtures of Laplace Approximations for Improved Post-Hoc Uncertainty in Deep Learning Runa Eschenhagen Erik A. Daxberger Philipp Hennig Agustinus Kristiadi UQCV BDL 30 22 0 05 Nov 2021
A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications Xinlei Zhou Han Liu Farhad Pourpanah T. Zeng Xizhao Wang UQCV UD 29 58 0 03 Nov 2021
Exploring Covariate and Concept Shift for Detection and Calibration of Out-of-Distribution Data Junjiao Tian Yen-Change Hsu Yilin Shen Hongxia Jin Z. Kira OODD 19 6 0 28 Oct 2021
A Geometric Perspective towards Neural Calibration via Sensitivity Decomposition Junjiao Tian Dylan Yung Yen-Chang Hsu Z. Kira 27 23 0 27 Oct 2021
What Do We Mean by Generalization in Federated Learning? Honglin Yuan Warren Morningstar Lin Ning K. Singhal OOD FedML 46 71 0 27 Oct 2021
Diversity Matters When Learning From Ensembles G. Nam Jongmin Yoon Yoonho Lee Juho Lee UQCV FedML VLM 43 36 0 27 Oct 2021
Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification Maximilian Stadler Bertrand Charpentier Simon Geisler Daniel Zügner Stephan Günnemann UQCV BDL 46 81 0 26 Oct 2021
Diversity and Generalization in Neural Network Ensembles Luis A. Ortega Rafael Cabañas A. Masegosa FedML UQCV 28 43 0 26 Oct 2021
AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification Romain Egele R. Maulik Krishnan Raghavan Bethany Lusch Isabelle M Guyon Prasanna Balaprakash UQCV OOD BDL 20 47 0 26 Oct 2021
Alignment Attention by Matching Key and Query Distributions Shujian Zhang Xinjie Fan Huangjie Zheng Korawat Tanwisuth Mingyuan Zhou OOD 40 10 0 25 Oct 2021
Perceptual Consistency in Video Segmentation Yizhe Zhang Shubhankar Borse Hong Cai Ying Wang N. Bi Xiaoyun Jiang Fatih Porikli VOS 16 14 0 24 Oct 2021
Combining Different V1 Brain Model Variants to Improve Robustness to Image Corruptions in CNNs A. Baidya Joel Dapello J. DiCarlo Tiago Marques AAML 33 6 0 20 Oct 2021
Natural Attribute-based Shift Detection Jeonghoon Park Jimin Hong Radhika Dua Daehoon Gwak Yixuan Li Jaegul Choo Edward Choi OOD 25 3 0 18 Oct 2021
Centroid Approximation for Bootstrap: Improving Particle Quality at Inference Mao Ye Qiang Liu 27 1 0 17 Oct 2021
Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction Sara Elkerdawy Mostafa Elhoushi Hong Zhang Nilanjan Ray CVBM 31 38 0 15 Oct 2021
Dropout Prediction Uncertainty Estimation Using Neuron Activation Strength Haichao Yu Zhe Chen Dong Lin G. Shamir Jie Han UQCV 35 0 0 13 Oct 2021
Dense Uncertainty Estimation Jing Zhang Yuchao Dai Mochu Xiang Deng-Ping Fan Peyman Moghadam Mingyi He Christian J. Walder Kaihao Zhang Mehrtash Harandi Nick Barnes UQCV BDL 58 11 0 13 Oct 2021
Meta Learning Low Rank Covariance Factors for Energy-Based Deterministic Uncertainty Jeffrey Willette Haebeom Lee Juho Lee Sung Ju Hwang OODD OOD 44 1 0 12 Oct 2021
On out-of-distribution detection with Bayesian neural networks Francesco DÁngelo Christian Henning BDL UQCV 29 6 0 12 Oct 2021
Revisiting Design Choices in Offline Model-Based Reinforcement Learning Cong Lu Philip J. Ball Jack Parker-Holder Michael A. Osborne Stephen J. Roberts OffRL 37 54 0 08 Oct 2021
Sparse MoEs meet Efficient Ensembles J. Allingham F. Wenzel Zelda E. Mariet Basil Mustafa J. Puigcerver ... Balaji Lakshminarayanan Jasper Snoek Dustin Tran Carlos Riquelme Ruiz Rodolphe Jenatton MoE 51 21 0 07 Oct 2021
Improving Confidence Estimation on Out-of-Domain Data for End-to-End Speech Recognition Qiujia Li Yu Zhang David Qiu Yanzhang He Liangliang Cao P. Woodland 31 11 0 07 Oct 2021
Reliable Probability Intervals For Classification Using Inductive Venn Predictors Based on Distance Learning Dimitrios Boursinos X. Koutsoukos 29 1 0 07 Oct 2021