v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
BEA: Revisiting anchor-based object detection DNN using Budding Ensemble Architecture S. Qutub Neslihan Kose Rafael Rosales Michael Paulitsch Korbinian Hagn Florian Geissler Yang Peng Gereon Hinz Alois C. Knoll 68 3 0 14 Sep 2023
RT-LM: Uncertainty-Aware Resource Management for Real-Time Inference of Language Models Yufei Li Zexin Li Wei Yang Cong Liu 61 8 0 12 Sep 2023
Towards generalisable and calibrated synthetic speech detection with self-supervised representations Octavian Pascu Adriana Stan Dan Oneaţă Elisabeta Oneata H. Cucu SSL 86 13 0 11 Sep 2023
Affine Invariant Ensemble Transform Methods to Improve Predictive Uncertainty in Neural Networks Diksha Bhandari Jakiw Pidstrigach Sebastian Reich 79 1 0 09 Sep 2023
Multiclass Alignment of Confidence and Certainty for Network Calibration Vinith Kugathasan M. H. Khan UQCV 55 1 0 06 Sep 2023
Building a Winning Team: Selecting Source Model Ensembles using a Submodular Transferability Estimation Approach KB Vimal Saketh Bachu Tanmay Garg Niveditha Lakshmi Narasimhan Raghavan Konuru Vineeth N. Balasubramanian 91 2 0 05 Sep 2023
A Theoretical and Practical Framework for Evaluating Uncertainty Calibration in Object Detection Pedro Conde Rui L. Lopes C. Premebida UQCV 83 1 0 01 Sep 2023
Uncertainty Aware Training to Improve Deep Learning Model Calibration for Classification of Cardiac MR Images Tareen Dawood Chen Chen B. Sidhu B. Ruijsink J. Gould ... Vishal S. Mehta C. Rinaldi Esther Puyol-Antón Reza Razavi A. King OOD 106 12 0 29 Aug 2023
Diversified Ensemble of Independent Sub-Networks for Robust Self-Supervised Representation Learning Amirhossein Vahidi Lisa Wimmer H. Gündüz Bernd Bischl Eyke Hüllermeier Mina Rezaei OOD UQCV 86 4 0 28 Aug 2023
RankMixup: Ranking-Based Mixup Training for Network Calibration Jongyoun Noh Hyekang Park Junghyup Lee Bumsub Ham UQCV 75 10 0 23 Aug 2023
Deep Evidential Learning for Bayesian Quantile Regression F. B. Hüttel Filipe Rodrigues Francisco Câmara Pereira UD EDL BDL UQCV 64 5 0 21 Aug 2023
Sensitivity analysis of AI-based algorithms for autonomous driving on optical wavefront aberrations induced by the windshield D. Wolf Markus Ulrich Nikhil Kapoor 67 3 0 19 Aug 2023
Distance Matters For Improving Performance Estimation Under Covariate Shift Mélanie Roschewitz Ben Glocker 62 1 0 14 Aug 2023
When Monte-Carlo Dropout Meets Multi-Exit: Optimizing Bayesian Neural Networks on FPGA Hongxiang Fan Hao Mark Chen Liam Castelli Zhiqiang Que He Li Kenneth Long Wayne Luk BDL 41 2 0 13 Aug 2023
Comparing the quality of neural network uncertainty estimates for classification problems Daniel Ries Joshua J. Michalenko T. Ganter R. Baiyasi Jason Adams UQCV BDL 64 1 0 11 Aug 2023
LOUC: Leave-One-Out-Calibration Measure for Analyzing Human Matcher Performance Matan Solomon Bar Genossar Roee Shraga A. Gal 42 0 0 03 Aug 2023
Learning to Generate Training Datasets for Robust Semantic Segmentation Marwane Hariat Olivier Laurent Rémi Kazmierczak Shihao Zhang Andrei Bursuc Angela Yao Gianni Franchi UQCV 79 2 0 01 Aug 2023
GradOrth: A Simple yet Efficient Out-of-Distribution Detection with Orthogonal Projection of Gradients Sima Behpour T. Doan Xin Li Wenbin He Liangke Gou Liu Ren OODD 97 17 0 01 Aug 2023
Evaluating the Robustness of Test Selection Methods for Deep Neural Networks Qiang Hu Yuejun Guo Xiaofei Xie Maxime Cordy Wei Ma Mike Papadakis Yves Le Traon NoLa OOD 63 5 0 29 Jul 2023
EnSolver: Uncertainty-Aware Ensemble CAPTCHA Solvers with Theoretical Guarantees D. C. Hoang Behzad Ousat Amin Kharraz Cuong V Nguyen AAML 76 1 0 27 Jul 2023
Towards Practicable Sequential Shift Detectors Oliver Cobb A. V. Looveren 67 0 0 27 Jul 2023
Understanding Silent Failures in Medical Image Classification Till J. Bungert L. Kobelke Paul F. Jaeger UQCV 77 4 0 27 Jul 2023
Characterizing Data Point Vulnerability via Average-Case Robustness Tessa Han Suraj Srinivas Himabindu Lakkaraju AAML OOD 100 1 0 26 Jul 2023
Model Calibration in Dense Classification with Adaptive Label Perturbation Jiawei Liu Changkun Ye Shanpeng Wang Rui-Qing Cui Jing Zhang Kai Zhang Nick Barnes 69 5 0 25 Jul 2023
Rethinking Data Distillation: Do Not Overlook Calibration Dongyao Zhu Bowen Lei Jie M. Zhang Yanbo Fang Ruqi Zhang Yiqun Xie Dongkuan Xu DD FedML 89 16 0 24 Jul 2023
Information-theoretic Analysis of Test Data Sensitivity in Uncertainty Futoshi Futami Tomoharu Iwata UD PER 62 3 0 23 Jul 2023
U-CE: Uncertainty-aware Cross-Entropy for Semantic Segmentation S. Landgraf Markus Hillemann Kira Wursthorn Markus Ulrich SSeg UQCV 64 7 0 19 Jul 2023
Measuring and Modeling Uncertainty Degree for Monocular Depth Estimation Mochu Xiang Jing Zhang Nick Barnes Yuchao Dai UQCV 75 4 0 19 Jul 2023
An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration Hiroki Naganuma Ryuichiro Hataya Kotaro Yoshida Ioannis Mitliagkas OODD 175 3 0 17 Jul 2023
PseudoCal: A Source-Free Approach to Unsupervised Uncertainty Calibration in Domain Adaptation Dapeng Hu Jian Liang Xinchao Wang Chuan-Sheng Foo 55 0 0 14 Jul 2023
Drug Discovery under Covariate Shift with Domain-Informed Prior Distributions over Functions Leo Klarner Tim G. J. Rudner M. Reutlinger Torsten Schindler Garrett M. Morris Charlotte M. Deane Yee Whye Teh OOD BDL 52 10 0 14 Jul 2023
Function-Space Regularization for Deep Bayesian Classification J. Lin Joe Watson Pascal Klink Jan Peters UQCV BDL 71 1 0 12 Jul 2023
URL: A Representation Learning Benchmark for Transferable Uncertainty Estimates Michael Kirchhof Bálint Mucsányi Seong Joon Oh Enkelejda Kasneci UQCV 491 15 0 07 Jul 2023
DE-TGN: Uncertainty-Aware Human Motion Forecasting using Deep Ensembles Kareem A. Eltouny Wansong Liu Sibo Tian Minghui Zheng Xiao Liang 3DH 53 7 0 07 Jul 2023
Quantification of Uncertainty with Adversarial Models Kajetan Schweighofer L. Aichberger Mykyta Ielanskyi Günter Klambauer Sepp Hochreiter UQCV 88 17 0 06 Jul 2023
Achieving Reliable and Fair Skin Lesion Diagnosis via Unsupervised Domain Adaptation Janet Wang Yunbei Zhang Zhengming Ding Jihun Hamm 127 6 0 06 Jul 2023
BaBE: Enhancing Fairness via Estimation of Latent Explaining Variables Ruta Binkyt.e D. Gorla C. Palamidessi FaML 47 1 0 06 Jul 2023
Fisher-Weighted Merge of Contrastive Learning Models in Sequential Recommendation Jung Hyun Ryu Jaeheyoung Jeon Jewoong Cho Myung-joo Kang MoMe 44 1 0 05 Jul 2023
Empirically Validating Conformal Prediction on Modern Vision Architectures Under Distribution Shift and Long-tailed Data Kevin Kasa Graham W. Taylor 94 4 0 03 Jul 2023
Morse Neural Networks for Uncertainty Quantification Benoit Dherin Huiyi Hu Jie Jessie Ren Michael W. Dusenberry Balaji Lakshminarayanan UQCV AI4CE 41 4 0 02 Jul 2023
Introspective Perception for Mobile Robots Sadegh Rabiee Joydeep Biswas 75 4 0 29 Jun 2023
Towards Robust Aspect-based Sentiment Analysis through Non-counterfactual Augmentations Xinyu Liu Yanl Ding Kaikai An Chunyang Xiao Pranava Madhyastha Tong Xiao Jingbo Zhu 87 2 0 24 Jun 2023
Density Uncertainty Layers for Reliable Uncertainty Estimation Yookoon Park David M. Blei UQCV BDL 56 2 0 21 Jun 2023
Beyond Deep Ensembles: A Large-Scale Evaluation of Bayesian Deep Learning under Distribution Shift Florian Seligmann P. Becker Michael Volpp Gerhard Neumann UQCV 87 16 0 21 Jun 2023
Uncertainty Estimation for Molecules: Desiderata and Methods Tom Wollschlager Nicholas Gao Bertrand Charpentier Mohamed Amine Ketata Stephan Günnemann 93 10 0 20 Jun 2023
Traversing Between Modes in Function Space for Fast Ensembling Eunggu Yun Hyungi Lee G. Nam Juho Lee UQCV 62 3 0 20 Jun 2023
Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn OOD 101 5 0 19 Jun 2023
Improving Selective Visual Question Answering by Learning from Your Peers Corentin Dancette Spencer Whitehead Rishabh Maheshwary Ramakrishna Vedantam Stefan Scherer Xinlei Chen Matthieu Cord Marcus Rohrbach AAML OOD 82 17 0 14 Jun 2023
Multiclass Confidence and Localization Calibration for Object Detection Bimsara Pathiraja Malitha Gunawardhana M. H. Khan UQCV 95 15 0 14 Jun 2023
BeliefPPG: Uncertainty-aware Heart Rate Estimation from PPG signals via Belief Propagation Valentin Bieri Paul Streli B. U. Demirel Christian Holz 104 8 0 13 Jun 2023