Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,042 papers shown

Title
Characterizing Data Point Vulnerability via Average-Case Robustness Tessa Han Suraj Srinivas Himabindu Lakkaraju AAML OOD 37 0 0 26 Jul 2023
Model Calibration in Dense Classification with Adaptive Label Perturbation Jiawei Liu Changkun Ye Shanpeng Wang Rui-Qing Cui Jing Zhang Kai Zhang Nick Barnes 47 5 0 25 Jul 2023
Rethinking Data Distillation: Do Not Overlook Calibration Dongyao Zhu Bowen Lei Jie M. Zhang Yanbo Fang Ruqi Zhang Yiqun Xie Dongkuan Xu DD FedML 23 15 0 24 Jul 2023
Information-theoretic Analysis of Test Data Sensitivity in Uncertainty Futoshi Futami Tomoharu Iwata UD PER 22 3 0 23 Jul 2023
U-CE: Uncertainty-aware Cross-Entropy for Semantic Segmentation S. Landgraf Markus Hillemann Kira Wursthorn Markus Ulrich SSeg UQCV 31 6 0 19 Jul 2023
Measuring and Modeling Uncertainty Degree for Monocular Depth Estimation Mochu Xiang Jing Zhang Nick Barnes Yuchao Dai UQCV 45 3 0 19 Jul 2023
An Empirical Study of Pre-trained Model Selection for Out-of-Distribution Generalization and Calibration Hiroki Naganuma Ryuichiro Hataya Kotaro Yoshida Ioannis Mitliagkas OODD 95 1 0 17 Jul 2023
PseudoCal: A Source-Free Approach to Unsupervised Uncertainty Calibration in Domain Adaptation Dapeng Hu Jian Liang Xinchao Wang Chuan-Sheng Foo 23 0 0 14 Jul 2023
Drug Discovery under Covariate Shift with Domain-Informed Prior Distributions over Functions Leo Klarner Tim G. J. Rudner M. Reutlinger Torsten Schindler Garrett M. Morris Charlotte M. Deane Yee Whye Teh OOD BDL 15 9 0 14 Jul 2023
Function-Space Regularization for Deep Bayesian Classification J. Lin Joe Watson Pascal Klink Jan Peters UQCV BDL 41 1 0 12 Jul 2023
URL: A Representation Learning Benchmark for Transferable Uncertainty Estimates Michael Kirchhof Bálint Mucsányi Seong Joon Oh Enkelejda Kasneci UQCV 374 13 0 07 Jul 2023
DE-TGN: Uncertainty-Aware Human Motion Forecasting using Deep Ensembles Kareem A. Eltouny Wansong Liu Sibo Tian Minghui Zheng Xiao Liang 3DH 29 7 0 07 Jul 2023
Quantification of Uncertainty with Adversarial Models Kajetan Schweighofer L. Aichberger Mykyta Ielanskyi Günter Klambauer Sepp Hochreiter UQCV 42 14 0 06 Jul 2023
Achieving Reliable and Fair Skin Lesion Diagnosis via Unsupervised Domain Adaptation Janet Wang Yunbei Zhang Zhengming Ding Jihun Hamm 35 5 0 06 Jul 2023
BaBE: Enhancing Fairness via Estimation of Latent Explaining Variables Ruta Binkyt.e D. Gorla C. Palamidessi FaML 30 1 0 06 Jul 2023
Fisher-Weighted Merge of Contrastive Learning Models in Sequential Recommendation Jung Hyun Ryu Jaeheyoung Jeon Jewoong Cho Myung-joo Kang MoMe 19 1 0 05 Jul 2023
Empirically Validating Conformal Prediction on Modern Vision Architectures Under Distribution Shift and Long-tailed Data Kevin Kasa Graham W. Taylor 43 2 0 03 Jul 2023
Morse Neural Networks for Uncertainty Quantification Benoit Dherin Huiyi Hu Jie Jessie Ren Michael W. Dusenberry Balaji Lakshminarayanan UQCV AI4CE 26 4 0 02 Jul 2023
Introspective Perception for Mobile Robots Sadegh Rabiee Joydeep Biswas 36 3 0 29 Jun 2023
Towards Robust Aspect-based Sentiment Analysis through Non-counterfactual Augmentations Xinyu Liu Yanl Ding Kaikai An Chunyang Xiao Pranava Madhyastha Tong Xiao Jingbo Zhu 35 2 0 24 Jun 2023
Density Uncertainty Layers for Reliable Uncertainty Estimation Yookoon Park David M. Blei UQCV BDL 35 2 0 21 Jun 2023
Beyond Deep Ensembles: A Large-Scale Evaluation of Bayesian Deep Learning under Distribution Shift Florian Seligmann P. Becker Michael Volpp Gerhard Neumann UQCV 27 14 0 21 Jun 2023
Uncertainty Estimation for Molecules: Desiderata and Methods Tom Wollschlager Nicholas Gao Bertrand Charpentier Mohamed Amine Ketata Stephan Günnemann 29 9 0 20 Jun 2023
Traversing Between Modes in Function Space for Fast Ensembling Eunggu Yun Hyungi Lee G. Nam Juho Lee UQCV 34 2 0 20 Jun 2023
Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn OOD 22 5 0 19 Jun 2023
Improving Selective Visual Question Answering by Learning from Your Peers Corentin Dancette Spencer Whitehead Rishabh Maheshwary Ramakrishna Vedantam Stefan Scherer Xinlei Chen Matthieu Cord Marcus Rohrbach AAML OOD 40 16 0 14 Jun 2023
Multiclass Confidence and Localization Calibration for Object Detection Bimsara Pathiraja Malitha Gunawardhana M. H. Khan UQCV 34 15 0 14 Jun 2023
BeliefPPG: Uncertainty-aware Heart Rate Estimation from PPG signals via Belief Propagation Valentin Bieri Paul Streli B. U. Demirel Christian Holz 27 8 0 13 Jun 2023
Deep Gaussian Mixture Ensembles Yousef El-Laham Niccolò Dalmasso Elizabeth Fons Svitlana Vyetrenko BDL UQCV 33 2 0 12 Jun 2023
Variational Imbalanced Regression: Fair Uncertainty Quantification via Probabilistic Smoothing Ziyan Wang Hao Wang UQCV 22 0 0 11 Jun 2023
Explaining Predictive Uncertainty with Information Theoretic Shapley Values David S. Watson Joshua O'Hara Niek Tax Richard Mudd Ido Guy TDI FAtt 34 22 0 09 Jun 2023
On the Joint Interaction of Models, Data, and Features Yiding Jiang Christina Baek J. Zico Kolter FedML 28 4 0 07 Jun 2023
ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptation Jiaming Liu Senqiao Yang Peidong Jia Renrui Zhang Ming Lu Yandong Guo Wei Xue Shanghang Zhang TTA OOD VLM 30 36 0 07 Jun 2023
Asymptotics of Bayesian Uncertainty Estimation in Random Features Regression You-Hyun Baek S. Berchuck Sayan Mukherjee 26 0 0 06 Jun 2023
Using Multiple Dermoscopic Photographs of One Lesion Improves Melanoma Classification via Deep Learning: A Prognostic Diagnostic Accuracy Study A. Hekler Roman C. Maron Sarah Haggenmuller Max Schmitt Christoph Wies ... Matthias Goebeler Bastian Schilling Jakob N. Kather E. Krieghoff-Henning T. Brinker 25 3 0 05 Jun 2023
Input-gradient space particle inference for neural network ensembles Trung Trinh Markus Heinonen Luigi Acerbi Samuel Kaski UQCV 32 3 0 05 Jun 2023
Uncertainty in Natural Language Processing: Sources, Quantification, and Applications Mengting Hu Zhen Zhang Shiwan Zhao Minlie Huang Bingzhe Wu BDL 31 35 0 05 Jun 2023
Sen2Pro: A Probabilistic Perspective to Sentence Embedding from Pre-trained Language Model Lingfeng Shen Haiyun Jiang Lemao Liu Shuming Shi 21 2 0 04 Jun 2023
A Data-Driven Measure of Relative Uncertainty for Misclassification Detection Eduardo Dadalto Camara Gomes Marco Romanelli Georg Pichler Pablo Piantanida UQCV 40 5 0 02 Jun 2023
Estimating Semantic Similarity between In-Domain and Out-of-Domain Samples Rhitabrat Pokharel Ameeta Agrawal OODD 27 2 0 01 Jun 2023
On the Limitations of Temperature Scaling for Distributions with Overlaps Muthuraman Chidambaram Rong Ge UQCV 40 4 0 01 Jun 2023
(Almost) Provable Error Bounds Under Distribution Shift via Disagreement Discrepancy Elan Rosenfeld Saurabh Garg UQCV 40 4 0 01 Jun 2023
ActiveAED: A Human in the Loop Improves Annotation Error Detection Leon Weber Barbara Plank 35 10 0 31 May 2023
A Study of Bayesian Neural Network Surrogates for Bayesian Optimization Y. Li Tim G. J. Rudner A. Wilson BDL 42 28 0 31 May 2023
Perception and Semantic Aware Regularization for Sequential Confidence Calibration Zhenghua Peng Yuanmao Luo Tianshui Chen Keke Xu Shuangping Huang AI4TS 30 2 0 31 May 2023
Trustworthy Sensor Fusion against Inaudible Command Attacks in Advanced Driver-Assistance System Jiwei Guan Lei Pan Chen Wang Shui Yu Longxiang Gao Xi Zheng AAML 19 3 0 30 May 2023
Beyond Confidence: Reliable Models Should Also Consider Atypicality Mert Yuksekgonul Linjun Zhang James Zou Carlos Guestrin 32 20 0 29 May 2023
Federated Conformal Predictors for Distributed Uncertainty Quantification Charles Lu Yaodong Yu Sai Praneeth Karimireddy Michael I. Jordan Ramesh Raskar FedML 42 22 0 27 May 2023
Characterizing Out-of-Distribution Error via Optimal Transport Yuzhe Lu Yilong Qin Runtian Zhai Andrew Shen Ketong Chen Zhenlin Wang Soheil Kolouri Simon Stepputtis Joseph Campbell Katia P. Sycara OODD 40 10 0 25 May 2023
How to Fix a Broken Confidence Estimator: Evaluating Post-hoc Methods for Selective Classification with Deep Neural Networks L. F. P. Cattelan Danilo Silva UQCV 27 6 0 24 May 2023