v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
Probabilistic Attention based on Gaussian Processes for Deep Multiple Instance Learning Arne Schmidt Pablo Morales-Álvarez Rafael Molina 73 15 0 08 Feb 2023
How Reliable is Your Regression Model's Uncertainty Under Real-World Distribution Shifts? Fredrik K. Gustafsson Martin Danelljan Thomas B. Schon OOD UQCV 66 12 0 07 Feb 2023
Variational Inference on the Final-Layer Output of Neural Networks Yadi Wei Roni Khardon BDL UQCV 85 0 0 05 Feb 2023
A Minimax Approach Against Multi-Armed Adversarial Attacks Detection Federica Granese Marco Romanelli S. Garg Pablo Piantanida AAML 55 0 0 04 Feb 2023
The Science of Detecting LLM-Generated Texts Ruixiang Tang Yu-Neng Chuang Helen Zhou DeLMO 98 180 0 04 Feb 2023
Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications Chengyu Dong OOD UQCV BDL AI4CE 128 0 0 02 Feb 2023
Benchmarking Probabilistic Deep Learning Methods for License Plate Recognition Franziska Schirrmacher Benedikt Lorch Anatol Maier Christian Riess UQCV 78 6 0 02 Feb 2023
Confidence and Dispersity Speak: Characterising Prediction Matrix for Unsupervised Accuracy Estimation Weijian Deng Yumin Suh Stephen Gould Liang Zheng UQCV 81 13 0 02 Feb 2023
Model Monitoring and Robustness of In-Use Machine Learning Models: Quantifying Data Distribution Shifts Using Population Stability Index A. Khademi M. Hopka Devesh Upadhyay OOD 73 3 0 01 Feb 2023
Pathologies of Predictive Diversity in Deep Ensembles Taiga Abe E. Kelly Buchanan Geoff Pleiss John P. Cunningham UQCV 147 14 0 01 Feb 2023
ForkMerge: Mitigating Negative Transfer in Auxiliary-Task Learning Junguang Jiang Baixu Chen Junwei Pan Ximei Wang Liu Dapeng Jie Jiang Mingsheng Long MoMe 90 23 0 30 Jan 2023
Conformal inference is (almost) free for neural networks trained with early stopping Zi-Chen Liang Yan Zhou Matteo Sesia BDL 117 11 0 27 Jan 2023
On the role of Model Uncertainties in Bayesian Optimization Jonathan Foldager Mikkel Jordahn Lars Kai Hansen Michael Riis Andersen 175 5 0 14 Jan 2023
How Does Traffic Environment Quantitatively Affect the Autonomous Driving Prediction? Wenbo Shao Yan Xu Jun Yu Li Chen Lv Weida Wang Hong Wang 86 9 0 11 Jan 2023
Benchmarking common uncertainty estimation methods with histopathological images under domain shift and label noise H. A. Mehrtens Alexander Kurz Tabea-Clara Bucher T. Brinker OOD UQCV 272 11 0 03 Jan 2023
Towards Reliable Medical Image Segmentation by utilizing Evidential Calibrated Uncertainty K. Zou Yidi Chen Ling Huang Xuedong Yuan Xiaojing Shen Meng Wang Rick Siow Mong Goh Yong-Jin Liu Huazhu Fu UQCV 84 4 0 01 Jan 2023
Detection of out-of-distribution samples using binary neuron activation patterns Bartlomiej Olber Krystian Radlak A. Popowicz Michal Szczepankiewicz K. Chachula OODD 56 17 0 29 Dec 2022
A System-Level View on Out-of-Distribution Data in Robotics Rohan Sinha Apoorva Sharma Somrita Banerjee T. Lew Rachel Luo Spencer M. Richards Yixiao Sun Edward Schmerling Marco Pavone UQCV 97 26 0 28 Dec 2022
Annealing Double-Head: An Architecture for Online Calibration of Deep Neural Networks Erdong Guo D. Draper Maria de Iorio 76 0 0 27 Dec 2022
On Calibrating Semantic Segmentation Models: Analyses and An Algorithm Dongdong Wang Boqing Gong Liqiang Wang 90 27 0 22 Dec 2022
ECG-Based Electrolyte Prediction: Evaluating Regression and Probabilistic Methods Philipp Bachmann Daniel Gedon Fredrik K. Gustafsson Antônio H. Ribeiro E. Lampa S. Gustafsson Johan Sundström Thomas B. Schon 61 1 0 21 Dec 2022
TMS-Net: A Segmentation Network Coupled With A Run-time Quality Control Method For Robust Cardiac Image Segmentation F. Uslu Anil A. Bharath 67 15 0 21 Dec 2022
KL Regularized Normalization Framework for Low Resource Tasks Neeraj Kumar Ankur Narang Brejesh Lall 58 1 0 21 Dec 2022
Calibrating Deep Neural Networks using Explicit Regularisation and Dynamic Data Pruning R. Hebbalaguppe Rishabh Patra T. Dash Gautam M. Shroff Lovekesh Vig 74 15 0 20 Dec 2022
Bayesian posterior approximation with stochastic ensembles Oleksandr Balabanov Bernhard Mehlig Hampus Linander BDL UQCV 120 5 0 15 Dec 2022
Scalable Bayesian Uncertainty Quantification for Neural Network Potentials: Promise and Pitfalls Stephan Thaler Gregor Doehner Julija Zavadlav 101 21 0 15 Dec 2022
Rethinking the Role of Pre-Trained Networks in Source-Free Domain Adaptation Wenyu Zhang Li Shen Chuan-Sheng Foo TTA AI4CE 86 19 0 15 Dec 2022
Uncertainty Quantification for Deep Neural Networks: An Empirical Comparison and Usage Guidelines Michael Weiss Paolo Tonella BDL UQCV 76 11 0 14 Dec 2022
An Exploratory Study of AI System Risk Assessment from the Lens of Data Distribution and Uncertainty Zhijie Wang Yuheng Huang Lei Ma Haruki Yokoyama Susumu Tokumoto Kazuki Munakata 64 4 0 13 Dec 2022
Efficient Bayesian Uncertainty Estimation for nnU-Net Yidong Zhao Changchun Yang Artur M. Schweidtmann Qian Tao UQCV BDL 62 22 0 12 Dec 2022
Reliable Multimodal Trajectory Prediction via Error Aligned Uncertainty Optimization Neslihan Kose R. Krishnan Akash Dhamasia Omesh Tickoo Michael Paulitsch 58 1 0 09 Dec 2022
PØDA: Prompt-driven Zero-shot Domain Adaptation Mohammad Fahes Tuan-Hung Vu Andrei Bursuc Patrick Pérez Raoul de Charette VLM 151 49 0 06 Dec 2022
A Learning Based Hypothesis Test for Harmful Covariate Shift T. Ginsberg Zhongyuan Liang Rahul G. Krishnan 90 14 0 06 Dec 2022
Calibration and generalizability of probabilistic models on low-data chemical datasets with DIONYSUS Gary Tom Riley J. Hickman Aniket N. Zinzuwadia A. Mohajeri Benjamín Sánchez-Lengeling A. Aspuru‐Guzik 82 17 0 03 Dec 2022
Understanding the Robustness of Multi-Exit Models under Common Corruptions Akshay Mehra Skyler Seto Navdeep Jaitly B. Theobald AAML 86 4 0 03 Dec 2022
Investigating Deep Learning Model Calibration for Classification Problems in Mechanics S. Mohammadzadeh Peerasait Prachaseree Emma Lejeune AI4CE 65 3 0 01 Dec 2022
A Call to Reflect on Evaluation Practices for Failure Detection in Image Classification Paul F. Jaeger Carsten T. Lüth Lukas Klein Till J. Bungert UQCV 103 38 0 28 Nov 2022
Class Adaptive Network Calibration Bingyuan Liu Jérôme Rony Adrian Galdran Jose Dolz Ismail Ben Ayed 94 10 0 28 Nov 2022
Looking at the posterior: accuracy and uncertainty of neural-network predictions Hampus Linander Oleksandr Balabanov Henry Yang Bernhard Mehlig UQCV UD BDL 80 2 0 26 Nov 2022
Ensemble Multi-Quantiles: Adaptively Flexible Distribution Prediction for Uncertainty Quantification Xing Yan Yonghua Su Wenxuan Ma UQCV 91 2 0 26 Nov 2022
MP-GELU Bayesian Neural Networks: Moment Propagation by GELU Nonlinearity Yuki Hirayama Sinya Takamaeda-Yamazaki BDL 49 0 0 24 Nov 2022
Improving Multi-task Learning via Seeking Task-based Flat Regions Hoang Phan Lam C. Tran Ngoc N. Tran Nhat Ho Tuan Truong Qi Lei Nhat Ho Dinh Q. Phung Trung Le 209 11 0 24 Nov 2022
Benchmarking Bayesian Deep Learning on Diabetic Retinopathy Detection Tasks Neil Band Tim G. J. Rudner Qixuan Feng Angelos Filos Zachary Nado Michael W. Dusenberry Ghassen Jerfel Dustin Tran Y. Gal OOD UQCV BDL 57 54 0 23 Nov 2022
AdaFocal: Calibration-aware Adaptive Focal Loss Arindam Ghosh Thomas Schaaf Matthew R. Gormley FedML UQCV 97 30 0 21 Nov 2022
Layer-Stack Temperature Scaling Amr Khalifa Michael C. Mozer Hanie Sedghi Behnam Neyshabur Ibrahim Alabdulmohsin 146 2 0 18 Nov 2022
Weighted Ensemble Self-Supervised Learning Yangjun Ruan Saurabh Singh Warren Morningstar Alexander A. Alemi Sergey Ioffe Ian S. Fischer Joshua V. Dillon FedML 83 16 0 18 Nov 2022
Introduction and Exemplars of Uncertainty Decomposition Shuo Chen UD UQCV PER 72 1 0 17 Nov 2022
Interpretable Self-Aware Neural Networks for Robust Trajectory Prediction Masha Itkina Mykel J. Kochenderfer EDL UQCV 107 26 0 16 Nov 2022
A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks Tommaso Salvatori Yuhang Song Yordan Yordanov Beren Millidge Zheng R. Xu Lei Sha Cornelius Emde Rafal Bogacz Thomas Lukasiewicz 99 13 0 16 Nov 2022
Calibrated Interpretation: Confidence Estimation in Semantic Parsing Elias Stengel-Eskin Benjamin Van Durme UQLM 160 25 0 14 Nov 2022