v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
MixMo: Mixing Multiple Inputs for Multiple Outputs via Deep Subnetworks Alexandre Ramé Rémy Sun Matthieu Cord UQCV 108 60 0 10 Mar 2021
Limitations of Post-Hoc Feature Alignment for Robustness Collin Burns Jacob Steinhardt OOD 97 23 0 10 Mar 2021
Memory-efficient Learning for High-Dimensional MRI Reconstruction Ke Wang Michael R. Kellman Christopher M. Sandino Kevin Zhang S. Vasanawala Jonathan I. Tamir Stella X. Yu Michael Lustig MedIm 45 12 0 06 Mar 2021
Global canopy height regression and uncertainty estimation from GEDI LIDAR waveforms with deep ensembles Nico Lang Nikolai Kalischek J. Armston Konrad Schindler R. Dubayah Jan Dirk Wegner 59 168 0 05 Mar 2021
On the effectiveness of adversarial training against common corruptions Klim Kireev Maksym Andriushchenko Nicolas Flammarion AAML 72 103 0 03 Mar 2021
A Kernel Framework to Quantify a Model's Local Predictive Uncertainty under Data Distributional Shifts Rishabh Singh José C. Príncipe UQCV 31 0 0 02 Mar 2021
Uncertainty Quantification by Ensemble Learning for Computational Optical Form Measurements L. Hoffmann I. Fortmeier Clemens Elster UQCV 68 28 0 01 Mar 2021
Posterior Meta-Replay for Continual Learning Christian Henning Maria R. Cervera Francesco DÁngelo J. Oswald Regina Traber Benjamin Ehret Seijin Kobayashi Benjamin Grewe João Sacramento CLL BDL 113 60 0 01 Mar 2021
Fool Me Once: Robust Selective Segmentation via Out-of-Distribution Detection with Contrastive Learning David S. W. Williams Matthew Gadd D. Martini Paul Newman OODD 57 13 0 01 Mar 2021
Medical Image Segmentation with Limited Supervision: A Review of Deep Network Models Jialin Peng Ye Wang VLM 104 60 0 28 Feb 2021
NOMU: Neural Optimization-based Model Uncertainty Jakob Heiss Jakob Weissteiner Hanna Wutte Sven Seuken Josef Teichmann BDL 92 20 0 26 Feb 2021
Loss Surface Simplexes for Mode Connecting Volumes and Fast Ensembling Gregory W. Benton Wesley J. Maddox Sanae Lotfi A. Wilson UQCV 126 70 0 25 Feb 2021
Bayesian OOD detection with aleatoric uncertainty and outlier exposure Xi Wang Laurence Aitchison UD 87 15 0 24 Feb 2021
Deep Deterministic Uncertainty: A Simple Baseline Jishnu Mukhoti Andreas Kirsch Joost R. van Amersfoort Philip Torr Y. Gal UD UQCV PER BDL 126 156 0 23 Feb 2021
On Feature Collapse and Deep Kernel Learning for Single Forward Pass Uncertainty Joost R. van Amersfoort Lewis Smith Andrew Jesson Oscar Key Y. Gal UQCV 81 105 0 22 Feb 2021
Improving Uncertainty Calibration via Prior Augmented Data Jeffrey Willette Juho Lee Sung Ju Hwang UQCV 36 0 0 22 Feb 2021
DEUP: Direct Epistemic Uncertainty Prediction Salem Lahlou Moksh Jain Hadi Nekoei V. Butoi Paul Bertin Jarrid Rector-Brooks Maksym Korablyov Yoshua Bengio PER UQLM UQCV UD 317 94 0 16 Feb 2021
COMBO: Conservative Offline Model-Based Policy Optimization Tianhe Yu Aviral Kumar Rafael Rafailov Aravind Rajeswaran Sergey Levine Chelsea Finn OffRL 302 433 0 16 Feb 2021
Don't Just Blame Over-parametrization for Over-confidence: Theoretical Analysis of Calibration in Binary Classification Yu Bai Song Mei Haiquan Wang Caiming Xiong 83 42 0 15 Feb 2021
Bayesian Neural Network Priors Revisited Vincent Fortuin Adrià Garriga-Alonso Sebastian W. Ober F. Wenzel Gunnar Rätsch Richard Turner Mark van der Wilk Laurence Aitchison BDL UQCV 133 141 0 12 Feb 2021
When and How Mixup Improves Calibration Linjun Zhang Zhun Deng Kenji Kawaguchi James Zou UQCV 61 70 0 11 Feb 2021
U-LanD: Uncertainty-Driven Video Landmark Detection Mohammad Jafari C. Luong Michael Y. Tsang A. Gu N. V. Woudenberg R. Rohling T. Tsang Purang Abolmaesumi 75 13 0 02 Feb 2021
Bayesian Neural Networks for Virtual Flow Metering: An Empirical Study B. Grimstad M. Hotvedt Anders T. Sandnes O. Kolbjørnsen Lars Imsland 90 22 0 02 Feb 2021
Fail-Safe Execution of Deep Learning based Systems through Uncertainty Monitoring Michael Weiss Paolo Tonella AAML 123 30 0 01 Feb 2021
DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation Alexandre Ramé Matthieu Cord FedML 85 52 0 14 Jan 2021
An evaluation of word-level confidence estimation for end-to-end automatic speech recognition Dan Oneaţă Alexandru Caranica Adriana Stan H. Cucu UQCV 88 25 0 14 Jan 2021
Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectors Ali Harakeh Steven L. Waslander UQCV 130 41 0 13 Jan 2021
Using uncertainty estimation to reduce false positives in liver lesion detection Ishaan Bhat Hugo J. Kuijf Veronika Cheplygina J. Pluim MedIm 133 9 0 12 Jan 2021
On the Calibration and Uncertainty of Neural Learning to Rank Models Gustavo Penha C. Hauff 260 30 0 12 Jan 2021
A Novel Regression Loss for Non-Parametric Uncertainty Optimization Joachim Sicking Maram Akila Maximilian Pintz Tim Wirtz Asja Fischer Stefan Wrobel UQCV 23 3 0 07 Jan 2021
Practical Evaluation of Out-of-Distribution Detection Methods for Image Classification Engkarat Techapanurak Takayuki Okatani OODD 54 9 0 07 Jan 2021
Run-Time Monitoring of Machine Learning for Robotic Perception: A Survey of Emerging Trends Q. Rahman Peter Corke Feras Dayoub OOD 135 55 0 05 Jan 2021
Uncertainty-Wizard: Fast and User-Friendly Neural Network Uncertainty Quantification Michael Weiss Paolo Tonella UQCV 89 21 0 29 Dec 2020
Probabilistic electric load forecasting through Bayesian Mixture Density Networks A. Brusaferri Matteo Matteucci S. Spinelli Andrea Vitali 60 38 0 23 Dec 2020
Wasserstein Dropout Joachim Sicking Maram Akila Maximilian Pintz Tim Wirtz Asja Fischer Stefanie Wrobel BDL OOD UQCV 44 1 0 23 Dec 2020
On Calibration of Scene-Text Recognition Models Ron Slossberg Oron Anschel Amir Markovitz Ron Litman Aviad Aberdam Shahar Tsiper Shai Mazor Jon Wu R. Manmatha 61 13 0 23 Dec 2020
Algorithmic Recourse in the Wild: Understanding the Impact of Data and Model Shifts Kaivalya Rawal Ece Kamar Himabindu Lakkaraju 96 42 0 22 Dec 2020
SENTRY: Selective Entropy Optimization via Committee Consistency for Unsupervised Domain Adaptation Viraj Prabhu Shivam Khare Deeksha Kartik Judy Hoffman 114 135 0 21 Dec 2020
Post-hoc Uncertainty Calibration for Domain Drift Scenarios Christian Tomani Sebastian Gruber Muhammed Ebrar Erdem Daniel Cremers Florian Buettner UQCV 194 67 0 20 Dec 2020
Towards Trustworthy Predictions from Deep Neural Networks with Fast Adversarial Calibration Christian Tomani Florian Buettner UQCV AAML OOD 73 39 0 20 Dec 2020
Mitigating Bias in Calibration Error Estimation Rebecca Roelofs Nicholas Cain Jonathon Shlens Michael C. Mozer 100 95 0 15 Dec 2020
Uncertainty Estimation with Deep Learning for Rainfall-Runoff Modelling D. Klotz Frederik Kratzert M. Gauch A. Sampson Günter Klambauer Sepp Hochreiter G. Nearing BDL UQCV 63 111 0 15 Dec 2020
Masksembles for Uncertainty Estimation Nikita Durasov Timur M. Bagautdinov Pierre Baqué Pascal Fua OOD UQCV 76 83 0 15 Dec 2020
Detecting and Adapting to Irregular Distribution Shifts in Bayesian Online Learning Aodong Li Alex Boyd Padhraic Smyth Stephan Mandt 59 24 0 15 Dec 2020
Improving model calibration with accuracy versus uncertainty optimization R. Krishnan Omesh Tickoo UQCV 256 169 0 14 Dec 2020
WILDS: A Benchmark of in-the-Wild Distribution Shifts Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang ... A. Kundaje Emma Pierson Sergey Levine Chelsea Finn Percy Liang OOD 311 1,452 0 14 Dec 2020
Uncertainty-Aware Deep Calibrated Salient Object Detection Jing Zhang Yuchao Dai Xin Yu Mehrtash Harandi Nick Barnes Leonid Sigal UQCV EDL 61 6 0 10 Dec 2020
Semi-supervised novelty detection using ensembles with regularized disagreement A. Tifrea E. Stavarache Fanny Yang UQCV 87 6 0 10 Dec 2020
Know Your Limits: Uncertainty Estimation with ReLU Classifiers Fails at Reliable OOD Detection Dennis Ulmer Giovanni Cina OODD 141 33 0 09 Dec 2020
The Hidden Uncertainty in a Neural Networks Activations Janis Postels Hermann Blum Yannick Strümpler Cesar Cadena Roland Siegwart Luc Van Gool Federico Tombari UQCV 187 22 0 05 Dec 2020