v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
Robust Semantic Segmentation with Superpixel-Mix Gianni Franchi Nacim Belkhir Mai Lan Ha Yufei Hu Andrei Bursuc V. Blanz Angela Yao UQCV 87 23 0 02 Aug 2021
Sequential Multivariate Change Detection with Calibrated and Memoryless False Detection Rates Oliver Cobb A. V. Looveren Janis Klaise 80 6 0 02 Aug 2021
Soft Calibration Objectives for Neural Networks A. Karandikar Nicholas Cain Dustin Tran Balaji Lakshminarayanan Jonathon Shlens Michael C. Mozer Becca Roelofs UQCV 108 91 0 30 Jul 2021
When Deep Learners Change Their Mind: Learning Dynamics for Active Learning Javad Zolfaghari Bengar Bogdan Raducanu Joost van de Weijer 67 10 0 30 Jul 2021
Are Bayesian neural networks intrinsically good at out-of-distribution detection? Christian Henning Francesco DÁngelo Benjamin Grewe UQCV BDL 68 10 0 26 Jul 2021
An Uncertainty-Aware Deep Learning Framework for Defect Detection in Casting Products Maryam Habibpour Hassan Gharoun AmirReza Tajally Afshar Shamsi Jokandan Hamzeh Asgharnezhad Abbas Khosravi S. Nahavandi UQCV 68 16 0 24 Jul 2021
Estimating Predictive Uncertainty Under Program Data Distribution Shift Yufei Li Simin Chen Wei Yang UQCV 68 5 0 23 Jul 2021
AUGCO: Augmentation Consistency-guided Self-training for Source-free Domain Adaptive Semantic Segmentation Viraj Prabhu Shivam Khare Deeksha Kartik Judy Hoffman TTA 88 21 0 21 Jul 2021
Iterative Distillation for Better Uncertainty Estimates in Multitask Emotion Recognition Didan Deng Liang Wu Bertram E. Shi 63 34 0 21 Jul 2021
High Frequency EEG Artifact Detection with Uncertainty via Early Exit Paradigm Lorena Qendro Alexander Campbell Pietro Lio Cecilia Mascolo 131 6 0 21 Jul 2021
Uncertainty Estimation and Out-of-Distribution Detection for Counterfactual Explanations: Pitfalls and Solutions Eoin Delaney Derek Greene Mark T. Keane 79 26 0 20 Jul 2021
Epistemic Neural Networks Ian Osband Zheng Wen M. Asghari Vikranth Dwaracherla M. Ibrahimi Xiyuan Lu Benjamin Van Roy UQCV BDL 134 109 0 19 Jul 2021
On the Importance of Regularisation & Auxiliary Information in OOD Detection John Mitros Brian Mac Namee 52 2 0 15 Jul 2021
Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks A. Malinin Neil Band Ganshin Alexander German Chesnokov ... Roginskiy Denis Mariya Shmatova Panos Tigas Boris Yangel UQCV OOD 124 132 0 15 Jul 2021
RBUE: A ReLU-Based Uncertainty Estimation Method of Deep Neural Networks Yufeng Xia Jun Zhang Zhiqiang Gong Tingsong Jiang Wen Yao UQCV 58 1 0 15 Jul 2021
Uncertainty-Aware Reliable Text Classification Yibo Hu Latifur Khan EDL UQCV 74 33 0 15 Jul 2021
Federated Mixture of Experts M. Reisser Christos Louizos E. Gavves Max Welling FedML 71 26 0 14 Jul 2021
What classifiers know what they don't? Mohamed Ishmael Belghazi David Lopez-Paz 86 7 0 13 Jul 2021
Project Achoo: A Practical Model and Application for COVID-19 Detection from Recordings of Breath, Voice, and Cough Alexander Ponomarchuk I. Burenko Elian Malkin Ivan Nazarov V. Kokh Manvel Avetisian L. Zhukov 87 40 0 12 Jul 2021
Multi-headed Neural Ensemble Search Ashwin Raaghav Narayanan Arber Zela Tonmoy Saikia Thomas Brox Frank Hutter UQCV 46 4 0 09 Jul 2021
Differentially private training of neural networks with Langevin dynamics for calibrated predictive uncertainty Moritz Knolle Alexander Ziller Dmitrii Usynin R. Braren Marcus R. Makowski Daniel Rueckert Georgios Kaissis UQCV 56 2 0 09 Jul 2021
Measuring and Improving Model-Moderator Collaboration using Uncertainty Estimation Ian D Kivlichan Zi Lin J. Liu Lucy Vasserman 58 20 0 09 Jul 2021
Towards Robust Active Feature Acquisition Yang Li Siyuan Shan Qin Liu Junier B. Oliva TPM 54 4 0 09 Jul 2021
A Survey of Uncertainty in Deep Neural Networks J. Gawlikowski Cedrique Rovile Njieutcheu Tassi Mohsin Ali Jongseo Lee Matthias Humt ... R. Roscher Muhammad Shahzad Wen Yang R. Bamler Xiaoxiang Zhu BDL UQCV OOD 242 1,177 0 07 Jul 2021
Predicting with Confidence on Unseen Distributions Devin Guillory Vaishaal Shankar Sayna Ebrahimi Trevor Darrell Ludwig Schmidt UQCV OOD 122 123 0 07 Jul 2021
Test for non-negligible adverse shifts Vathy M. Kamulete 77 4 0 07 Jul 2021
Detecting Concept Drift With Neural Network Model Uncertainty Lucas Baier Tim Schlör Jakob Schöffer Niklas Kühl 68 28 0 05 Jul 2021
Mitigating Uncertainty of Classifier for Unsupervised Domain Adaptation Shanu Kumar V. Kurmi Praphul Singh Vinay P. Namboodiri 30 4 0 01 Jul 2021
On the Practicality of Deterministic Epistemic Uncertainty Janis Postels Mattia Segu Tao Sun Luca Sieber Luc Van Gool Feng Yu Federico Tombari UQCV 97 61 0 01 Jul 2021
Unsupervised Model Drift Estimation with Batch Normalization Statistics for Dataset Shift Detection and Model Selection Won-Jo Lee Seokhyun Byun Jooeun Kim Minje Park Kirill Chechil AI4TS 40 2 0 01 Jul 2021
Detecting Errors and Estimating Accuracy on Unlabeled Data with Self-training Ensembles Jiefeng Chen Frederick Liu Besim Avci Xi Wu Yingyu Liang S. Jha 116 64 0 29 Jun 2021
Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis Linyi Yang Jiazheng Li Padraig Cunningham Yue Zhang Barry Smyth Ruihai Dong 89 48 0 29 Jun 2021
Laplace Redux -- Effortless Bayesian Deep Learning Erik A. Daxberger Agustinus Kristiadi Alexander Immer Runa Eschenhagen Matthias Bauer Philipp Hennig BDL UQCV 254 315 0 28 Jun 2021
Ensembling Shift Detectors: an Extensive Empirical Evaluation Simona Maggio L. Dreyfus-Schmidt AI4TS 104 3 0 28 Jun 2021
Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity Shiwei Liu Tianlong Chen Zahra Atashgahi Xiaohan Chen Ghada Sokar Elena Mocanu Mykola Pechenizkiy Zhangyang Wang Decebal Constantin Mocanu OOD 125 53 0 28 Jun 2021
Scene Uncertainty and the Wellington Posterior of Deterministic Image Classifiers Stephanie Tsuei Aditya Golatkar Stefano Soatto UQCV 46 0 0 25 Jun 2021
FF-NSL: Feed-Forward Neural-Symbolic Learner Daniel Cunnington Mark Law A. Russo Jorge Lobo NAI 92 15 0 24 Jun 2021
Estimating the Robustness of Classification Models by the Structure of the Learned Feature-Space Kalun Ho Franz-Josef Pfreundt J. Keuper Margret Keuper OOD UQCV 50 3 0 23 Jun 2021
Towards Consistent Predictive Confidence through Fitted Ensembles Navid Kardan Ankit Sharma Kenneth O. Stanley FedML OODD 60 8 0 22 Jun 2021
Dangers of Bayesian Model Averaging under Covariate Shift Pavel Izmailov Patrick K. Nicholson Sanae Lotfi A. Wilson OOD UQCV BDL 151 46 0 22 Jun 2021
Repulsive Deep Ensembles are Bayesian Francesco DÁngelo Vincent Fortuin UQCV BDL 129 101 0 22 Jun 2021
On Stein Variational Neural Network Ensembles Francesco DÁngelo Vincent Fortuin F. Wenzel UQCV BDL 92 27 0 20 Jun 2021
Being a Bit Frequentist Improves Bayesian Neural Networks Agustinus Kristiadi Matthias Hein Philipp Hennig BDL UQCV 95 16 0 18 Jun 2021
Gradual Domain Adaptation via Self-Training of Auxiliary Models Yabin Zhang Bin Deng Kui Jia Lei Zhang CLL 94 10 0 18 Jun 2021
Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error Ondrej Bohdal Yongxin Yang Timothy M. Hospedales UQCV OOD 108 23 0 17 Jun 2021
On Deep Neural Network Calibration by Regularization and its Impact on Refinement Aditya Singh Alessandro Bay B. Sengupta Andrea Mirabile AAML 88 3 0 17 Jun 2021
Behavioral Priors and Dynamics Models: Improving Performance and Domain Transfer in Offline RL Catherine Cang Aravind Rajeswaran Pieter Abbeel Michael Laskin OffRL 70 30 0 16 Jun 2021
Test Sample Accuracy Scales with Training Sample Density in Neural Networks Xu Ji Razvan Pascanu Devon Hjelm Balaji Lakshminarayanan Andrea Vedaldi 70 8 0 15 Jun 2021
Revisiting the Calibration of Modern Neural Networks Matthias Minderer Josip Djolonga Rob Romijnders F. Hubis Xiaohua Zhai N. Houlsby Dustin Tran Mario Lucic UQCV 112 369 0 15 Jun 2021
Disentangling the Roles of Curation, Data-Augmentation and the Prior in the Cold Posterior Effect Lorenzo Noci Kevin Roth Gregor Bachmann Sebastian Nowozin Thomas Hofmann CML 84 26 0 11 Jun 2021