v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
Excess risk analysis for epistemic uncertainty with application to variational inference Futoshi Futami Tomoharu Iwata N. Ueda Issei Sato Masashi Sugiyama UQCV 112 1 0 02 Jun 2022
Feature Space Particle Inference for Neural Network Ensembles Shingo Yashima Teppei Suzuki Kohta Ishikawa Ikuro Sato Rei Kawakami BDL 66 11 0 02 Jun 2022
Masked Bayesian Neural Networks : Computation and Optimality Insung Kong Dongyoon Yang Jongjin Lee Ilsang Ohn Yongdai Kim TPM 53 1 0 02 Jun 2022
FiLM-Ensemble: Probabilistic Deep Learning via Feature-wise Linear Modulation Mehmet Özgür Türkoglu Alexander Becker H. Gündüz Mina Rezaei Bernd Bischl Rodrigo Caye Daudt Stefano Dáronco Jan Dirk Wegner Konrad Schindler FedML UQCV 126 28 0 31 May 2022
CHALLENGER: Training with Attribution Maps Christian Tomani Daniel Cremers 27 1 0 30 May 2022
Teaching Models to Express Their Uncertainty in Words Stephanie C. Lin Jacob Hilton Owain Evans OOD 131 425 0 28 May 2022
Failure Detection in Medical Image Classification: A Reality Check and Benchmarking Testbed Mélanie Bernhardt Fabio De Sousa Ribeiro Ben Glocker 56 10 0 27 May 2022
Why So Pessimistic? Estimating Uncertainties for Offline RL through Ensembles, and Why Their Independence Matters Seyed Kamyar Seyed Ghasemipour S. Gu Ofir Nachum OffRL 90 72 0 27 May 2022
What is Your Metric Telling You? Evaluating Classifier Calibration under Context-Specific Definitions of Reliability John Kirchenbauer Jacob Oaks Eric Heim UQCV 106 4 0 23 May 2022
PyRelationAL: a python library for active learning research and development P. Scherer Thomas Gaudelet Alison Pouplin Alice Del Vecchio S. SurajM Oliver Bolton Jyothish Soman J. Taylor-King Lindsay Edwards KELM 49 0 0 23 May 2022
Active Source Free Domain Adaptation Fan Wang Zhongyi Han Zhiyan Zhang Yilong Yin 200 12 0 22 May 2022
Transformer-based out-of-distribution detection for clinically safe segmentation M. Graham Petru-Daniel Tudosiu P. Wright W. H. Pinaya J. U-King-im ... H. Jäger D. Werring P. Nachev Sebastien Ourselin M. Jorge Cardoso MedIm 86 21 0 21 May 2022
Test-time Batch Normalization Tao Yang Shenglong Zhou Yuwang Wang Yan Lu Nanning Zheng OOD 69 11 0 20 May 2022
On the Calibration of Probabilistic Classifier Sets Thomas Mortier Viktor Bengs Eyke Hüllermeier Stijn Luca Willem Waegeman UQCV 78 7 0 20 May 2022
The Unreasonable Effectiveness of Deep Evidential Regression N. Meinert J. Gawlikowski Alexander Lavin UQCV EDL 277 37 0 20 May 2022
Posterior Refinement Improves Sample Efficiency in Bayesian Neural Networks Agustinus Kristiadi Runa Eschenhagen Philipp Hennig BDL 92 13 0 20 May 2022
Diverse Weight Averaging for Out-of-Distribution Generalization Alexandre Ramé Matthieu Kirchmeyer Thibaud Rahier A. Rakotomamonjy Patrick Gallinari Matthieu Cord OOD 258 138 0 19 May 2022
Simple Regularisation for Uncertainty-Aware Knowledge Distillation Martin Ferianc Miguel R. D. Rodrigues UQCV 80 1 0 19 May 2022
Marginal and Joint Cross-Entropies & Predictives for Online Bayesian Inference, Active Learning, and Active Sampling Andreas Kirsch Jannik Kossen Y. Gal UQCV BDL 97 3 0 18 May 2022
Dark solitons in Bose-Einstein condensates: a dataset for many-body physics research A. R. Fritsch Shangjie Guo Sophia M. Koh I. Spielman Justyna P. Zwolak 36 3 0 17 May 2022
Evaluating Uncertainty Calibration for Open-Set Recognition Zongyao Lyu Nolan B. Gutierrez William J. Beksi UQCV 59 0 0 15 May 2022
Training Uncertainty-Aware Classifiers with Conformalized Deep Learning Bat-Sheva Einbinder Yaniv Romano Matteo Sesia Yanfei Zhou UQCV 146 54 0 12 May 2022
Affective Medical Estimation and Decision Making via Visualized Learning and Deep Learning M. Eslami Solale Tabarestani Ehsan Adeli G. Elwyn T. Elze Mengyu Wang Nazlee Zebardast Nassir Navab M. Adjouadi 42 0 0 09 May 2022
A Survey on Uncertainty Toolkits for Deep Learning Maximilian Pintz Joachim Sicking Maximilian Poretschkin Maram Akila ELM 76 6 0 02 May 2022
Simple Techniques Work Surprisingly Well for Neural Network Test Prioritization and Active Learning (Replicability Study) Michael Weiss Paolo Tonella AAML 84 52 0 02 May 2022
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness J. Liu Shreyas Padhy Jie Jessie Ren Zi Lin Yeming Wen Ghassen Jerfel Zachary Nado Jasper Snoek Dustin Tran Balaji Lakshminarayanan UQCV BDL 233 51 0 01 May 2022
Deep Ensemble as a Gaussian Process Approximate Posterior Zhijie Deng Feng Zhou Jianfei Chen Guoqiang Wu Jun Zhu UQCV 41 5 0 30 Apr 2022
Tailored Uncertainty Estimation for Deep Learning Systems Joachim Sicking Maram Akila Jan David Schneider Fabian Hüger Peter Schlicht Tim Wirtz Stefan Wrobel UQCV 74 2 0 29 Apr 2022
A Deeper Look into Aleatoric and Epistemic Uncertainty Disentanglement Matias Valdenegro-Toro Daniel Saromo UD PER BDL UQCV 69 86 0 20 Apr 2022
Towards Fine-grained Causal Reasoning and QA Linyi Yang Zhen Wang Yuxiang Wu Jie Yang Yue Zhang 88 16 0 15 Apr 2022
A high-resolution canopy height model of the Earth Nico Lang W. Jetz Konrad Schindler Jan Dirk Wegner 65 287 0 13 Apr 2022
A Comparative Analysis of Decision-Level Fusion for Multimodal Driver Behaviour Understanding Alina Roitberg Kunyu Peng Zdravko Marinov C. Seibold David Schneider Rainer Stiefelhagen 99 19 0 10 Apr 2022
Is my Driver Observation Model Overconfident? Input-guided Calibration Networks for Reliable and Interpretable Confidence Estimates Alina Roitberg Kunyu Peng David Schneider Kailun Yang Marios Koulakis Manuel Martínez Rainer Stiefelhagen UQCV 68 9 0 10 Apr 2022
A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration R. Hebbalaguppe Jatin Prakash Neelabh Madan Chetan Arora UQCV 117 45 0 25 Mar 2022
Learning Confidence for Transformer-based Neural Machine Translation Yu Lu Jiali Zeng Jiajun Zhang Shuangzhi Wu Mu Li 89 9 0 22 Mar 2022
Active learning in open experimental environments: selecting the right information channel(s) based on predictability in deep kernel learning M. Ziatdinov Yongtao Liu Sergei V. Kalinin 46 10 0 18 Mar 2022
Self-Distribution Distillation: Efficient Uncertainty Estimation Yassir Fathullah Mark Gales UQCV 41 11 0 15 Mar 2022
Self-Normalized Density Map (SNDM) for Counting Microbiological Objects K. Graczyk J. Pawlowski Sylwia Majchrowska Tomasz Golan 56 9 0 15 Mar 2022
Igeood: An Information Geometry Approach to Out-of-Distribution Detection Eduardo Dadalto Camara Gomes F. Alberge Pierre Duhamel Pablo Piantanida OODD 178 29 0 15 Mar 2022
Uncertainty Estimation for Language Reward Models Adam Gleave G. Irving UQLM 84 34 0 14 Mar 2022
The worst of both worlds: A comparative analysis of errors in learning from data in psychology and machine learning Jessica Hullman Sayash Kapoor Priyanka Nanayakkara Andrew Gelman Arvind Narayanan 147 39 0 12 Mar 2022
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time Mitchell Wortsman Gabriel Ilharco S. Gadre Rebecca Roelofs Raphael Gontijo-Lopes ... Hongseok Namkoong Ali Farhadi Y. Carmon Simon Kornblith Ludwig Schmidt MoMe 201 1,013 1 10 Mar 2022
Sparsity-Inducing Categorical Prior Improves Robustness of the Information Bottleneck Anirban Samaddar Sandeep Madireddy Prasanna Balaprakash Tapabrata Maiti Gustavo de los Campos Ian Fischer 55 1 0 04 Mar 2022
MUAD: Multiple Uncertainties for Autonomous Driving, a benchmark for multiple uncertainty types and tasks Gianni Franchi Xuanlong Yu Andrei Bursuc Ángel Tena Rémi Kazmierczak Séverine Dubuisson Emanuel Aldea David Filliat UQCV 92 28 0 02 Mar 2022
Understanding the Challenges When 3D Semantic Segmentation Faces Class Imbalanced and OOD Data Yancheng Pan Fan Xie Huijing Zhao CVBM 67 8 0 01 Mar 2022
An Empirical Study on Explanations in Out-of-Domain Settings G. Chrysostomou Nikolaos Aletras LRM 69 28 0 28 Feb 2022
Uncertainty Estimation for Computed Tomography with a Linearised Deep Image Prior Javier Antorán Riccardo Barbano Johannes Leuschner José Miguel Hernández-Lobato Bangti Jin UQCV 112 10 0 28 Feb 2022
Pessimistic Bootstrapping for Uncertainty-Driven Offline Reinforcement Learning Chenjia Bai Lingxiao Wang Zhuoran Yang Zhihong Deng Animesh Garg Peng Liu Zhaoran Wang OffRL 106 140 0 23 Feb 2022
Confident Neural Network Regression with Bootstrapped Deep Ensembles Laurens Sluijterman Eric Cator Tom Heskes BDL UQCV FedML 52 2 0 22 Feb 2022
UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography Francisca Vasconcelos Bobby He Nalini Singh Yee Whye Teh BDL OOD UQCV 76 13 0 22 Feb 2022