v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
Exploring Covariate and Concept Shift for Detection and Calibration of Out-of-Distribution Data Junjiao Tian Yen-Change Hsu Yilin Shen Hongxia Jin Z. Kira OODD 74 6 0 28 Oct 2021
A Geometric Perspective towards Neural Calibration via Sensitivity Decomposition Junjiao Tian Dylan Yung Yen-Chang Hsu Z. Kira 91 23 0 27 Oct 2021
What Do We Mean by Generalization in Federated Learning? Honglin Yuan Warren Morningstar Lin Ning K. Singhal OOD FedML 123 76 0 27 Oct 2021
Diversity Matters When Learning From Ensembles G. Nam Jongmin Yoon Yoonho Lee Juho Lee UQCV FedML VLM 93 36 0 27 Oct 2021
Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification Maximilian Stadler Bertrand Charpentier Simon Geisler Daniel Zügner Stephan Günnemann UQCV BDL 120 89 0 26 Oct 2021
Diversity and Generalization in Neural Network Ensembles Luis A. Ortega Rafael Cabañas A. Masegosa FedML UQCV 96 45 0 26 Oct 2021
AutoDEUQ: Automated Deep Ensemble with Uncertainty Quantification Romain Egele R. Maulik Krishnan Raghavan Bethany Lusch Isabelle M Guyon Prasanna Balaprakash UQCV OOD BDL 134 49 0 26 Oct 2021
Alignment Attention by Matching Key and Query Distributions Shujian Zhang Xinjie Fan Huangjie Zheng Korawat Tanwisuth Mingyuan Zhou OOD 122 10 0 25 Oct 2021
Perceptual Consistency in Video Segmentation Yizhe Zhang Shubhankar Borse Hong Cai Ying Wang N. Bi Xiaoyun Jiang Fatih Porikli VOS 47 14 0 24 Oct 2021
Combining Different V1 Brain Model Variants to Improve Robustness to Image Corruptions in CNNs A. Baidya Joel Dapello J. DiCarlo Tiago Marques AAML 62 6 0 20 Oct 2021
Natural Attribute-based Shift Detection Jeonghoon Park Jimin Hong Radhika Dua Daehoon Gwak Yixuan Li Jaegul Choo Edward Choi OOD 79 3 0 18 Oct 2021
Centroid Approximation for Bootstrap: Improving Particle Quality at Inference Mao Ye Qiang Liu 47 1 0 17 Oct 2021
Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction Sara Elkerdawy Mostafa Elhoushi Hong Zhang Nilanjan Ray CVBM 88 41 0 15 Oct 2021
Dropout Prediction Uncertainty Estimation Using Neuron Activation Strength Haichao Yu Zhe Chen Dong Lin G. Shamir Jie Han UQCV 79 0 0 13 Oct 2021
Dense Uncertainty Estimation Jing Zhang Yuchao Dai Mochu Xiang Deng-Ping Fan Peyman Moghadam Mingyi He Christian J. Walder Kaihao Zhang Mehrtash Harandi Nick Barnes UQCV BDL 133 11 0 13 Oct 2021
Meta Learning Low Rank Covariance Factors for Energy-Based Deterministic Uncertainty Jeffrey Willette Haebeom Lee Juho Lee Sung Ju Hwang OODD OOD 94 2 0 12 Oct 2021
On out-of-distribution detection with Bayesian neural networks Francesco DÁngelo Christian Henning BDL UQCV 94 6 0 12 Oct 2021
Revisiting Design Choices in Offline Model-Based Reinforcement Learning Cong Lu Philip J. Ball Jack Parker-Holder Michael A. Osborne Stephen J. Roberts OffRL 95 57 0 08 Oct 2021
Sparse MoEs meet Efficient Ensembles J. Allingham F. Wenzel Zelda E. Mariet Basil Mustafa J. Puigcerver ... Balaji Lakshminarayanan Jasper Snoek Dustin Tran Carlos Riquelme Ruiz Rodolphe Jenatton MoE 80 21 0 07 Oct 2021
Improving Confidence Estimation on Out-of-Domain Data for End-to-End Speech Recognition Qiujia Li Yu Zhang David Qiu Yanzhang He Liangliang Cao P. Woodland 77 11 0 07 Oct 2021
Reliable Probability Intervals For Classification Using Inductive Venn Predictors Based on Distance Learning Dimitrios Boursinos X. Koutsoukos 31 1 0 07 Oct 2021
Assurance Monitoring of Learning Enabled Cyber-Physical Systems Using Inductive Conformal Prediction based on Distance Learning Dimitrios Boursinos X. Koutsoukos 97 11 0 07 Oct 2021
Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimation Dennis Ulmer Christian Hardmeier J. Frellsen BDL UQCV UD EDL PER 150 55 0 06 Oct 2021
Deep Classifiers with Label Noise Modeling and Distance Awareness Vincent Fortuin Mark Collier F. Wenzel J. Allingham J. Liu Dustin Tran Balaji Lakshminarayanan Jesse Berent Rodolphe Jenatton E. Kokiopoulou UQCV 78 11 0 06 Oct 2021
Post-hoc Models for Performance Estimation of Machine Learning Inference Xuechen Zhang Samet Oymak Jiasi Chen UQCV 54 5 0 06 Oct 2021
$Δ$ -UQ: Accurate Uncertainty Quantification via Anchor Marginalization Rushil Anirudh Jayaraman J. Thiagarajan 63 1 0 05 Oct 2021
Dropout Q-Functions for Doubly Efficient Reinforcement Learning Takuya Hiraoka Takahisa Imagawa Taisei Hashimoto Takashi Onishi Yoshimasa Tsuruoka 90 113 0 05 Oct 2021
Synergizing between Self-Training and Adversarial Learning for Domain Adaptive Object Detection Muhammad Akhtar Munir M. H. Khan M. Sarfraz Mohsen Ali ObjD 70 53 0 01 Oct 2021
On the Importance of Gradients for Detecting Distributional Shifts in the Wild Rui Huang Andrew Geng Yixuan Li 302 355 0 01 Oct 2021
Offline Reinforcement Learning with Reverse Model-based Imagination Jianhao Wang Wenzhe Li Haozhe Jiang Guangxiang Zhu Siyuan Li Chongjie Zhang OffRL 198 62 0 01 Oct 2021
Out-of-Distribution Detection for Medical Applications: Guidelines for Practical Evaluation Karina Zadorozhny P. Thoral Paul Elbers Giovanni Cina OODD OOD 86 15 0 30 Sep 2021
Word-level confidence estimation for RNN transducers Mingqiu Wang H. Soltau Laurent El Shafey Izhak Shafran UQCV 64 5 0 28 Sep 2021
Unsolved Problems in ML Safety Dan Hendrycks Nicholas Carlini John Schulman Jacob Steinhardt 285 294 0 28 Sep 2021
A Step Towards Efficient Evaluation of Complex Perception Tasks in Simulation Jonathan Sadeghi Blaine Rogers James Gunn Thomas Saunders Sina Samangooei P. Dokania John Redford 73 8 0 28 Sep 2021
Training on Test Data with Bayesian Adaptation for Covariate Shift Aurick Zhou Sergey Levine OOD TTA 112 13 0 27 Sep 2021
A Physics inspired Functional Operator for Model Uncertainty Quantification in the RKHS Rishabh Singh José C. Príncipe 45 4 0 22 Sep 2021
Can We Leverage Predictive Uncertainty to Detect Dataset Shift and Adversarial Examples in Android Malware Detection? Deqiang Li Tian Qiu Shuo Chen Qianmu Li Shouhuai Xu AAML 119 13 0 20 Sep 2021
CompilerGym: Robust, Performant Compiler Optimization Environments for AI Research Chris Cummins Bram Wasti Jiadong Guo Brandon Cui Jason Ansel ... Jia-Wei Liu O. Teytaud Benoit Steiner Yuandong Tian Hugh Leather 76 76 0 17 Sep 2021
Reliable Neural Networks for Regression Uncertainty Estimation Tony Tohme Kevin Vanslette K. Youcef-Toumi UQCV BDL 85 15 0 16 Sep 2021
Deploying clinical machine learning? Consider the following... Charles Lu Kenglun Chang Praveer Singh S. Pomerantz S. Doyle Sujay S Kakarmath Christopher P. Bridge Jayashree Kalpathy-Cramer 123 4 0 14 Sep 2021
Robust Contrastive Active Learning with Feature-guided Query Strategies R. Krishnan Nilesh A. Ahuja Alok Sinha Mahesh Subedar Omesh Tickoo Ravi Iyer 60 1 0 13 Sep 2021
Mitigating Sampling Bias and Improving Robustness in Active Learning R. Krishnan Alok Sinha Nilesh A. Ahuja Mahesh Subedar Omesh Tickoo R. Iyer 74 9 0 13 Sep 2021
On the Impact of Spurious Correlation for Out-of-distribution Detection Yifei Ming Hang Yin Yixuan Li OODD 198 75 0 12 Sep 2021
A framework for benchmarking uncertainty in deep regression F. Schmähling Jörg Martin Clemens Elster UQCV 60 8 0 10 Sep 2021
Detecting and Mitigating Test-time Failure Risks via Model-agnostic Uncertainty Learning Preethi Lahoti Krishna P. Gummadi Gerhard Weikum 56 3 0 09 Sep 2021
Uncertainty Measures in Neural Belief Tracking and the Effects on Dialogue Policy Performance Carel van Niekerk A. Malinin Christian Geishauser Michael Heck Hsien-chin Lin Nurul Lubis Shutong Feng Milica Gavsić 105 9 0 09 Sep 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 219 741 0 04 Sep 2021
SHIFT15M: Fashion-specific dataset for set-to-set matching with several distribution shifts Masanari Kimura Takuma Nakamura Yuki Saito OOD 94 3 0 30 Aug 2021
Uncertainty-Aware Model Adaptation for Unsupervised Cross-Domain Object Detection Minjie Cai Minyi Luo Xionghu Zhong Hao Chen OOD 56 6 0 28 Aug 2021
Leveraging Uncertainty for Improved Static Malware Detection Under Extreme False Positive Constraints A. Nguyen Edward Raff Charles K. Nicholas James Holt 108 22 0 09 Aug 2021