Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,043 papers shown

Title
Robust Models are less Over-Confident Julia Grabinski Paul Gavrikov J. Keuper M. Keuper AAML 36 24 0 12 Oct 2022
What does a deep neural network confidently perceive? The effective dimension of high certainty class manifolds and their low confidence boundaries Stanislav Fort E. D. Cubuk Surya Ganguli S. Schoenholz 25 5 0 11 Oct 2022
Detect, Distill and Update: Learned DB Systems Facing Out of Distribution Data M. Kurmanji Peter Triantafillou OOD AAML 36 18 0 11 Oct 2022
Sampling-based inference for large linear models, with application to linearised Laplace Javier Antorán Shreyas Padhy Riccardo Barbano Eric T. Nalisnick David Janz José Miguel Hernández-Lobato BDL 27 17 0 10 Oct 2022
Revisiting adapters with adversarial training Sylvestre-Alvise Rebuffi Francesco Croce Sven Gowal AAML 36 16 0 10 Oct 2022
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis Yuxin Xiao Paul Pu Liang Umang Bhatt Willie Neiswanger Ruslan Salakhutdinov Louis-Philippe Morency 175 87 0 10 Oct 2022
State Advantage Weighting for Offline RL Jiafei Lyu Aicheng Gong Le Wan Zongqing Lu Xiu Li OffRL 36 9 0 09 Oct 2022
A Review of Uncertainty Calibration in Pretrained Object Detectors Denis Huseljic M. Herde Mehmet Muejde Bernhard Sick UQCV 16 0 0 06 Oct 2022
Uncertainty Estimation for Multi-view Data: The Power of Seeing the Whole Picture M. Jung He Zhao Joanna Dipnall Belinda Gabbe Lan Du UQCV EDL 67 12 0 06 Oct 2022
Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysis Benjamin Lambert Florence Forbes A. Tucholka Senan Doyle Harmonie Dehaene M. Dojat 34 81 0 05 Oct 2022
GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Models Chen Liang Wenguan Wang Jiaxu Miao Yi Yang VLM 46 117 0 05 Oct 2022
Meta-Ensemble Parameter Learning Zhengcong Fei Shuman Tian Junshi Huang Xiaoming Wei Xiaolin K. Wei OOD 44 2 0 05 Oct 2022
Out-of-Distribution Detection and Selective Generation for Conditional Language Models Jie Jessie Ren Jiaming Luo Yao-Min Zhao Kundan Krishna Mohammad Saleh Balaji Lakshminarayanan Peter J. Liu OODD 75 98 0 30 Sep 2022
Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel Sungyub Kim Si-hun Park Kyungsu Kim Eunho Yang BDL 32 4 0 30 Sep 2022
Variable-Based Calibration for Machine Learning Classifiers Mark Kelly Padhraic Smyth 27 4 0 30 Sep 2022
Raising the Bar on the Evaluation of Out-of-Distribution Detection Jishnu Mukhoti Tsung-Yu Lin Bor-Chun Chen Ashish Shah Philip Torr P. Dokania Ser-Nam Lim OODD 21 4 0 24 Sep 2022
Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning Boris Ivanovic James Harrison Marco Pavone AI4CE 36 27 0 23 Sep 2022
Evaluating Latent Space Robustness and Uncertainty of EEG-ML Models under Realistic Distribution Shifts Neeraj Wagh Jionghao Wei Samarth Rawal Brent M. Berry Y. Varatharajah OOD 24 10 0 22 Sep 2022
Probabilistic Dalek -- Emulator framework with probabilistic prediction for supernova tomography W. E. Kerzendorf Nutan Chen Jack O'Brien J. Buchner Patrick van der Smagt MedIm 20 0 0 20 Sep 2022
Two-stage Modeling for Prediction with Confidence Dangxing Chen OODD OOD 19 0 0 19 Sep 2022
RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection Yue Song N. Sebe Wei Wang OODD 64 54 0 18 Sep 2022
Deep Convolutional Architectures for Extrapolative Forecast in Time-dependent Flow Problems Pratyush Bhatt Y. Kumar A. Soulaïmani AI4TS AI4CE 19 5 0 18 Sep 2022
Linking Neural Collapse and L2 Normalization with Improved Out-of-Distribution Detection in Deep Neural Networks J. Haas William Yolland B. Rabus OODD 48 16 0 17 Sep 2022
Uncertainty Quantification of Collaborative Detection for Self-Driving Sanbao Su Yiming Li Sihong He Songyang Han Chen Feng Caiwen Ding Fei Miao 56 54 0 16 Sep 2022
Operationalizing Machine Learning: An Interview Study Shreya Shankar Rolando Garcia J. M. Hellerstein Aditya G. Parameswaran 71 51 0 16 Sep 2022
Vision-Based Uncertainty-Aware Motion Planning based on Probabilistic Semantic Segmentation Ralf Römer Armin Lederer Samuel Tesfazgi Sandra Hirche 29 2 0 14 Sep 2022
Towards Better Generalization with Flexible Representation of Multi-Module Graph Neural Networks Hyungeun Lee Kijung Yoon AI4CE 33 2 0 14 Sep 2022
Active Learning and Novel Model Calibration Measurements for Automated Visual Inspection in Manufacturing Jože M. Rožanec Luka Bizjak Elena Trajkova Patrik Zajec Jelle Keizer B. Fortuna Dunja Mladenić 26 11 0 12 Sep 2022
Calibrating Segmentation Networks with Margin-based Label Smoothing Balamurali Murugesan Bingyuan Liu Adrian Galdran Ismail Ben Ayed Jose Dolz UQCV 32 0 0 09 Sep 2022
SmOOD: Smoothness-based Out-of-Distribution Detection Approach for Surrogate Neural Networks in Aircraft Design Houssem Ben Braiek Ali Tfaily Foutse Khomh Thomas Reid Ciro Guida 22 0 0 07 Sep 2022
Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures? Lisa Wimmer Yusuf Sale Paul Hofman Bern Bischl Eyke Hüllermeier PER UD 42 65 0 07 Sep 2022
Calibrated Selective Classification Adam Fisch Tommi Jaakkola Regina Barzilay 34 17 0 25 Aug 2022
Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost Lu Yin Shiwei Liu Fang Meng Tianjin Huang Vlado Menkovski Mykola Pechenizkiy 25 13 0 23 Aug 2022
Generalised Co-Salient Object Detection Jiawei Liu Jing Zhang Ruikai Cui Kaihao Zhang Weihao Li Nick Barnes 33 3 0 20 Aug 2022
Region-Based Evidential Deep Learning to Quantify Uncertainty and Improve Robustness of Brain Tumor Segmentation Hao Li Yang Nan Javier Del Ser Guang Yang EDL OOD UQCV 24 39 0 11 Aug 2022
Multi-task Active Learning for Pre-trained Transformer-based Models Guy Rotman Roi Reichart 25 22 0 10 Aug 2022
Bayesian Pseudo Labels: Expectation Maximization for Robust and Efficient Semi-Supervised Segmentation Moucheng Xu Yukun Zhou Chen Jin M. Groot Daniel C. Alexander N. Oxtoby Yipeng Hu Joseph Jacob VLM OOD 19 12 0 08 Aug 2022
Improved post-hoc probability calibration for out-of-domain MRI segmentation Cheng Ouyang Shuo Wang Chong Chen Zeju Li Wenjia Bai Bernhard Kainz Daniel Rueckert UQCV MedIm 21 4 0 04 Aug 2022
Exploration with Model Uncertainty at Extreme Scale in Real-Time Bidding Jan Hartman Davorin Kopic 24 2 0 03 Aug 2022
XOOD: Extreme Value Based Out-Of-Distribution Detection For Image Classification Frej Berglind Haron Temam S. Mukhopadhyay K. Das Md Saiful Islam Sajol K. Sricharan Kumar Kallurupalli OODD 21 0 0 01 Aug 2022
Adaptive Temperature Scaling for Robust Calibration of Deep Neural Networks Sérgio A. Balanya Juan Maroñas Daniel Ramos OOD 43 14 0 31 Jul 2022
Towards Clear Expectations for Uncertainty Estimation Victor Bouvier Simona Maggio A. Abraham L. Dreyfus-Schmidt UQCV 28 1 0 27 Jul 2022
Domain Adaptation under Open Set Label Shift Saurabh Garg Sivaraman Balakrishnan Zachary Chase Lipton OOD VLM 27 41 0 26 Jul 2022
Improving Predictive Performance and Calibration by Weight Fusion in Semantic Segmentation Timo Sämann A. Hammam Andrei Bursuc Christoph Stiller H. Groß FedML 38 1 0 22 Jul 2022
JAWS: Auditing Predictive Uncertainty Under Covariate Shift Drew Prinster Anqi Liu Suchi Saria 22 13 0 21 Jul 2022
Latent Discriminant deterministic Uncertainty Gianni Franchi Xuanlong Yu Andrei Bursuc Emanuel Aldea Séverine Dubuisson David Filliat UQCV 31 18 0 20 Jul 2022
Assaying Out-Of-Distribution Generalization in Transfer Learning F. Wenzel Andrea Dittadi Peter V. Gehler Carl-Johann Simon-Gabriel Max Horn ... Chris Russell Thomas Brox Bernt Schiele Bernhard Schölkopf Francesco Locatello OOD OODD AAML 64 71 0 19 Jul 2022
IDPS Signature Classification with a Reject Option and the Incorporation of Expert Knowledge Hidetoshi Kawaguchi Yuichi Nakatani S. Okada 30 3 0 19 Jul 2022
Calibrated ensembles can mitigate accuracy tradeoffs under distribution shift Ananya Kumar Tengyu Ma Percy Liang Aditi Raghunathan UQCV OODD OOD 49 38 0 18 Jul 2022
Benchmarking Machine Learning Robustness in Covid-19 Genome Sequence Classification Sarwan Ali Bikram Sahoo Alexander Zelikovskiy Pin-Yu Chen Murray Patterson OOD AAML 32 19 0 18 Jul 2022