v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
Accurate and Reliable Methods for 5G UAV Jamming Identification With Calibrated Uncertainty Hamed Farkhari Joseanne Viana P. Sebastião L. M. Campos Luís Bernardo R. Dinis Sarang Kahvazadeh UQCV 34 2 0 05 Nov 2022
Quantifying Model Uncertainty for Semantic Segmentation using Operators in the RKHS Rishabh Singh José C. Príncipe UQCV 68 3 0 03 Nov 2022
Towards Better Out-of-Distribution Generalization of Neural Algorithmic Reasoning Tasks Sadegh Mahdavi Kevin Swersky Thomas Kipf Milad Hashemi Christos Thrampoulidis Renjie Liao LRM OOD NAI 104 26 0 01 Nov 2022
Behavioral Intention Prediction in Driving Scenes: A Survey Jianwu Fang Fan Wang Jianru Xue Tat-Seng Chua 171 50 0 01 Nov 2022
A Close Look into the Calibration of Pre-trained Language Models Yangyi Chen Lifan Yuan Ganqu Cui Zhiyuan Liu Heng Ji 153 52 0 31 Oct 2022
Unsafe's Betrayal: Abusing Unsafe Rust in Binary Reverse Engineering via Machine Learning Sangdon Park Xiang Cheng Taesoo Kim 87 1 0 31 Oct 2022
Federated Averaging Langevin Dynamics: Toward a unified theory and new algorithms Vincent Plassier Alain Durmus Eric Moulines FedML 111 7 0 31 Oct 2022
A Graph Is More Than Its Nodes: Towards Structured Uncertainty-Aware Learning on Graphs Hans Hao-Hsun Hsu Yuesong Shen Daniel Cremers 80 7 0 27 Oct 2022
Revisiting Softmax for Uncertainty Approximation in Text Classification Andreas Nugaard Holm Dustin Wright Isabelle Augenstein BDL UQCV 51 10 0 25 Oct 2022
MEET: A Monte Carlo Exploration-Exploitation Trade-off for Buffer Sampling Julius Ott Lorenzo Servadei Jose A. Arjona-Medina E. Rinaldi Gianfranco Mauro Daniela Sanchez Lopera Michael Stephan Thomas Stadelmayer Avik Santra Robert Wille 62 0 0 24 Oct 2022
Bridging Machine Learning and Sciences: Opportunities and Challenges Taoli Cheng UQCV OOD AI4CE 61 2 0 24 Oct 2022
GFlowOut: Dropout with Generative Flow Networks Dianbo Liu Moksh Jain Bonaventure F. P. Dossou Qianli Shen Salem Lahlou ... Dinghuai Zhang N. Hassen Xu Ji Kenji Kawaguchi Yoshua Bengio UQCV BDL OOD 109 22 0 24 Oct 2022
Uncertainty Estimates of Predictions via a General Bias-Variance Decomposition Sebastian G. Gruber Florian Buettner PER UQCV UD 297 13 0 21 Oct 2022
Exploring Predictive Uncertainty and Calibration in NLP: A Study on the Impact of Method & Data Scarcity Dennis Ulmer J. Frellsen Christian Hardmeier 264 23 0 20 Oct 2022
Uncertainty estimation for out-of-distribution detection in computational histopathology Lea Goetz OOD 74 0 0 18 Oct 2022
Disentangling the Predictive Variance of Deep Ensembles through the Neural Tangent Kernel Seijin Kobayashi Pau Vilimelis Aceituno J. Oswald UQCV 87 3 0 18 Oct 2022
Packed-Ensembles for Efficient Uncertainty Estimation Olivier Laurent Adrien Lafage Enzo Tartaglione Geoffrey Daniel Jean-Marc Martinez Andrei Bursuc Gianni Franchi OODD 145 32 0 17 Oct 2022
Distributional Reward Estimation for Effective Multi-Agent Deep Reinforcement Learning Jifeng Hu Yanchao Sun Hechang Chen Sili Huang Haiyin Piao Yi-Ju Chang Lichao Sun 64 5 0 14 Oct 2022
Deep Combinatorial Aggregation Yuesong Shen Daniel Cremers OOD UQCV 52 4 0 12 Oct 2022
Quantifying Uncertainty with Probabilistic Machine Learning Modeling in Wireless Sensing Amit Kachroo Sai Prashanth Chinnapalli 145 0 0 12 Oct 2022
Efficient Bayesian Updates for Deep Learning via Laplace Approximations Denis Huseljic M. Herde Lukas Rauch Paul Hahn Zhixin Huang D. Kottke S. Vogt Bernhard Sick BDL 67 0 0 12 Oct 2022
Robust Models are less Over-Confident Julia Grabinski Paul Gavrikov J. Keuper Margret Keuper AAML 80 25 0 12 Oct 2022
What does a deep neural network confidently perceive? The effective dimension of high certainty class manifolds and their low confidence boundaries Stanislav Fort E. D. Cubuk Surya Ganguli S. Schoenholz 57 5 0 11 Oct 2022
Detect, Distill and Update: Learned DB Systems Facing Out of Distribution Data M. Kurmanji Peter Triantafillou OOD AAML 88 18 0 11 Oct 2022
Sampling-based inference for large linear models, with application to linearised Laplace Javier Antorán Shreyas Padhy Riccardo Barbano Eric T. Nalisnick David Janz José Miguel Hernández-Lobato BDL 53 17 0 10 Oct 2022
Revisiting adapters with adversarial training Sylvestre-Alvise Rebuffi Francesco Croce Sven Gowal AAML 60 17 0 10 Oct 2022
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis Yuxin Xiao Paul Pu Liang Umang Bhatt Willie Neiswanger Ruslan Salakhutdinov Louis-Philippe Morency 253 98 0 10 Oct 2022
State Advantage Weighting for Offline RL Jiafei Lyu Aicheng Gong Le Wan Zongqing Lu Xiu Li OffRL 87 9 0 09 Oct 2022
A Review of Uncertainty Calibration in Pretrained Object Detectors Denis Huseljic M. Herde Mehmet Muejde Bernhard Sick UQCV 31 0 0 06 Oct 2022
Uncertainty Estimation for Multi-view Data: The Power of Seeing the Whole Picture M. Jung He Zhao Joanna Dipnall Lan Du Lan Du UQCV EDL 96 12 0 06 Oct 2022
Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysis Benjamin Lambert Florence Forbes A. Tucholka Senan Doyle Harmonie Dehaene M. Dojat 110 90 0 05 Oct 2022
GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Models Chen Liang Wenguan Wang Jiaxu Miao Yi Yang VLM 106 122 0 05 Oct 2022
Meta-Ensemble Parameter Learning Zhengcong Fei Shuman Tian Junshi Huang Xiaoming Wei Xiaolin K. Wei OOD 114 2 0 05 Oct 2022
Out-of-Distribution Detection and Selective Generation for Conditional Language Models Jie Jessie Ren Jiaming Luo Yao-Min Zhao Kundan Krishna Mohammad Saleh Balaji Lakshminarayanan Peter J. Liu OODD 129 114 0 30 Sep 2022
Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel Sungyub Kim Si-hun Park Kyungsu Kim Eunho Yang BDL 84 5 0 30 Sep 2022
Variable-Based Calibration for Machine Learning Classifiers Mark Kelly Padhraic Smyth 55 4 0 30 Sep 2022
Raising the Bar on the Evaluation of Out-of-Distribution Detection Jishnu Mukhoti Tsung-Yu Lin Bor-Chun Chen Ashish Shah Philip Torr P. Dokania Ser-Nam Lim OODD 52 4 0 24 Sep 2022
Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning Boris Ivanovic James Harrison Marco Pavone AI4CE 101 28 0 23 Sep 2022
Evaluating Latent Space Robustness and Uncertainty of EEG-ML Models under Realistic Distribution Shifts Neeraj Wagh Jionghao Wei Samarth Rawal Brent M. Berry Y. Varatharajah OOD 93 12 0 22 Sep 2022
Probabilistic Dalek -- Emulator framework with probabilistic prediction for supernova tomography W. E. Kerzendorf Nutan Chen Jack O'Brien J. Buchner Patrick van der Smagt MedIm 29 0 0 20 Sep 2022
Two-stage Modeling for Prediction with Confidence Dangxing Chen OODD OOD 43 1 0 19 Sep 2022
RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection Yue Song N. Sebe Wei Wang OODD 133 58 0 18 Sep 2022
Deep Convolutional Architectures for Extrapolative Forecast in Time-dependent Flow Problems Pratyush Bhatt Y. Kumar A. Soulaïmani AI4TS AI4CE 41 6 0 18 Sep 2022
Linking Neural Collapse and L2 Normalization with Improved Out-of-Distribution Detection in Deep Neural Networks J. Haas William Yolland B. Rabus OODD 103 20 0 17 Sep 2022
Uncertainty Quantification of Collaborative Detection for Self-Driving Sanbao Su Yiming Li Sihong He Songyang Han Chen Feng Caiwen Ding Fei Miao 174 57 0 16 Sep 2022
Operationalizing Machine Learning: An Interview Study Shreya Shankar Rolando Garcia J. M. Hellerstein Aditya G. Parameswaran 116 54 0 16 Sep 2022
Vision-Based Uncertainty-Aware Motion Planning based on Probabilistic Semantic Segmentation Ralf Römer Armin Lederer Samuel Tesfazgi Sandra Hirche 45 2 0 14 Sep 2022
Towards Better Generalization with Flexible Representation of Multi-Module Graph Neural Networks Hyungeun Lee Kijung Yoon AI4CE 69 2 0 14 Sep 2022
Active Learning and Novel Model Calibration Measurements for Automated Visual Inspection in Manufacturing Jože M. Rožanec Luka Bizjak Elena Trajkova Patrik Zajec Jelle Keizer B. Fortuna Dunja Mladenić 54 11 0 12 Sep 2022
Calibrating Segmentation Networks with Margin-based Label Smoothing Balamurali Murugesan Bingyuan Liu Adrian Galdran Ismail Ben Ayed Jose Dolz UQCV 49 0 0 09 Sep 2022