Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,042 papers shown

Title
Pessimistic Value Iteration for Multi-Task Data Sharing in Offline Reinforcement Learning Chenjia Bai Lingxiao Wang Jianye Hao Zhuoran Yang Bin Zhao Zhen Wang Xuelong Li OffRL 37 9 0 30 Apr 2024
Out-of-distribution Detection in Medical Image Analysis: A survey Zesheng Hong Yubiao Yue Yubin Chen Lele Cong Huanjie Lin ... Jialong Xu Xiaoqi Yang Hechang Chen Zhenzhang Li Sihong Xie OOD 45 5 0 28 Apr 2024
The Over-Certainty Phenomenon in Modern UDA Algorithms Fin Amin Jung-Eun Kim 40 0 0 24 Apr 2024
FedSI: Federated Subnetwork Inference for Efficient Uncertainty Quantification Hui Chen Hengyu Liu Zhangkai Wu Xuhui Fan LongBing Cao FedML 33 2 0 24 Apr 2024
QUTE: Quantifying Uncertainty in TinyML models with Early-exit-assisted ensembles N. Ghanathe Steve Wilton UQCV 42 0 0 19 Apr 2024
Variational Bayesian Last Layers James Harrison John Willes Jasper Snoek BDL UQCV 63 24 0 17 Apr 2024
Awareness of uncertainty in classification using a multivariate model and multi-views Alexey Kornaev E. Kornaeva Oleg Ivanov Ilya S. Pershin Danis Alukaev UQCV EDL 44 0 0 16 Apr 2024
Post-Hoc Reversal: Are We Selecting Models Prematurely? Rishabh Ranjan Saurabh Garg Mrigank Raman Carlos Guestrin Zachary Chase Lipton 42 0 0 11 Apr 2024
Active Exploration in Bayesian Model-based Reinforcement Learning for Robot Manipulation Carlos Plou Ana C. Murillo Ruben Martinez-Cantin OffRL 40 0 0 02 Apr 2024
On Uncertainty Quantification for Near-Bayes Optimal Algorithms Ziyu Wang Chris Holmes UQCV 44 2 0 28 Mar 2024
"We Have No Idea How Models will Behave in Production until Production": How Engineers Operationalize Machine Learning Shreya Shankar Rolando Garcia J. M. Hellerstein Aditya G. Parameswaran 27 10 0 25 Mar 2024
Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding Lingdong Kong Xiang Xu Jun Cen Wenwei Zhang Liang Pan Kai-xiang Chen Ziwei Liu 53 5 0 25 Mar 2024
ZoDi: Zero-Shot Domain Adaptation with Diffusion-Based Image Transfer Hiroki Azuma Yusuke Matsui Atsuto Maki VLM 39 1 0 20 Mar 2024
Diversity-Aware Agnostic Ensemble of Sharpness Minimizers Anh-Vu Bui Vy Vo Tung Pham Dinh Q. Phung Trung Le FedML UQCV 37 1 0 19 Mar 2024
Posterior Uncertainty Quantification in Neural Networks using Data Augmentation Luhuan Wu Sinead Williamson UQCV 43 6 0 18 Mar 2024
Explainability through uncertainty: Trustworthy decision-making with neural networks Arthur Thuy Dries F. Benoit 46 13 0 15 Mar 2024
Uncertainty Quantification with Deep Ensembles for 6D Object Pose Estimation Kira Wursthorn Markus Hillemann Markus Ulrich 30 8 0 12 Mar 2024
Enhancing Transfer Learning with Flexible Nonparametric Posterior Sampling Hyungi Lee G. Nam Edwin Fong Juho Lee BDL 32 5 0 12 Mar 2024
Calibrating Large Language Models Using Their Generations Only Dennis Ulmer Martin Gubri Hwaran Lee Sangdoo Yun Seong Joon Oh UQLM 432 18 1 09 Mar 2024
Density-Regression: Efficient and Distance-Aware Deep Regressor for Uncertainty Estimation under Distribution Shifts H. Bui Anqi Liu OOD BDL UQCV 49 4 0 07 Mar 2024
Don't Blame the Data, Blame the Model: Understanding Noise and Bias When Learning from Subjective Annotations Abhishek Anand Negar Mokhberian Prathyusha Naresh Kumar Anweasha Saha Zihao He Ashwin Rao Fred Morstatter Kristina Lerman 39 6 0 06 Mar 2024
Revisiting Confidence Estimation: Towards Reliable Failure Prediction Fei Zhu Xu-Yao Zhang Zhen Cheng Cheng-Lin Liu UQCV 52 10 0 05 Mar 2024
Bayesian Uncertainty Estimation by Hamiltonian Monte Carlo: Applications to Cardiac MRI Segmentation Yidong Zhao João Tourais Iain Pierce Christian Nitsche T. Treibel Sebastian Weingartner Artur M. Schweidtmann Qian Tao BDL UQCV 43 5 0 04 Mar 2024
A prediction rigidity formalism for low-cost uncertainties in trained neural networks Filippo Bigi Sanggyu Chong Michele Ceriotti Federico Grasselli 52 5 0 04 Mar 2024
Selection, Ensemble, and Adaptation: Advancing Multi-Source-Free Domain Adaptation via Architecture Zoo Jiangbo Pei Ruizhe Li Aidong Men Yang Liu Xiahai Zhuang Qingchao Chen 48 0 0 03 Mar 2024
Benchmarking Uncertainty Disentanglement: Specialized Uncertainties for Specialized Tasks Bálint Mucsányi Michael Kirchhof Seong Joon Oh UQCV BDL OODD 436 20 1 29 Feb 2024
Securing Reliability: A Brief Overview on Enhancing In-Context Learning for Foundation Models Yunpeng Huang Yaonan Gu Jingwei Xu Zhihong Zhu Zhaorun Chen Xiaoxing Ma 43 3 0 27 Feb 2024
Confidence-Aware Multi-Field Model Calibration Yuang Zhao Chuhan Wu Qinglin Jia Hong Zhu Jia Yan Libin Zong Linxuan Zhang Zhenhua Dong Muyu Zhang 38 1 0 27 Feb 2024
Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Data David S. W. Williams Daniele De Martini Matthew Gadd Paul Newman UQCV 29 5 0 27 Feb 2024
Variational Learning is Effective for Large Deep Networks Yuesong Shen Nico Daheim Bai Cong Peter Nickl Gian Maria Marconi ... Rio Yokota Iryna Gurevych Daniel Cremers Mohammad Emtiyaz Khan Thomas Möllenhoff 43 22 0 27 Feb 2024
Pretrained Visual Uncertainties Michael Kirchhof Mark Collier Seong Joon Oh Enkelejda Kasneci UQCV 410 8 1 26 Feb 2024
Watch Your Head: Assembling Projection Heads to Save the Reliability of Federated Models Jinqian Chen Jihua Zhu Qinghai Zheng Zhongyu Li Zhiqiang Tian FedML 34 3 0 26 Feb 2024
Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Data YongKyung Oh Dongyoung Lim Sungil Kim AI4TS 43 13 0 22 Feb 2024
The METRIC-framework for assessing data quality for trustworthy AI in medicine: a systematic review Daniel Schwabe Katinka Becker Martin Seyferth Andreas Klass Tobias Schäffter 36 20 0 21 Feb 2024
Discriminant Distance-Aware Representation on Deterministic Uncertainty Quantification Methods Jiaxin Zhang Kamalika Das Kumar Sricharan UQCV 35 0 0 20 Feb 2024
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles Oleksandr Balabanov Hampus Linander UQCV 36 15 0 19 Feb 2024
HEAL: Brain-inspired Hyperdimensional Efficient Active Learning Yang Ni Zhuowen Zou Wenjun Huang Hanning Chen William Youngwoo Chung Samuel Cho R. Krishnan Pietro Mercati Mohsen Imani 42 3 0 17 Feb 2024
Efficient Multi-task Uncertainties for Joint Semantic Segmentation and Monocular Depth Estimation S. Landgraf Markus Hillemann Theodor Kapler Markus Ulrich UQCV 34 8 0 16 Feb 2024
UR2M: Uncertainty and Resource-Aware Event Detection on Microcontrollers Hong Jia Young D. Kwon Dong Ma Nhat Pham Lorena Qendro Tam N. Vu Cecilia Mascolo 27 2 0 14 Feb 2024
Variational Continual Test-Time Adaptation Fan Lyu Kaile Du Yuyang Li Hanyu Zhao Zhang Zhang Guangcan Liu Liang Wang TTA BDL 29 6 0 13 Feb 2024
An Empirical Study Into What Matters for Calibrating Vision-Language Models Weijie Tu Weijian Deng Dylan Campbell Stephen Gould Tom Gedeon VLM 35 7 0 12 Feb 2024
A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP) Weijie Tu Weijian Deng Tom Gedeon UQCV VLM 20 33 0 12 Feb 2024
Predictive Churn with the Set of Good Models J. Watson-Daniels Flavio du Pin Calmon Alexander DÁmour Carol Xuan Long David C. Parkes Berk Ustun 83 7 0 12 Feb 2024
Assessing Uncertainty Estimation Methods for 3D Image Segmentation under Distribution Shifts Masoumeh Javanbakhat Md Tasnimul Hasan Cristoph Lippert UQCV OOD 26 1 0 10 Feb 2024
SAE: Single Architecture Ensemble Neural Networks Martin Ferianc Hongxiang Fan Miguel R. D. Rodrigues UQCV 24 0 0 09 Feb 2024
Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions A. Testoni Raquel Fernández 22 10 0 09 Feb 2024
Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Models Anthony Sicilia Hyunwoo J. Kim Khyathi Raghavi Chandu Malihe Alikhani Jack Hessel 20 1 0 05 Feb 2024
How Good is a Single Basin? Kai Lion Lorenzo Noci Thomas Hofmann Gregor Bachmann UQCV 28 2 0 05 Feb 2024
A Distributionally Robust Optimisation Approach to Fair Credit Scoring Pablo Casas Christophe Mues Huan Yu 14 0 0 02 Feb 2024
Non-Exchangeable Conformal Language Generation with Nearest Neighbors Dennis Ulmer Chrysoula Zerva André F. T. Martins 38 11 0 01 Feb 2024