v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learning Fahimeh Fakour Ali Mosleh Ramin Ramezani UQCV UD PER 106 3 0 01 Jun 2024
LACIE: Listener-Aware Finetuning for Confidence Calibration in Large Language Models Elias Stengel-Eskin Peter Hase Mohit Bansal 100 7 0 31 May 2024
On Calibration of Object Detectors: Pitfalls, Evaluation and Baselines Selim Kuzucu Kemal Oksuz Jonathan Sadeghi P. Dokania 89 5 0 30 May 2024
Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similarities Alexander Nikitin Jannik Kossen Yarin Gal Pekka Marttinen UQCV 136 45 0 30 May 2024
Accurate and Reliable Predictions with Mutual-Transport Ensemble Han Liu Peng Cui Bingning Wang Jun Zhu Xiaolin Hu UQCV 58 0 0 30 May 2024
Federated Continual Learning Goes Online: Leveraging Uncertainty for Modality-Agnostic Class-Incremental Learning Giuseppe Serra Florian Buettner CLL FedML 98 0 0 29 May 2024
Language Generation with Strictly Proper Scoring Rules Chenze Shao Fandong Meng Yijin Liu Jie Zhou 101 6 0 29 May 2024
Synergy and Diversity in CLIP: Enhancing Performance Through Adaptive Backbone Ensembling Cristian Rodriguez-Opazo Ehsan Abbasnejad Damien Teney Edison Marrese-Taylor Hamed Damirchi Anton Van Den Hengel VLM 136 1 0 27 May 2024
FedCal: Achieving Local and Global Calibration in Federated Learning via Aggregated Parameterized Scaler Hongyi Peng Han Yu Xiaoli Tang Xiaoxiao Li 109 5 0 24 May 2024
Credal Wrapper of Model Averaging for Uncertainty Estimation in Classification Kaizheng Wang Fabio Cuzzolin Keivan K1 Shariatmadar David Moens Hans Hallez UQCV BDL 126 6 0 23 May 2024
Trajectory Volatility for Out-of-Distribution Detection in Mathematical Reasoning Yiming Wang Pei Zhang Baosong Yang Derek F. Wong Zhuosheng Zhang Rui Wang OODD 33 1 0 22 May 2024
LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate A. Fuller Daniel G. Kyrollos Yousef Yassin James R. Green 109 3 0 22 May 2024
Visual Analysis of Prediction Uncertainty in Neural Networks for Deep Image Synthesis Soumya Dutta Faheem Nizar Ahmad Amaan Ayan Acharya AAML 89 1 0 22 May 2024
System Safety Monitoring of Learned Components Using Temporal Metric Forecasting Sepehr Sharifi Andrea Stocco Lionel C. Briand AI4TS 106 1 0 21 May 2024
Geometric Transformation Uncertainty for Improving 3D Fetal Brain Pose Prediction from Freehand 2D Ultrasound Videos Jayroop Ramesh Nicola K. Dinsdale INTERGROWTH-21 Consortium P. Yeung Ana I. L. Namburete MedIm 81 4 0 21 May 2024
Uncertainty Quantification Metrics for Deep Regression Simon Kristoffersson Lind Ziliang Xiong Per-Erik Forssén Volker Kruger UQCV 63 6 0 07 May 2024
Information-driven Affordance Discovery for Efficient Robotic Manipulation Pietro Mazzaglia Taco Cohen Daniel Dijkman 125 2 0 06 May 2024
The Role of Predictive Uncertainty and Diversity in Embodied AI and Robot Learning Ransalu Senanayake 96 9 0 06 May 2024
A View on Out-of-Distribution Identification from a Statistical Testing Theory Perspective Alberto Caron Chris Hicks V. Mavroudis OODD 142 2 0 05 May 2024
Source-Free Domain Adaptation Guided by Vision and Vision-Language Pre-Training Wenyu Zhang Li Shen Chuan-Sheng Foo VLM TTA 107 5 0 05 May 2024
Quantifying Distribution Shifts and Uncertainties for Enhanced Model Robustness in Machine Learning Applications Vegard Flovik OOD 83 1 0 03 May 2024
Accelerating Convergence in Bayesian Few-Shot Classification Tianjun Ke Haoqun Cao Feng Zhou 101 0 0 02 May 2024
Error-Driven Uncertainty Aware Training Pedro Mendes Paolo Romano David Garlan UQCV 93 2 0 02 May 2024
Pessimistic Value Iteration for Multi-Task Data Sharing in Offline Reinforcement Learning Chenjia Bai Lingxiao Wang Jianye Hao Zhuoran Yang Bin Zhao Zhen Wang Xuelong Li OffRL 84 9 0 30 Apr 2024
Out-of-distribution Detection in Medical Image Analysis: A survey Zesheng Hong Yubiao Yue Yubin Chen Lele Cong Huanjie Lin ... Jialong Xu Xiaoqi Yang Hechang Chen Zhenzhang Li Sihong Xie OOD 75 7 0 28 Apr 2024
The Over-Certainty Phenomenon in Modern UDA Algorithms Fin Amin Jung-Eun Kim 60 0 0 24 Apr 2024
FedSI: Federated Subnetwork Inference for Efficient Uncertainty Quantification Hui Chen Hengyu Liu Zhangkai Wu Xuhui Fan LongBing Cao FedML 84 2 0 24 Apr 2024
QUTE: Quantifying Uncertainty in TinyML models with Early-exit-assisted ensembles N. Ghanathe Steve Wilton UQCV 71 0 0 19 Apr 2024
Variational Bayesian Last Layers James Harrison John Willes Jasper Snoek BDL UQCV 146 34 0 17 Apr 2024
Awareness of uncertainty in classification using a multivariate model and multi-views Alexey Kornaev E. Kornaeva Oleg Ivanov Ilya Pershin Danis Alukaev UQCV EDL 63 1 0 16 Apr 2024
Post-Hoc Reversal: Are We Selecting Models Prematurely? Rishabh Ranjan Saurabh Garg Mrigank Raman Carlos Guestrin Zachary Chase Lipton 72 0 0 11 Apr 2024
Active Exploration in Bayesian Model-based Reinforcement Learning for Robot Manipulation Carlos Plou Ana C. Murillo Ruben Martinez-Cantin OffRL 90 0 0 02 Apr 2024
On Uncertainty Quantification for Near-Bayes Optimal Algorithms Ziyu Wang Chris Holmes UQCV 105 3 0 28 Mar 2024
"We Have No Idea How Models will Behave in Production until Production": How Engineers Operationalize Machine Learning Shreya Shankar Rolando Garcia J. M. Hellerstein Aditya G. Parameswaran 83 12 0 25 Mar 2024
Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding Lingdong Kong Xiang Xu Jun Cen Wenwei Zhang Liang Pan Kai-xiang Chen Ziwei Liu 123 7 0 25 Mar 2024
ZoDi: Zero-Shot Domain Adaptation with Diffusion-Based Image Transfer Hiroki Azuma Yusuke Matsui Atsuto Maki VLM 72 1 0 20 Mar 2024
Diversity-Aware Agnostic Ensemble of Sharpness Minimizers Anh-Vu Bui Vy Vo Tung Pham Dinh Q. Phung Trung Le FedML UQCV 70 1 0 19 Mar 2024
Posterior Uncertainty Quantification in Neural Networks using Data Augmentation Luhuan Wu Sinead Williamson UQCV 89 7 0 18 Mar 2024
Explainability through uncertainty: Trustworthy decision-making with neural networks Arthur Thuy Dries F. Benoit 98 15 0 15 Mar 2024
Uncertainty Quantification with Deep Ensembles for 6D Object Pose Estimation Kira Wursthorn Markus Hillemann Markus Ulrich 61 8 0 12 Mar 2024
Enhancing Transfer Learning with Flexible Nonparametric Posterior Sampling Hyungi Lee G. Nam Edwin Fong Juho Lee BDL 75 6 0 12 Mar 2024
Calibrating Large Language Models Using Their Generations Only Dennis Ulmer Martin Gubri Hwaran Lee Sangdoo Yun Seong Joon Oh UQLM 501 28 1 09 Mar 2024
Density-Regression: Efficient and Distance-Aware Deep Regressor for Uncertainty Estimation under Distribution Shifts H. Bui Anqi Liu OOD BDL UQCV 190 4 0 07 Mar 2024
Don't Blame the Data, Blame the Model: Understanding Noise and Bias When Learning from Subjective Annotations Abhishek Anand Negar Mokhberian Prathyusha Naresh Kumar Anweasha Saha Zihao He Ashwin Rao Fred Morstatter Kristina Lerman 79 7 0 06 Mar 2024
Revisiting Confidence Estimation: Towards Reliable Failure Prediction Fei Zhu Xu-Yao Zhang Zhen Cheng Cheng-Lin Liu UQCV 103 12 0 05 Mar 2024
Bayesian Uncertainty Estimation by Hamiltonian Monte Carlo: Applications to Cardiac MRI Segmentation Yidong Zhao João Tourais Iain Pierce Christian Nitsche T. Treibel Sebastian Weingartner Artur M. Schweidtmann Qian Tao BDL UQCV 83 5 0 04 Mar 2024
A prediction rigidity formalism for low-cost uncertainties in trained neural networks Filippo Bigi Sanggyu Chong Michele Ceriotti Federico Grasselli 75 6 0 04 Mar 2024
Selection, Ensemble, and Adaptation: Advancing Multi-Source-Free Domain Adaptation via Architecture Zoo Jiangbo Pei Ruizhe Li Aidong Men Yang Liu Xiahai Zhuang Qingchao Chen 89 0 0 03 Mar 2024
Benchmarking Uncertainty Disentanglement: Specialized Uncertainties for Specialized Tasks Bálint Mucsányi Michael Kirchhof Seong Joon Oh UQCV BDL OODD 582 32 1 29 Feb 2024
Securing Reliability: A Brief Overview on Enhancing In-Context Learning for Foundation Models Yunpeng Huang Yaonan Gu Jingwei Xu Zhihong Zhu Zhaorun Chen Xiaoxing Ma 64 3 0 27 Feb 2024