Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,042 papers shown

Title
Label Augmentation for Neural Networks Robustness Fatemeh Amerehi Patrick Healy AAML 39 1 0 04 Aug 2024
Harnessing Uncertainty-aware Bounding Boxes for Unsupervised 3D Object Detection A. Benfenati P. Causin Hang Yu Zhedong Zheng 3DPC 48 2 0 01 Aug 2024
Uncertainty-Aware Deep Neural Representations for Visual Analysis of Vector Field Data Atul Kumar S. Garg Soumya Dutta 53 0 0 23 Jul 2024
Achieving Well-Informed Decision-Making in Drug Discovery: A Comprehensive Calibration Study using Neural Network-Based Structure-Activity Models Hannah Rosa Friesacher Ola Engkvist Lewis H. Mervin Yves Moreau Adam Arany 39 0 0 19 Jul 2024
Robust Calibration of Large Vision-Language Adapters Balamurali Murugesan Julio Silva-Rodríguez Ismail Ben Ayed Jose Dolz OODD VLM 32 6 0 18 Jul 2024
Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance Haiquan Lu Xiaotian Liu Yefan Zhou Qunli Li Kurt Keutzer Michael W. Mahoney Yujun Yan Huanrui Yang Yaoqing Yang 45 1 0 17 Jul 2024
Calibrated Diverse Ensemble Entropy Minimization for Robust Test-Time Adaptation in Prostate Cancer Detection Mahdi Gilany Mohamed Harmanani P. Wilson Minh-Son To A. Jamzad Fahimeh Fooladgar Brian Wodlinger Purang Abolmaesumi Parvin Mousavi OOD 33 0 0 17 Jul 2024
Instance-wise Uncertainty for Class Imbalance in Semantic Segmentation Luís Almeida Ines Dutra Francesco Renna UQCV 43 0 0 17 Jul 2024
On the Calibration of Epistemic Uncertainty: Principles, Paradoxes and Conflictual Loss Mohammed Fellaji Frédéric Pennerath Brieuc Conan-Guez Miguel Couceiro UQCV 51 1 0 16 Jul 2024
Proper losses regret at least 1/2-order Han Bao Asuka Takatsu 18 1 0 15 Jul 2024
Real-Time Anomaly Detection and Reactive Planning with Large Language Models Rohan Sinha Amine Elhafsi Christopher Agia Matthew Foutter Edward Schmerling Marco Pavone OffRL LRM 45 27 0 11 Jul 2024
How to Leverage Predictive Uncertainty Estimates for Reducing Catastrophic Forgetting in Online Continual Learning Giuseppe Serra Ben Werner Florian Buettner 45 2 0 10 Jul 2024
Are Data Augmentation Methods in Named Entity Recognition Applicable for Uncertainty Estimation? Wataru Hashimoto Hidetaka Kamigaito Taro Watanabe 34 1 0 02 Jul 2024
Overcoming Common Flaws in the Evaluation of Selective Classification Systems Jeremias Traub Till J. Bungert Carsten T. Lüth Michael Baumgartner Klaus H. Maier-Hein Lena Maier-Hein Paul F. Jaeger 44 3 0 01 Jul 2024
Evaluation of autonomous systems under data distribution shifts Daniel Sikar Artur Garcez 19 0 0 28 Jun 2024
Unified Uncertainties: Combining Input, Data and Model Uncertainty into a Single Formulation Matias Valdenegro-Toro Ivo Pascal de Jong Marco Zullich UD 43 2 0 26 Jun 2024
Improving robustness to corruptions with multiplicative weight perturbations Trung Trinh Markus Heinonen Luigi Acerbi Samuel Kaski 44 0 0 24 Jun 2024
Hardware-Aware Neural Dropout Search for Reliable Uncertainty Prediction on FPGA Zehuan Zhang Hongxiang Fan Hao Mark Chen Lukasz Dudziak Wayne Luk BDL 42 0 0 23 Jun 2024
AI-based Anomaly Detection for Clinical-Grade Histopathological Diagnostics Jonas Dippel Niklas Prenißl Julius Hense Philipp Liznerski Tobias Winterhoff ... David Horst Maximilian Alber Lukas Ruff Klaus-Robert Müller Frederick Klauschen 38 4 0 21 Jun 2024
Enhancing Dropout-based Bayesian Neural Networks with Multi-Exit on FPGA Hao Mark Chen Liam Castelli Martin Ferianc Hongyu Zhou Shuanglong Liu Wayne Luk Hongxiang Fan 28 0 0 20 Jun 2024
On the Utility of Domain-Adjacent Fine-Tuned Model Ensembles for Few-shot Problems Md. Ibrahim Ibne Alam Parikshit Ram Soham Dan Horst Samulowitz Koushik Kar 38 0 0 19 Jun 2024
Calibrating Where It Matters: Constrained Temperature Scaling Stephen McKenna Jacob Carse 28 0 0 17 Jun 2024
What Does Softmax Probability Tell Us about Classifiers Ranking Across Diverse Test Conditions? Weijie Tu Weijian Deng Liang Zheng Tom Gedeon 42 0 0 14 Jun 2024
DAISY: Data Adaptive Self-Supervised Early Exit for Speech Representation Models T. Lin Hung-yi Lee Hao Tang 53 1 0 08 Jun 2024
Measuring Stochastic Data Complexity with Boltzmann Influence Functions Nathan Ng Roger C. Grosse Marzyeh Ghassemi 40 0 0 04 Jun 2024
Language Models Do Hard Arithmetic Tasks Easily and Hardly Do Easy Arithmetic Tasks Andrew Gambardella Yusuke Iwasawa Yutaka Matsuo LRM 35 6 0 04 Jun 2024
Evidentially Calibrated Source-Free Time-Series Domain Adaptation with Temporal Imputation Mohamed Ragab Peiliang Gong Emadeldeen Eldele Wenyu Zhang Min-man Wu Chuan-Sheng Foo Daoqiang Zhang Xiaoli Li Zhenghua Chen TTA AI4TS 42 2 0 04 Jun 2024
Orthogonal Causal Calibration Justin Whitehouse Christopher Jung Vasilis Syrgkanis Bryan Wilder Zhiwei Steven Wu CML 114 1 0 04 Jun 2024
A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learning Fahimeh Fakour Ali Mosleh Ramin Ramezani UQCV UD PER 51 2 0 01 Jun 2024
LACIE: Listener-Aware Finetuning for Confidence Calibration in Large Language Models Elias Stengel-Eskin Peter Hase Mohit Bansal 37 4 0 31 May 2024
On Calibration of Object Detectors: Pitfalls, Evaluation and Baselines Selim Kuzucu Kemal Oksuz Jonathan Sadeghi P. Dokania 46 4 0 30 May 2024
Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similarities Alexander Nikitin Jannik Kossen Yarin Gal Pekka Marttinen UQCV 55 25 0 30 May 2024
Accurate and Reliable Predictions with Mutual-Transport Ensemble Han Liu Peng Cui Bingning Wang Jun Zhu Xiaolin Hu UQCV 34 0 0 30 May 2024
Federated Continual Learning Goes Online: Leveraging Uncertainty for Modality-Agnostic Class-Incremental Learning Giuseppe Serra Florian Buettner CLL FedML 59 0 0 29 May 2024
Language Generation with Strictly Proper Scoring Rules Chenze Shao Fandong Meng Yijin Liu Jie Zhou 68 5 0 29 May 2024
Synergy and Diversity in CLIP: Enhancing Performance Through Adaptive Backbone Ensembling Cristian Rodriguez-Opazo Ehsan Abbasnejad Damien Teney Edison Marrese-Taylor Hamed Damirchi Anton Van Den Hengel VLM 45 1 0 27 May 2024
FedCal: Achieving Local and Global Calibration in Federated Learning via Aggregated Parameterized Scaler Hongyi Peng Han Yu Xiaoli Tang Xiaoxiao Li 47 4 0 24 May 2024
Credal Wrapper of Model Averaging for Uncertainty Estimation in Classification Kaizheng Wang Fabio Cuzzolin Keivan K1 Shariatmadar David Moens Hans Hallez UQCV BDL 88 0 0 23 May 2024
LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate A. Fuller Daniel G. Kyrollos Yousef Yassin James R. Green 54 2 0 22 May 2024
Visual Analysis of Prediction Uncertainty in Neural Networks for Deep Image Synthesis Soumya Dutta Faheem Nizar Ahmad Amaan Ayan Acharya AAML 48 1 0 22 May 2024
System Safety Monitoring of Learned Components Using Temporal Metric Forecasting Sepehr Sharifi Andrea Stocco Lionel C. Briand AI4TS 50 1 0 21 May 2024
Geometric Transformation Uncertainty for Improving 3D Fetal Brain Pose Prediction from Freehand 2D Ultrasound Videos Jayroop Ramesh Nicola K. Dinsdale INTERGROWTH-21 Consortium P. Yeung Ana I. L. Namburete MedIm 41 3 0 21 May 2024
Uncertainty Quantification Metrics for Deep Regression Simon Kristoffersson Lind Ziliang Xiong Per-Erik Forssén Volker Kruger UQCV 34 3 0 07 May 2024
Information-driven Affordance Discovery for Efficient Robotic Manipulation Pietro Mazzaglia Taco Cohen Daniel Dijkman 40 2 0 06 May 2024
The Role of Predictive Uncertainty and Diversity in Embodied AI and Robot Learning Ransalu Senanayake 32 8 0 06 May 2024
A View on Out-of-Distribution Identification from a Statistical Testing Theory Perspective Alberto Caron Chris Hicks V. Mavroudis OODD 36 2 0 05 May 2024
Source-Free Domain Adaptation Guided by Vision and Vision-Language Pre-Training Wenyu Zhang Li Shen Chuan-Sheng Foo VLM TTA 58 4 0 05 May 2024
Quantifying Distribution Shifts and Uncertainties for Enhanced Model Robustness in Machine Learning Applications Vegard Flovik OOD 34 1 0 03 May 2024
Accelerating Convergence in Bayesian Few-Shot Classification Tianjun Ke Haoqun Cao Feng Zhou 50 0 0 02 May 2024
Error-Driven Uncertainty Aware Training Pedro Mendes Paolo Romano David Garlan UQCV 26 0 0 02 May 2024