Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,042 papers shown

Title
Test-Time Alignment via Hypothesis Reweighting Yoonho Lee Jonathan Williams Henrik Marklund Archit Sharma E. Mitchell Anikait Singh Chelsea Finn 96 3 0 11 Dec 2024
Detecting Discrepancies Between AI-Generated and Natural Images Using Uncertainty Jun Nie Yonggang Zhang Tongliang Liu Y. Cheung Bo Han Xinmei Tian UQCV 95 1 0 08 Dec 2024
Detecting Fake News on Social Media: A Novel Reliability Aware Machine-Crowd Hybrid Intelligence-Based Method Yidong Chai Kangwei Shi Jiaheng Xie Chunli Liu Yuanchun Jiang Yezheng Liu 71 0 0 07 Dec 2024
Enhancing Zero-shot Chain of Thought Prompting via Uncertainty-Guided Strategy Selection Shanu Kumar Saish Mendke Karody Lubna Abdul Rahman Santosh Kurasa Parag Agrawal Sandipan Dandapat LLMAG LRM 72 2 0 30 Nov 2024
Customer Lifetime Value Prediction with Uncertainty Estimation Using Monte Carlo Dropout Xinzhe Cao Yadong Xu Xiaofeng Yang 74 0 0 24 Nov 2024
PaRCE: Probabilistic and Reconstruction-based Competency Estimation for CNN-based Image Classification Sara Pohland Claire Tomlin UQCV 76 1 0 22 Nov 2024
Improving OOD Generalization of Pre-trained Encoders via Aligned Embedding-Space Ensembles Shuman Peng Arash Khoeini Sharan Vaswani Martin Ester 75 0 0 20 Nov 2024
Improving self-training under distribution shifts via anchored confidence with theoretical guarantees Taejong Joo Diego Klabjan UQCV 51 0 0 01 Nov 2024
Enhancing Diversity in Bayesian Deep Learning via Hyperspherical Energy Minimization of CKA David Smerkous Qinxun Bai Fuxin Li BDL 31 0 0 31 Oct 2024
Automated Trustworthiness Oracle Generation for Machine Learning Text Classifiers Lam Nguyen Tung Steven Cho Xiaoning Du Neelofar Neelofar Valerio Terragni Stefano Ruberto Aldeida Aleti 233 2 0 30 Oct 2024
Legitimate ground-truth-free metrics for deep uncertainty classification scoring Arthur Pignet Chiara Regniez John Klein 72 0 0 30 Oct 2024
Domain Adaptation with a Single Vision-Language Embedding Mohammad Fahes Tuan-Hung Vu Andrei Bursuc Patrick Pérez Raoul de Charette VLM 33 0 0 28 Oct 2024
Ensembling Finetuned Language Models for Text Classification Sebastian Pineda Arango Maciej Janowski Lennart Purucker Arber Zela Frank Hutter Josif Grabocka 33 0 0 25 Oct 2024
Theoretical Limitations of Ensembles in the Age of Overparameterization Niclas Dern John P. Cunningham Geoff Pleiss BDL UQCV 36 0 0 21 Oct 2024
The Disparate Benefits of Deep Ensembles Kajetan Schweighofer Adrián Arnaiz-Rodríguez Sepp Hochreiter Nuria Oliver FedML 28 1 0 17 Oct 2024
Uncertainty Estimation and Out-of-Distribution Detection for LiDAR Scene Semantic Segmentation Hanieh Shojaei Qianqian Zou Max Mehltretter UQCV 28 0 0 11 Oct 2024
Towards Trustworthy Web Attack Detection: An Uncertainty-Aware Ensemble Deep Kernel Learning Model Yonghang Zhou Hongyi Zhu Yidong Chai Yuanchun Jiang Yezheng Liu AAML 24 0 0 10 Oct 2024
Evaluating Computational Pathology Foundation Models for Prostate Cancer Grading under Distribution Shifts Fredrik K. Gustafsson Mattias Rantalainen OOD MedIm 34 0 0 09 Oct 2024
Functional-level Uncertainty Quantification for Calibrated Fine-tuning on LLMs Ruijia Niu D. Wu Rose Yu Yi Ma 35 1 0 09 Oct 2024
Predicting Battery Capacity Fade Using Probabilistic Machine Learning Models With and Without Pre-Trained Priors Michael J. Kenney Katerina G. Malollari Sergei V. Kalinin M. Ziatdinov BDL 36 0 0 08 Oct 2024
Gaussian-Based and Outside-the-Box Runtime Monitoring Join Forces Vahid Hashemi Jan Křetínský Sabine Rieder Torsten Schön Jan Vorhoff 39 0 0 08 Oct 2024
Probing Language Models on Their Knowledge Source Zineddine Tighidet Andrea Mogini Jiali Mei Benjamin Piwowarski Patrick Gallinari KELM 40 1 0 08 Oct 2024
Improving Predictor Reliability with Selective Recalibration Thomas P. Zollo Zhun Deng Jake C. Snell T. Pitassi Richard Zemel OOD 41 0 0 07 Oct 2024
Dynamic Post-Hoc Neural Ensemblers Sebastian Pineda Arango Maciej Janowski Lennart Purucker Arber Zela Frank Hutter Josif Grabocka UQCV 44 0 0 06 Oct 2024
Distribution Guided Active Feature Acquisition Yang Li Junier Oliva 29 0 0 04 Oct 2024
Lightning UQ Box: A Comprehensive Framework for Uncertainty Quantification in Deep Learning Nils Lehmann Jakob Gawlikowski Adam J. Stewart Vytautas Jancauskas Stefan Depeweg Eric T. Nalisnick N. Gottschling 44 0 0 04 Oct 2024
Probabilistic road classification in historical maps using synthetic data and deep learning Dominik J. Mühlematter Sebastian Schweizer Chenjing Jiao Xue Xia M. Heitzler L. Hurni 39 0 0 03 Oct 2024
Toward a Holistic Evaluation of Robustness in CLIP Models Weijie Tu Weijian Deng Tom Gedeon VLM 44 5 0 02 Oct 2024
Bias Assessment and Data Drift Detection in Medical Image Analysis: A Survey Andrea Prenner Bernhard Kainz 40 0 0 26 Sep 2024
Scalable Ensemble Diversification for OOD Generalization and Detection Alexander Rubinstein Luca Scimeca Damien Teney Seong Joon Oh BDL OOD 368 1 0 25 Sep 2024
On the calibration of powerset speaker diarization models Alexis Plaquet H. Bredin UQCV 16 0 0 24 Sep 2024
Simple Unsupervised Knowledge Distillation With Space Similarity Aditya Singh Haohan Wang 31 1 0 20 Sep 2024
Trimming the Risk: Towards Reliable Continuous Training for Deep Learning Inspection Systems Altaf Allah Abbassi Houssem Ben Braiek Foutse Khomh Thomas Reid 28 0 0 13 Sep 2024
Sources of Uncertainty in 3D Scene Reconstruction Marcus Klasson Riccardo Mereu Arno Solin Arno Solin 3DV 3DGS 33 3 0 10 Sep 2024
Competency-Aware Planning for Probabilistically Safe Navigation Under Perception Uncertainty Sara Pohland Claire Tomlin 43 0 0 09 Sep 2024
Enhancing Uncertainty Quantification in Drug Discovery with Censored Regression Labels Emma Svensson Hannah Rosa Friesacher S. Winiwarter Lewis H. Mervin Adam Arany Ola Engkvist 50 2 0 06 Sep 2024
Prediction Accuracy & Reliability: Classification and Object Localization under Distribution Shift Fabian Diet Moussa Kassem Sbeyti Michelle Karg 41 0 0 05 Sep 2024
Improving Uncertainty-Error Correspondence in Deep Bayesian Medical Image Segmentation P. Mody Nicolas F. Chaves-de-Plaza Chinmay Rao Eleftheria Astrenidou M. de Ridder N. Hoekstra Klaus Hildebrandt Marius Staring UQCV 27 0 0 05 Sep 2024
UTrack: Multi-Object Tracking with Uncertain Detections Edgardo Solano-Carrillo Felix Sattler Antje Alex Alexander Klein Bruno Pereira Costa Ángel Bueno Rodríguez Jannis Stoppe VOT 42 1 0 30 Aug 2024
Estimating Uncertainty with Implicit Quantile Network Yi Hung Lim UQCV BDL 24 0 0 26 Aug 2024
Explanatory Model Monitoring to Understand the Effects of Feature Shifts on Performance Thomas Decker Alexander Koebler Michael Lebacher Ingo Thon Volker Tresp Florian Buettner 40 1 0 24 Aug 2024
How disentangled are your classification uncertainties? Ivo Pascal de Jong A. Sburlea Matias Valdenegro-Toro UQCV UD PER 33 2 0 22 Aug 2024
The Dilemma of Uncertainty Estimation for General Purpose AI in the EU AI Act Matias Valdenegro-Toro Radina Stoykova 21 0 0 20 Aug 2024
Addressing Heterogeneity in Federated Learning: Challenges and Solutions for a Shared Production Environment T. Legler Vinit Hegiste Ahmed Anwar Martin Ruskowski 31 0 0 18 Aug 2024
Identifying Technical Debt and Its Types Across Diverse Software Projects Issues Karthik Shivashankar Mili Orucevic Maren Maritsdatter Kruke Antonio Martini 46 1 0 17 Aug 2024
Deep Generative Classification of Blood Cell Morphology Simon Deltadahl J. Gilbey C. V. Laer Nancy Boeckx M. Leers ... Nicholas S. Gleadall Carola-Bibiane Schönlieb S. Sivapalaratnam Michael Roberts P. Nachev DiffM MedIm 44 0 0 16 Aug 2024
Uncertainty-Informed Volume Visualization using Implicit Neural Representation Shanu Saklani Chitwan Goel Shrey Bansal Zhe Wang Soumya Dutta Tushar M. Athawale D. Pugmire Christopher R. Johnson 50 0 0 12 Aug 2024
Improved Robustness for Deep Learning-based Segmentation of Multi-Center Myocardial Perfusion MRI Datasets Using Data Adaptive Uncertainty-guided Space-time Analysis D. M. Yalcinkaya Khalid Youssef Bobak Heydari Janet Wei N. Merz ... R. Dharmakumar Orlando Simonetti J. Weinsaft Subha V. Raman Behzad Sharif 23 0 0 09 Aug 2024
Ensemble everything everywhere: Multi-scale aggregation for adversarial robustness Stanislav Fort Balaji Lakshminarayanan OOD AAML 36 4 0 08 Aug 2024
Evaluating Posterior Probabilities: Decision Theory, Proper Scoring Rules, and Calibration Luciana Ferrer Daniel Ramos UQCV 33 4 0 05 Aug 2024