v1v2 (latest)

Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift

6 June 2019

Balaji Lakshminarayanan

Jasper Snoek

UQCV

ArXiv (abs)PDF HTML

Papers citing "Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift"

50 / 1,062 papers shown

Title
Confidence-Aware Multi-Field Model Calibration Yuang Zhao Chuhan Wu Qinglin Jia Hong Zhu Jia Yan Libin Zong Linxuan Zhang Zhenhua Dong Muyu Zhang 98 1 0 27 Feb 2024
Mitigating Distributional Shift in Semantic Segmentation via Uncertainty Estimation from Unlabelled Data David S. W. Williams Daniele De Martini Matthew Gadd Paul Newman UQCV 85 5 0 27 Feb 2024
Variational Learning is Effective for Large Deep Networks Yuesong Shen Nico Daheim Bai Cong Peter Nickl Gian Maria Marconi ... Rio Yokota Iryna Gurevych Daniel Cremers Mohammad Emtiyaz Khan Thomas Möllenhoff 91 31 0 27 Feb 2024
Pretrained Visual Uncertainties Michael Kirchhof Mark Collier Seong Joon Oh Enkelejda Kasneci UQCV 546 8 1 26 Feb 2024
Watch Your Head: Assembling Projection Heads to Save the Reliability of Federated Models Jinqian Chen Jihua Zhu Qinghai Zheng Zhongyu Li Zhiqiang Tian FedML 95 3 0 26 Feb 2024
Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Data YongKyung Oh Dongyoung Lim Sungil Kim AI4TS 145 17 0 22 Feb 2024
The METRIC-framework for assessing data quality for trustworthy AI in medicine: a systematic review Daniel Schwabe Katinka Becker Martin Seyferth Andreas Klass Tobias Schäffter 68 24 0 21 Feb 2024
Discriminant Distance-Aware Representation on Deterministic Uncertainty Quantification Methods Jiaxin Zhang Kamalika Das Kumar Sricharan UQCV 69 0 0 20 Feb 2024
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles Oleksandr Balabanov Hampus Linander UQCV 112 20 0 19 Feb 2024
HEAL: Brain-inspired Hyperdimensional Efficient Active Learning Yang Ni Zhuowen Zou Wenjun Huang Hanning Chen William Youngwoo Chung Samuel Cho R. Krishnan Pietro Mercati Mohsen Imani 76 3 0 17 Feb 2024
Efficient Multi-task Uncertainties for Joint Semantic Segmentation and Monocular Depth Estimation S. Landgraf Markus Hillemann Theodor Kapler Markus Ulrich UQCV 70 9 0 16 Feb 2024
UR2M: Uncertainty and Resource-Aware Event Detection on Microcontrollers Hong Jia Young D. Kwon Dong Ma Nhat Pham Lorena Qendro Tam N. Vu Cecilia Mascolo 69 2 0 14 Feb 2024
Variational Continual Test-Time Adaptation Fan Lyu Kaile Du Yuyang Li Hanyu Zhao Zhang Zhang Guangcan Liu Liang Wang TTA BDL 83 6 0 13 Feb 2024
An Empirical Study Into What Matters for Calibrating Vision-Language Models Weijie Tu Weijian Deng Dylan Campbell Stephen Gould Tom Gedeon VLM 88 8 0 12 Feb 2024
A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP) Weijie Tu Weijian Deng Tom Gedeon UQCV VLM 73 35 0 12 Feb 2024
Predictive Churn with the Set of Good Models J. Watson-Daniels Flavio du Pin Calmon Alexander DÁmour Carol Xuan Long David C. Parkes Berk Ustun 142 8 0 12 Feb 2024
Assessing Uncertainty Estimation Methods for 3D Image Segmentation under Distribution Shifts Masoumeh Javanbakhat Md Tasnimul Hasan Cristoph Lippert UQCV OOD 52 1 0 10 Feb 2024
SAE: Single Architecture Ensemble Neural Networks Martin Ferianc Hongxiang Fan Miguel R. D. Rodrigues UQCV 50 0 0 09 Feb 2024
Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions A. Testoni Raquel Fernández 64 11 0 09 Feb 2024
Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Models Anthony Sicilia Hyunwoo J. Kim Khyathi Chandu Malihe Alikhani Jack Hessel 58 2 0 05 Feb 2024
How Good is a Single Basin? Kai Lion Lorenzo Noci Thomas Hofmann Gregor Bachmann UQCV 46 3 0 05 Feb 2024
A Distributionally Robust Optimisation Approach to Fair Credit Scoring Pablo Casas Christophe Mues Huan Yu 27 0 0 02 Feb 2024
Non-Exchangeable Conformal Language Generation with Nearest Neighbors Dennis Ulmer Chrysoula Zerva André F. T. Martins 207 13 0 01 Feb 2024
Lightweight Pixel Difference Networks for Efficient Visual Representation Learning Z. Su Jiehua Zhang Longguang Wang Hua Zhang Zhen Liu M. Pietikäinen Li Liu 92 22 0 01 Feb 2024
Towards Understanding Variants of Invariant Risk Minimization through the Lens of Calibration Kotaro Yoshida Hiroki Naganuma 155 2 0 31 Jan 2024
Explaining Predictive Uncertainty by Exposing Second-Order Effects Florian Bley Sebastian Lapuschkin Wojciech Samek G. Montavon 80 3 0 30 Jan 2024
Neighbor-Aware Calibration of Segmentation Networks with Penalty-Based Constraints Balamurali Murugesan Sukesh Adiga Vasudeva Bingyuan Liu H. Lombaert Ismail Ben Ayed Jose Dolz UQCV 97 6 0 25 Jan 2024
WARM: On the Benefits of Weight Averaged Reward Models Alexandre Ramé Nino Vieillard Léonard Hussenot Robert Dadashi Geoffrey Cideron Olivier Bachem Johan Ferret 179 104 0 22 Jan 2024
Out-of-Distribution Detection & Applications With Ablated Learned Temperature Energy Will LeVine Benjamin Pikus Jacob Phillips Berk Norman Fernando Amat Gil Sean Hendryx OODD 189 1 0 22 Jan 2024
Deep Ensemble Shape Calibration: Multi-Field Post-hoc Calibration in Online Advertising Shuai Yang Hao Yang Zhuang Zou Linhe Xu Shuo Yuan Yifan Zeng 114 1 0 17 Jan 2024
Uncertainty-Aware Hardware Trojan Detection Using Multimodal Deep Learning Rahul Vishwakarma Amin Rezaei 89 3 0 15 Jan 2024
Uncertainty Awareness of Large Language Models Under Code Distribution Shifts: A Benchmark Study Yufei Li Simin Chen Yanghong Guo Wei Yang Yue Dong Cong Liu UQCV 63 2 0 12 Jan 2024
Accurate and Scalable Estimation of Epistemic Uncertainty for Graph Neural Networks Puja Trivedi Mark Heimann Rushil Anirudh Danai Koutra Jayaraman J. Thiagarajan UQCV 107 5 0 07 Jan 2024
Calibration Attacks: A Comprehensive Study of Adversarial Attacks on Model Confidence Stephen Obadinma Xiaodan Zhu Hongyu Guo AAML 50 1 0 05 Jan 2024
SUDO: a framework for evaluating clinical artificial intelligence systems without ground-truth annotations Dani Kiyasseh Aaron Cohen Chengsheng Jiang Nicholas Altieri SyDa 79 11 0 02 Jan 2024
Out of the Ordinary: Spectrally Adapting Regression for Covariate Shift Benjamin Eyre Elliot Creager David Madras Antonio Torralba Katherine Heller OOD OODD 67 1 0 29 Dec 2023
Tractable Function-Space Variational Inference in Bayesian Neural Networks Tim G. J. Rudner Zonghao Chen Yee Whye Teh Y. Gal 147 44 0 28 Dec 2023
Efficient Deweather Mixture-of-Experts with Uncertainty-aware Feature-wise Linear Modulation Rongyu Zhang Yulin Luo Jiaming Liu Huanrui Yang Zhen Dong ... Tomoyuki Okuno Yohei Nakata Kurt Keutzer Yuan Du Shanghang Zhang MoMe MoE 74 3 0 27 Dec 2023
Make Me a BNN: A Simple Strategy for Estimating Bayesian Uncertainty from Pre-trained Models Gianni Franchi Olivier Laurent Maxence Leguéry Andrei Bursuc Andrea Pilzer Angela Yao UQCV BDL 60 6 0 23 Dec 2023
Density Uncertainty Quantification with NeRF-Ensembles: Impact of Data and Scene Constraints M. Jäger Steven Landgraf B. Jutzi 82 2 0 22 Dec 2023
Unveiling Backbone Effects in CLIP: Exploring Representational Synergies and Variances Cristian Rodriguez-Opazo Edison Marrese-Taylor Ehsan Abbasnejad Hamed Damirchi Ignacio M. Jara Felipe Bravo-Marquez Anton Van Den Hengel VLM 66 1 0 22 Dec 2023
Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation Jiaming Liu Ran Xu Senqiao Yang Renrui Zhang Qizhe Zhang Zehui Chen Yandong Guo Shanghang Zhang TTA 77 12 0 19 Dec 2023
On the calibration of neural networks for histological slide-level classification Alexander Kurz H. A. Mehrtens Tabea-Clara Bucher T. Brinker UQCV MedIm 57 0 0 15 Dec 2023
Reliability in Semantic Segmentation: Can We Use Synthetic Data? Thibaut Loiseau Tuan-Hung Vu Mickaël Chen Patrick Pérez Matthieu Cord UQCV 82 14 0 14 Dec 2023
Split-Ensemble: Efficient OOD-aware Ensemble via Task and Model Splitting Anthony Chen Huanrui Yang Yulu Gan Denis A. Gudovskiy Zhen Dong Haofan Wang Tomoyuki Okuno Yohei Nakata Kurt Keutzer Shanghang Zhang 67 3 0 14 Dec 2023
Weighted Ensemble Models Are Strong Continual Learners Imad Eddine Marouf Subhankar Roy Enzo Tartaglione Stéphane Lathuilière CLL 109 22 0 14 Dec 2023
Estimating calibration error under label shift without labels Teodora Popordanoska Gorjan Radevski Tinne Tuytelaars Matthew B. Blaschko 39 1 0 14 Dec 2023
Beyond Classification: Definition and Density-based Estimation of Calibration in Object Detection Teodora Popordanoska A. Tiulpin Matthew B. Blaschko 113 8 0 11 Dec 2023
An Ambiguity Measure for Recognizing the Unknowns in Deep Learning Roozbeh Yousefzadeh AAML UQCV 74 0 0 11 Dec 2023
Benchmarking of Query Strategies: Towards Future Deep Active Learning Shiryu Ueno Yusei Yamada Shunsuke Nakatsuka Kunihito Kato FedML 71 2 0 10 Dec 2023