Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?

7 September 2022

Lisa Wimmer

Eyke Hüllermeier

Papers citing "Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?"

50 / 50 papers shown

Title
An Axiomatic Assessment of Entropy- and Variance-based Uncertainty Quantification in Regression Christopher Bülte Yusuf Sale Timo Löhr Paul Hofman Gitta Kutyniok Eyke Hüllermeier UD 65 0 0 25 Apr 2025
Achieving Distributive Justice in Federated Learning via Uncertainty Quantification Alycia N. Carey Xintao Wu FedML 35 0 0 22 Apr 2025
Delusions of Large Language Models Hongshen Xu Zixv yang Zichen Zhu Kunyao Lan Zihan Wang Mengyue Wu Ziwei Ji Lu Chen Pascale Fung Kai Yu LRM HILM 56 0 0 09 Mar 2025
Conformal Prediction Regions are Imprecise Highest Density Regions Michele Caprio Yusuf Sale Eyke Hüllermeier 67 0 0 10 Feb 2025
Reducing Aleatoric and Epistemic Uncertainty through Multi-modal Data Acquisition Arthur Hoarau Benjamin Quost Sébastien Destercke Willem Waegeman UQCV UD PER 72 0 0 30 Jan 2025
Partial-Label Learning with a Reject Option Tobias Fuchs Florian Kalinke Klemens Bohm 42 0 0 08 Jan 2025
Conformalized Credal Regions for Classification with Ambiguous Ground Truth Michele Caprio David Stutz Shuo Li Arnaud Doucet UQCV 67 4 0 07 Nov 2024
Legitimate ground-truth-free metrics for deep uncertainty classification scoring Arthur Pignet Chiara Regniez John Klein 72 1 0 30 Oct 2024
A Survey of Uncertainty Estimation in LLMs: Theory Meets Practice Hsiu-Yuan Huang Yutong Yang Zhaoxi Zhang Sanwoo Lee Yunfang Wu 44 9 0 20 Oct 2024
Probabilistic Degeneracy Detection for Point-to-Plane Error Minimization Johan Hatleskog Kostas Alexis 3DPC 47 0 0 14 Oct 2024
Active Evaluation Acquisition for Efficient LLM Benchmarking Yang Li Jie Ma Miguel Ballesteros Yassine Benajiba Graham Horwood ELM 29 1 0 08 Oct 2024
CUQ-GNN: Committee-based Graph Uncertainty Quantification using Posterior Networks C. Damke Eyke Hüllermeier BDL 37 0 0 06 Sep 2024
How disentangled are your classification uncertainties? Ivo Pascal de Jong A. Sburlea Matias Valdenegro-Toro UQCV UD PER 25 2 0 22 Aug 2024
Do LLMs Know When to NOT Answer? Investigating Abstention Abilities of Large Language Models Nishanth Madhusudhan Sathwik Tejaswi Madhusudhan Vikas Yadav Masoud Hashemi 21 4 0 23 Jul 2024
Are We Ready for Out-of-Distribution Detection in Digital Pathology? Ji-Hun Oh Kianoush Falahkheirkhah Rohit Bhargava OODD 43 2 0 18 Jul 2024
Instance-wise Uncertainty for Class Imbalance in Semantic Segmentation Luís Almeida Ines Dutra Francesco Renna UQCV 40 0 0 17 Jul 2024
On the Calibration of Epistemic Uncertainty: Principles, Paradoxes and Conflictual Loss Mohammed Fellaji Frédéric Pennerath Brieuc Conan-Guez Miguel Couceiro UQCV 43 1 0 16 Jul 2024
How to Leverage Predictive Uncertainty Estimates for Reducing Catastrophic Forgetting in Online Continual Learning Giuseppe Serra Ben Werner Florian Buettner 45 2 0 10 Jul 2024
Unified Uncertainties: Combining Input, Data and Model Uncertainty into a Single Formulation Matias Valdenegro-Toro Ivo Pascal de Jong Marco Zullich UD 40 2 0 26 Jun 2024
Unleashing the Potential of Open-set Noisy Samples Against Label Noise for Medical Image Classification Zehui Liao Shishuai Hu Yong-quan Xia 43 0 0 18 Jun 2024
Linear Opinion Pooling for Uncertainty Quantification on Graphs C. Damke Eyke Hüllermeier 46 1 0 06 Jun 2024
Label-wise Aleatoric and Epistemic Uncertainty Quantification Yusuf Sale Paul Hofman Timo Löhr Lisa Wimmer Thomas Nagler Eyke Hüllermeier PER UD UQCV 45 7 0 04 Jun 2024
A Structured Review of Literature on Uncertainty in Machine Learning & Deep Learning Fahimeh Fakour Ali Mosleh Ramin Ramezani UQCV UD PER 43 1 0 01 Jun 2024
Scalable Bayesian Learning with posteriors Samuel Duffield Kaelan Donatella Johnathan Chiu Phoebe Klett Daniel Simpson BDL UQCV 62 1 0 31 May 2024
Federated Continual Learning Goes Online: Leveraging Uncertainty for Modality-Agnostic Class-Incremental Learning Giuseppe Serra Florian Buettner CLL FedML 51 0 0 29 May 2024
Evaluating Bayesian deep learning for radio galaxy classification Devina Mohan Anna M. M. Scaife UQCV BDL 46 1 0 28 May 2024
Quantifying Aleatoric and Epistemic Uncertainty with Proper Scoring Rules Paul Hofman Yusuf Sale Eyke Hüllermeier UQCV UD PER 46 5 0 18 Apr 2024
Benchmarking Uncertainty Disentanglement: Specialized Uncertainties for Specialized Tasks Bálint Mucsányi Michael Kirchhof Seong Joon Oh UQCV BDL OODD 431 20 1 29 Feb 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 56 17 0 28 Feb 2024
Pretrained Visual Uncertainties Michael Kirchhof Mark Collier Seong Joon Oh Enkelejda Kasneci UQCV 410 8 1 26 Feb 2024
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles Oleksandr Balabanov H. Linander UQCV 36 13 0 19 Feb 2024
Predictive Uncertainty Quantification via Risk Decompositions for Strictly Proper Scoring Rules Nikita Kotelevskii Maxim Panov PER UQCV UD 37 3 0 16 Feb 2024
Uncertainty Quantification for In-Context Learning of Large Language Models Chen Ling Xujiang Zhao Xuchao Zhang Wei Cheng Yanchi Liu ... Katsushi Matsuda Jie Ji Guangji Bai Liang Zhao Haifeng Chen 29 14 0 15 Feb 2024
Is Epistemic Uncertainty Faithfully Represented by Evidential Deep Learning Methods? Mira Jürgens Nis Meinert Viktor Bengs Eyke Hüllermeier Willem Waegeman UQCV UD PER EDL BDL 29 11 0 14 Feb 2024
Second-Order Uncertainty Quantification: Variance-Based Measures Yusuf Sale Paul Hofman Lisa Wimmer Eyke Hüllermeier Thomas Nagler PER UQCV UD 31 8 0 30 Dec 2023
Second-Order Uncertainty Quantification: A Distance-Based Approach Yusuf Sale Viktor Bengs Michele Caprio Eyke Hüllermeier PER UQCV UD 27 18 0 02 Dec 2023
Introducing an Improved Information-Theoretic Measure of Predictive Uncertainty Kajetan Schweighofer L. Aichberger Mykyta Ielanskyi Sepp Hochreiter 28 11 0 14 Nov 2023
Model-agnostic variable importance for predictive uncertainty: an entropy-based approach Danny Wood Theodore Papamarkou Matt Benatan Richard Allmendinger FAtt UD 40 3 0 19 Oct 2023
A Novel Bayes' Theorem for Upper Probabilities Michele Caprio Yusuf Sale Eyke Hüllermeier Insup Lee 28 10 0 13 Jul 2023
Is the Volume of a Credal Set a Good Measure for Epistemic Uncertainty? Yusuf Sale Michele Caprio Eyke Hüllermeier UD 31 25 0 16 Jun 2023
Ensembled Prediction Intervals for Causal Outcomes Under Hidden Confounding Myrl G. Marmarelis Greg Ver Steeg Aram Galstyan Fred Morstatter CML OOD 16 5 0 15 Jun 2023
Explaining Predictive Uncertainty with Information Theoretic Shapley Values David S. Watson Joshua O'Hara Niek Tax Richard Mudd Ido Guy TDI FAtt 26 21 0 09 Jun 2023
Laplacian Segmentation Networks: Improved Epistemic Uncertainty from Spatial Aleatoric Uncertainty Kilian Zepf Selma Wanna M. Miani Juston Moore J. Frellsen Søren Hauberg Aasa Feragen Frederik Warburg UQCV 32 4 0 23 Mar 2023
Multi-Head Multi-Loss Model Calibration Adrian Galdran Johan W. Verjans G. Carneiro M. A. G. Ballester UQCV 13 7 0 02 Mar 2023
Looking at the posterior: accuracy and uncertainty of neural-network predictions H. Linander Oleksandr Balabanov Henry Yang Bernhard Mehlig UQCV UD BDL 32 2 0 26 Nov 2022
FiLM-Ensemble: Probabilistic Deep Learning via Feature-wise Linear Modulation Mehmet Özgür Türkoglu Alexander Becker H. Gündüz Mina Rezaei Bernd Bischl Rodrigo Caye Daudt Stefano Dáronco Jan Dirk Wegner Konrad Schindler FedML UQCV 38 25 0 31 May 2022
The Unreasonable Effectiveness of Deep Evidential Regression N. Meinert J. Gawlikowski Alexander Lavin UQCV EDL 177 35 0 20 May 2022
Marginal and Joint Cross-Entropies & Predictives for Online Bayesian Inference, Active Learning, and Active Sampling Andreas Kirsch Jannik Kossen Y. Gal UQCV BDL 58 3 0 18 May 2022
Prior and Posterior Networks: A Survey on Evidential Deep Learning Methods For Uncertainty Estimation Dennis Ulmer Christian Hardmeier J. Frellsen BDL UQCV UD EDL PER 48 48 0 06 Oct 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,661 0 05 Dec 2016