Position: Uncertainty Quantification Needs Reassessment for Large-language Model Agents

28 May 2025

Papers citing "Position: Uncertainty Quantification Needs Reassessment for Large-language Model Agents"

24 / 24 papers shown

Title
Self-reflective Uncertainties: Do LLMs Know Their Internal Answer Distribution? Michael Kirchhof Luca Füger Adam Goliñski Eeshan Gunesh Dhekane Arno Blaas Sinead Williamson 29 1 0 26 May 2025
UNCLE: Uncertainty Expressions in Long-Form Generation Ruihan Yang Caiqi Zhang Zhisong Zhang Xinting Huang Dong Yu Nigel Collier Deqing Yang ELM 45 2 0 22 May 2025
Reasoning Models Better Express Their Confidence Dongkeun Yoon Seungone Kim Sohee Yang Sunkyoung Kim Soyeon Kim Yongil Kim Eunbi Choi Yireun Kim Minjoon Seo LRM 43 3 0 20 May 2025
CoT-UQ: Improving Response-wise Uncertainty Quantification in LLMs with Chain-of-Thought Boxuan Zhang Ruqi Zhang LRM 60 3 0 24 Feb 2025
Probabilistic Degeneracy Detection for Point-to-Plane Error Minimization Johan Hatleskog Kostas Alexis 3DPC 94 3 0 14 Oct 2024
On Uncertainty In Natural Language Processing Dennis Ulmer BDL 36 1 0 04 Oct 2024
Measuring Uncertainty Disentanglement Error in Classification Ivo Pascal de Jong A. Sburlea Matthia Sabatelli Matias Valdenegro-Toro UQCV UD PER 69 4 0 22 Aug 2024
Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words? G. Yona Roee Aharoni Mor Geva HILM 83 31 0 27 May 2024
Benchmarking Uncertainty Disentanglement: Specialized Uncertainties for Specialized Tasks Bálint Mucsányi Michael Kirchhof Seong Joon Oh UQCV BDL OODD 547 31 1 29 Feb 2024
Calibrating Long-form Generations from Large Language Models Yukun Huang Yixin Liu Raghuveer Thirukovalluru Arman Cohan Bhuwan Dhingra 50 12 0 09 Feb 2024
Clarify When Necessary: Resolving Ambiguity Through Interaction with LMs Michael J.Q. Zhang Eunsol Choi 79 37 0 16 Nov 2023
Hallucinations in Large Multilingual Translation Models Nuno M. Guerreiro Duarte M. Alves Jonas Waldendorf Barry Haddow Alexandra Birch Pierre Colombo André F.T. Martins VLM HILM LRM 180 152 0 28 Mar 2023
Probabilistic Contrastive Learning Recovers the Correct Aleatoric Uncertainty of Ambiguous Inputs Michael Kirchhof Enkelejda Kasneci Seong Joon Oh UQCV 479 25 0 06 Feb 2023
Towards Clear Expectations for Uncertainty Estimation Victor Bouvier Simona Maggio A. Abraham L. Dreyfus-Schmidt UQCV 60 2 0 27 Jul 2022
Language Models (Mostly) Know What They Know Saurav Kadavath Tom Conerly Amanda Askell T. Henighan Dawn Drain ... Nicholas Joseph Benjamin Mann Sam McCandlish C. Olah Jared Kaplan ELM 122 830 0 11 Jul 2022
Pitfalls of Epistemic Uncertainty Quantification through Loss Minimisation Viktor Bengs Eyke Hüllermeier Willem Waegeman EDL UQCV UD 62 43 0 11 Mar 2022
Deep Deterministic Uncertainty: A Simple Baseline Jishnu Mukhoti Andreas Kirsch Joost R. van Amersfoort Philip Torr Y. Gal UD UQCV PER BDL 96 155 0 23 Feb 2021
Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awareness Jeremiah Zhe Liu Zi Lin Shreyas Padhy Dustin Tran Tania Bedrax-Weiss Balaji Lakshminarayanan UQCV BDL 202 451 0 17 Jun 2020
Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methods Eyke Hüllermeier Willem Waegeman PER UD 244 1,421 0 21 Oct 2019
PHiSeg: Capturing Uncertainty in Medical Image Segmentation Christian F. Baumgartner K. Tezcan K. Chaitanya A. Hötker Urs J. Muehlematter K. Schawkat Anton S. Becker O. Donati E. Konukoglu UQCV 62 204 0 07 Jun 2019
Know What You Don't Know: Unanswerable Questions for SQuAD Pranav Rajpurkar Robin Jia Percy Liang RALM ELM 290 2,853 0 11 Jun 2018
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? Alex Kendall Y. Gal BDL OOD UD UQCV PER 362 4,718 0 15 Mar 2017
Deep Bayesian Active Learning with Image Data Y. Gal Riashat Islam Zoubin Ghahramani BDL UQCV 73 1,739 0 08 Mar 2017
Bayesian Active Learning for Classification and Preference Learning N. Houlsby Ferenc Huszár Zoubin Ghahramani M. Lengyel 125 915 0 24 Dec 2011