A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions

v1v2 (latest)

A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions

7 December 2024

Anirudha Majumdar

ArXiv (abs)PDF HTML

Papers citing "A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions"

16 / 16 papers shown

Title
SAFE: Multitask Failure Detection for Vision-Language-Action Models Qiao Gu Yuanliang Ju Shengxiang Sun Igor Gilitschenski Haruki Nishimura Masha Itkina Florian Shkurti 36 0 0 11 Jun 2025
From Calibration to Collaboration: LLM Uncertainty Quantification Should Be More Human-Centered Siddartha Devic Tejas Srinivasan Jesse Thomason Willie Neiswanger Vatsal Sharan 21 0 0 09 Jun 2025
Uncertainty-o: One Model-agnostic Framework for Unveiling Uncertainty in Large Multimodal Models Ruiyang Zhang Hu Zhang Hao Fei Zhedong Zheng UQCV 24 0 0 09 Jun 2025
ChemAU: Harness the Reasoning of LLMs in Chemical Research with Adaptive Uncertainty Estimation Xinyi Liu Lipeng Ma Yixuan Li Weidong Yang Qingyuan Zhou Jiayi Song Shuhao Li Ben Fei LRM 43 0 0 01 Jun 2025
LLM-Powered AI Agent Systems and Their Applications in Industry Guannan Liang Qianqian Tong LLMAG LM&Ro 70 3 0 22 May 2025
Benchmarking and Confidence Evaluation of LALMs For Temporal Reasoning Debarpan Bhattacharya Apoorva Kulkarni Sriram Ganapathy 71 0 0 19 May 2025
Calibrating Uncertainty Quantification of Multi-Modal LLMs using Grounding Trilok Padhi R. Kaur Adam D. Cobb Manoj Acharya Anirban Roy Colin Samplawski Brian Matejek Alexander M. Berenbeim Nathaniel D. Bastian Susmit Jha 80 0 0 30 Apr 2025
Uncertainty Quantification for Language Models: A Suite of Black-Box, White-Box, LLM Judge, and Ensemble Scorers Dylan Bouchard Mohit Singh Chauhan HILM 153 0 0 27 Apr 2025
From predictions to confidence intervals: an empirical study of conformal prediction methods for in-context learning Zhe Huang Simone Rossi Rui Yuan T. Hannagan 83 0 0 22 Apr 2025
An overview of model uncertainty and variability in LLM-based sentiment analysis. Challenges, mitigation strategies and the role of explainability David Herrera-Poyatos Carlos Peláez-González Cristina Zuheros Andrés Herrera-Poyatos Virilo Tejedor F. Herrera Rosana Montes 97 2 0 06 Apr 2025
Agentic AI Needs a Systems Theory Erik Miehling Karthikeyan N. Ramamurthy Kush R. Varshney Matthew D Riemer Djallel Bouneffouf ... P. Sattigeri Dennis L. Wei Ambrish Rawat Jasmina Gajcin Werner Geyer 138 6 0 28 Feb 2025
Societal Alignment Frameworks Can Improve LLM Alignment Karolina Stañczak Nicholas Meade Mehar Bhatia Hattie Zhou Konstantin Böttinger ... Timothy P. Lillicrap Ana Marasović Sylvie Delacroix Gillian K. Hadfield Siva Reddy 470 1 0 27 Feb 2025
Uncertainty-Aware Step-wise Verification with Generative Reward Models Zihuiwen Ye Luckeciano C. Melo Younesse Kaddar Phil Blunsom Shivalika Singh Yarin Gal LRM 144 5 0 16 Feb 2025
Uncertainty-Aware Adaptation of Large Language Models for Protein-Protein Interaction Analysis Sanket Jantre Tianle Wang Gilchan Park Kriti Chopra Nicholas Jeon Xiaoning Qian Nathan M. Urban Byung-Jun Yoon 191 1 0 10 Feb 2025
Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation Yiming Wang Pei Zhang Baosong Yang Derek F. Wong Rui Wang LRM 115 15 0 17 Oct 2024
Uncertainty quantification in fine-tuned LLMs using LoRA ensembles Oleksandr Balabanov Hampus Linander UQCV 109 20 0 19 Feb 2024