MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in
Generative LLMs

MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs

19 February 2024

Yavuz Faruk Bakman

Baturalp Buyukates

Dimitrios Dimitriadis

Papers citing "MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs"

11 / 11 papers shown

Title
Uncertainty Quantification for Language Models: A Suite of Black-Box, White-Box, LLM Judge, and Ensemble Scorers Dylan Bouchard Mohit Singh Chauhan HILM 102 0 0 27 Apr 2025
A Survey of Uncertainty Estimation Methods on Large Language Models Zhiqiu Xia Jinxuan Xu Yuqian Zhang Hang Liu 71 3 0 28 Feb 2025
Leveraging Uncertainty Estimation for Efficient LLM Routing Tuo Zhang Asal Mehradfar Dimitrios Dimitriadis Salman Avestimehr 93 1 0 16 Feb 2025
Graph-based Confidence Calibration for Large Language Models Yukun Li Sijia Wang Lifu Huang Li-Ping Liu UQCV 124 2 0 03 Nov 2024
Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluation Dongryeol Lee Yerin Hwang Yongil Kim Joonsuk Park Kyomin Jung ELM 110 10 0 28 Oct 2024
Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs D. Yaldiz Yavuz Faruk Bakman Baturalp Buyukates Chenyang Tao Anil Ramakrishna Dimitrios Dimitriadis Jieyu Zhao Salman Avestimehr 94 8 0 17 Jun 2024
Explainable Automated Fact-Checking for Public Health Claims Neema Kotonya Francesca Toni 252 260 0 19 Oct 2020
Unsupervised Quality Estimation for Neural Machine Translation M. Fomicheva Shuo Sun Lisa Yankovskaya Frédéric Blain Francisco Guzmán Mark Fishel Nikolaos Aletras Vishrav Chaudhary Lucia Specia UQLM 80 203 0 21 May 2020
Calibration of Pre-trained Transformers Shrey Desai Greg Durrett UQLM 283 300 0 17 Mar 2020
Quantifying Uncertainties in Natural Language Processing Tasks Yijun Xiao William Yang Wang UQCV BDL 68 148 0 18 Nov 2018
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension Mandar Joshi Eunsol Choi Daniel S. Weld Luke Zettlemoyer RALM 195 2,636 0 09 May 2017