MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in
Generative LLMs

MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs

19 February 2024

Yavuz Faruk Bakman

Baturalp Buyukates

Dimitrios Dimitriadis

Papers citing "MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs"

13 / 13 papers shown

Title
Uncertainty Quantification for Language Models: A Suite of Black-Box, White-Box, LLM Judge, and Ensemble Scorers Dylan Bouchard Mohit Singh Chauhan HILM 102 0 0 27 Apr 2025
A Survey of Uncertainty Estimation Methods on Large Language Models Zhiqiu Xia Jinxuan Xu Yuqian Zhang Hang Liu 71 3 0 28 Feb 2025
Leveraging Uncertainty Estimation for Efficient LLM Routing Tuo Zhang Asal Mehradfar Dimitrios Dimitriadis Salman Avestimehr 93 1 0 16 Feb 2025
Graph-based Confidence Calibration for Large Language Models Yukun Li Sijia Wang Lifu Huang Li-Ping Liu UQCV 124 2 0 03 Nov 2024
Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluation Dongryeol Lee Yerin Hwang Yongil Kim Joonsuk Park Kyomin Jung ELM 115 10 0 28 Oct 2024
Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs D. Yaldiz Yavuz Faruk Bakman Baturalp Buyukates Chenyang Tao Anil Ramakrishna Dimitrios Dimitriadis Jieyu Zhao Salman Avestimehr 94 8 0 17 Jun 2024
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis Yuxin Xiao Paul Pu Liang Umang Bhatt Willie Neiswanger Ruslan Salakhutdinov Louis-Philippe Morency 198 95 0 10 Oct 2022
Language Models (Mostly) Know What They Know Saurav Kadavath Tom Conerly Amanda Askell T. Henighan Dawn Drain ... Nicholas Joseph Benjamin Mann Sam McCandlish C. Olah Jared Kaplan ELM 104 809 0 11 Jul 2022
Explainable Automated Fact-Checking for Public Health Claims Neema Kotonya Francesca Toni 254 261 0 19 Oct 2020
Unsupervised Quality Estimation for Neural Machine Translation M. Fomicheva Shuo Sun Lisa Yankovskaya Frédéric Blain Francisco Guzmán Mark Fishel Nikolaos Aletras Vishrav Chaudhary Lucia Specia UQLM 80 205 0 21 May 2020
Calibration of Pre-trained Transformers Shrey Desai Greg Durrett UQLM 283 300 0 17 Mar 2020
Quantifying Uncertainties in Natural Language Processing Tasks Yijun Xiao William Yang Wang UQCV BDL 68 149 0 18 Nov 2018
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension Mandar Joshi Eunsol Choi Daniel S. Weld Luke Zettlemoyer RALM 197 2,643 0 09 May 2017