Language Models with Conformal Factuality Guarantees

15 February 2024

Tatsunori Hashimoto

Papers citing "Language Models with Conformal Factuality Guarantees"

22 / 22 papers shown

Title
Calibrated Predictive Lower Bounds on Time-to-Unsafe-Sampling in LLMs Hen Davidov Gilad Freidkin Shai Feldman Yaniv Romano 32 0 0 16 Jun 2025
Textual Bayes: Quantifying Uncertainty in LLM-Based Systems Brendan Leigh Ross Noël Vouitsis Atiyeh Ashari Ghomi Rasa Hosseinzadeh Ji Xin ... Yi Sui Shiyi Hou Kin Kwan Leung Gabriel Loaiza-Ganem Jesse C. Cresswell 74 0 0 11 Jun 2025
Efficient Robust Conformal Prediction via Lipschitz-Bounded Networks Thomas Massena Léo Andéol Thibaut Boissin Franck Mamalet Corentin Friedrich M. Serrurier Sébastien Gerchinovitz AAML 49 2 0 05 Jun 2025
High Accuracy, Less Talk (HALT): Reliable LLMs through Capability-Aligned Finetuning Tim Franzmeyer Archie Sravankumar Lijuan Liu Yuning Mao Rui Hou Sinong Wang Jakob Foerster Luke Zettlemoyer Madian Khabsa KELM ALM 93 0 0 04 Jun 2025
Conformal Arbitrage: Risk-Controlled Balancing of Competing Objectives in Language Models William Overman Mohsen Bayati 41 0 0 01 Jun 2025
Reinforcement Learning for Better Verbalized Confidence in Long-Form Generation Caiqi Zhang Xiaochen Zhu Chengzu Li Nigel Collier Andreas Vlachos OffRL HILM 53 1 0 29 May 2025
Calibrating LLMs for Text-to-SQL Parsing by Leveraging Sub-clause Frequencies Terrance Liu Shuyi Wang Daniel Preotiuc-Pietro Yash Chandarana Chirag Gupta 31 1 0 27 May 2025
Do Large Language Models (Really) Need Statistical Foundations? Weijie Su 278 0 0 25 May 2025
Thought calibration: Efficient and confident test-time scaling Menghua Wu Cai Zhou Stephen Bates Tommi Jaakkola LRM 85 0 0 23 May 2025
Advertising in AI systems: Society must be vigilant Menghua Wu Yujia Bao 107 0 0 23 May 2025
Bayesian Modeling of Zero-Shot Classifications for Urban Flood Detection Matt W Franchi N. Garg Wendy Ju Emma Pierson 90 2 0 18 Mar 2025
Don't lie to your friends: Learning what you know from collaborative self-play Jacob Eisenstein Reza Aghajani Adam Fisch Dheeru Dua Fantine Huot Mirella Lapata Vicky Zayats Jonathan Berant 147 0 0 18 Mar 2025
Conformal Linguistic Calibration: Trading-off between Factuality and Specificity Zhengping Jiang Anqi Liu Benjamin Van Durme 176 3 0 26 Feb 2025
Conformal Prediction Sets Can Cause Disparate Impact Jesse C. Cresswell Bhargava Kumar Yi Sui Mouloud Belbahri FaML 534 2 0 17 Feb 2025
A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions Ola Shorinwa Zhiting Mei Justin Lidard Allen Z. Ren Anirudha Majumdar HILM LRM 153 19 0 07 Dec 2024
Conformal Risk Minimization with Variance Reduction Sima Noorani Orlando Romero Nicolò Dal Fabbro Hamed Hassani George Pappas 253 3 0 03 Nov 2024
Sample then Identify: A General Framework for Risk Control and Assessment in Multimodal Large Language Models Qingni Wang Tiantian Geng Zhiyuan Wang Teng Wang Bo Fu Feng Zheng 192 5 0 10 Oct 2024
Conformal Prediction: A Data Perspective Xiaofan Zhou Baiting Chen Yu Gui Lu Cheng 1.0K 5 0 09 Oct 2024
Conformal Structured Prediction Botong Zhang Shuo Li Osbert Bastani 118 0 0 08 Oct 2024
Conformal Generative Modeling with Improved Sample Efficiency through Sequential Greedy Filtering Kemal Kurniawan Bernhard Schölkopf Michael Muehlebach 201 1 0 02 Oct 2024
Uncertainty Estimation and Quantification for LLMs: A Simple Supervised Approach Linyu Liu Yu Pan Xiaocheng Li Guanting Chen 105 39 0 24 Apr 2024
A Closer Look at Claim Decomposition Miriam Wanner Seth Ebner Zhengping Jiang Mark Dredze Benjamin Van Durme 103 24 0 18 Mar 2024