v1v2v3v4 (latest)

Semantic Volume: Quantifying and Detecting both External and Internal Uncertainty in LLMs

28 February 2025

Papers citing "Semantic Volume: Quantifying and Detecting both External and Internal Uncertainty in LLMs"

34 / 34 papers shown

Title
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning DeepSeek-AI Daya Guo Dejian Yang Haowei Zhang Junxiao Song ... Shiyu Wang S. Yu Shunfeng Zhou Shuting Pan S.S. Li ReLM VLM OffRL AI4TS LRM 380 1,970 0 22 Jan 2025
Improving Uncertainty Quantification in Large Language Models via Semantic Embeddings Yashvir S. Grewal Edwin V. Bonilla Thang D. Bui UQCV 79 9 0 30 Oct 2024
Rule-based Data Selection for Large Language Models Xiaomin Li Mingye Gao Zhiwei Zhang Chang Yue Hong Hu 70 6 0 07 Oct 2024
On the consistent reasoning paradox of intelligence and optimal trust in AI: The power of Í don't know' Alexander Bastounis Paolo Campodonico M. Schaar Ben Adcock Anders C. Hansen LRM 53 2 0 05 Aug 2024
LLM Internal States Reveal Hallucination Risk Faced With a Query Ziwei Ji Delong Chen Etsuko Ishii Samuel Cahyawijaya Yejin Bang Bryan Wilie Pascale Fung HILM LRM 89 33 0 03 Jul 2024
Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMs Jannik Kossen Jiatong Han Muhammed Razzak Lisa Schut Shreshth A. Malik Yarin Gal HILM 110 51 0 22 Jun 2024
Detecting Hallucinations in Large Language Model Generation: A Token Probability Approach Ernesto Quevedo Jorge Yero Rachel Koerner Pablo Rivas Tomas Cerny HILM 64 16 0 30 May 2024
CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models Tong Zhang Peixin Qin Yang Deng Chen Huang Wenqiang Lei Junhong Liu Dingnan Jin Hongru Liang Tat-Seng Chua 60 13 0 20 May 2024
CLARINET: Augmenting Language Models to Ask Clarification Questions for Retrieval Yizhou Chi Jessy Lin Kevin Lin Dan Klein RALM 50 7 0 28 Apr 2024
Uncertainty Estimation and Quantification for LLMs: A Simple Supervised Approach Linyu Liu Yu Pan Xiaocheng Li Guanting Chen 93 38 0 24 Apr 2024
Aligning Language Models to Explicitly Handle Ambiguity Sungmin Cho Youna Kim Cheonbok Park Junyeob Kim Choonghyun Park Kang Min Yoo Sang-goo Lee Taeuk Kim 64 21 0 18 Apr 2024
Clarify When Necessary: Resolving Ambiguity Through Interaction with LMs Michael J.Q. Zhang Eunsol Choi 79 37 0 16 Nov 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng ... Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu LRM HILM 130 901 0 09 Nov 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron Louis Martin Kevin R. Stone Peter Albert Amjad Almahairi ... Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom AI4MH ALM 396 12,044 0 18 Jul 2023
Generating with Confidence: Uncertainty Quantification for Black-box Large Language Models Zhen Lin Shubhendu Trivedi Jimeng Sun HILM 187 153 0 30 May 2023
Do Large Language Models Know What They Don't Know? Zhangyue Yin Qiushi Sun Qipeng Guo Jiawen Wu Xipeng Qiu Xuanjing Huang ELM AI4MH 78 163 0 29 May 2023
Selectively Answering Ambiguous Questions Jeremy R. Cole Michael J.Q. Zhang D. Gillick Julian Martin Eisenschlos Bhuwan Dhingra Jacob Eisenstein UQLM 88 30 0 24 May 2023
Asking Clarification Questions to Handle Ambiguity in Open-Domain QA Dongryeol Lee Segwang Kim Minwoo Lee Hwanhee Lee Joonsuk Park Sang-Woo Lee Kyomin Jung UQLM 76 13 0 23 May 2023
Hallucinations in Large Multilingual Translation Models Nuno M. Guerreiro Duarte M. Alves Jonas Waldendorf Barry Haddow Alexandra Birch Pierre Colombo André F.T. Martins VLM HILM LRM 182 152 0 28 Mar 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.5K 14,699 0 15 Mar 2023
LLaMA: Open and Efficient Foundation Language Models Hugo Touvron Thibaut Lavril Gautier Izacard Xavier Martinet Marie-Anne Lachaux ... Faisal Azhar Aurelien Rodriguez Armand Joulin Edouard Grave Guillaume Lample ALM PILM 1.5K 13,437 0 27 Feb 2023
Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation Lorenz Kuhn Y. Gal Sebastian Farquhar UQLM 201 308 0 19 Feb 2023
A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity Yejin Bang Samuel Cahyawijaya Nayeon Lee Wenliang Dai Dan Su ... Tiezheng Yu Willy Chung Quyet V. Do Yan Xu Pascale Fung ReLM LRM 124 1,386 0 08 Feb 2023
CLAM: Selective Clarification for Ambiguous Questions with Generative Language Models Lorenz Kuhn Y. Gal Sebastian Farquhar 77 41 0 15 Dec 2022
Towards Improving Faithfulness in Abstractive Summarization Preslav Nakov Mingzhe Li Xin Gao Xiangliang Zhang HILM 58 27 0 04 Oct 2022
Language Models (Mostly) Know What They Know Saurav Kadavath Tom Conerly Amanda Askell T. Henighan Dawn Drain ... Nicholas Joseph Benjamin Mann Sam McCandlish C. Olah Jared Kaplan ELM 122 830 0 11 Jul 2022
Survey of Hallucination in Natural Language Generation Ziwei Ji Nayeon Lee Rita Frieske Tiezheng Yu D. Su ... Delong Chen Wenliang Dai Ho Shu Chan Andrea Madotto Pascale Fung HILM LRM 228 2,423 0 08 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 843 9,644 0 28 Jan 2022
Types of Out-of-Distribution Texts and How to Detect Them Udit Arora William Huang He He OODD 262 101 0 14 Sep 2021
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 877 42,379 0 28 May 2020
Unsupervised Quality Estimation for Neural Machine Translation M. Fomicheva Shuo Sun Lisa Yankovskaya Frédéric Blain Francisco Guzmán Mark Fishel Nikolaos Aletras Vishrav Chaudhary Lucia Specia UQLM 87 209 0 21 May 2020
AmbigQA: Answering Ambiguous Open-domain Questions Sewon Min Julian Michael Hannaneh Hajishirzi Luke Zettlemoyer 107 317 0 22 Apr 2020
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,301 0 27 Aug 2019
Determinantal point processes for machine learning Alex Kulesza B. Taskar 260 1,140 0 25 Jul 2012