Hallucination Detection in LLMs Using Spectral Features of Attention Maps

Hallucination Detection in LLMs Using Spectral Features of Attention Maps

24 February 2025

Jakub Binkowski

Tomasz Kajdanowicz

Papers citing "Hallucination Detection in LLMs Using Spectral Features of Attention Maps"

12 / 12 papers shown

Title
Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Unanswerable Questions and Ambiguous Prompts Hazel Kim Adel Bibi Philip Torr Y. Gal 77 2 0 13 Dec 2024
FactLens: Benchmarking Fine-Grained Fact Verification Kushan Mitra Dan Zhang Sajjadur Rahman Estevam R. Hruschka HILM 112 1 0 08 Nov 2024
Softmax is not Enough (for Sharp Size Generalisation) Petar Velickovic Christos Perivolaropoulos Federico Barbero Razvan Pascanu 63 19 0 01 Oct 2024
Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps Yung-Sung Chuang Linlu Qiu Cheng-Yu Hsieh Ranjay Krishna Yoon Kim James R. Glass HILM 44 43 0 09 Jul 2024
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu ... Dacheng Li Eric Xing Haotong Zhang Joseph E. Gonzalez Ion Stoica ALM OSLM ELM 252 4,186 0 09 Jun 2023
Understanding over-squashing and bottlenecks on graphs via curvature Jake Topping Francesco Di Giovanni B. Chamberlain Xiaowen Dong M. Bronstein 89 440 0 29 Nov 2021
CoQA: A Conversational Question Answering Challenge Siva Reddy Danqi Chen Christopher D. Manning RALM HAI 86 1,197 0 21 Aug 2018
Know What You Don't Know: Unanswerable Questions for SQuAD Pranav Rajpurkar Robin Jia Percy Liang RALM ELM 196 2,830 0 11 Jun 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 492 129,831 0 12 Jun 2017
TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension Mandar Joshi Eunsol Choi Daniel S. Weld Luke Zettlemoyer RALM 173 2,610 0 09 May 2017
Spectral Networks and Locally Connected Networks on Graphs Joan Bruna Wojciech Zaremba Arthur Szlam Yann LeCun GNN 145 4,856 0 21 Dec 2013
A Tutorial on Spectral Clustering U. V. Luxburg 204 10,497 0 01 Nov 2007