SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and
Related Observable Overgeneration Mistakes

SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes

12 March 2024

Timothee Mickus

Jörg Tiedemann

Vincent Segonne

Alessandro Raganato

Marianna Apidianaki

Papers citing "SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes"

15 / 15 papers shown

Title
Can LLMs Detect Intrinsic Hallucinations in Paraphrasing and Machine Translation? Evangelia Gogoulou Shorouq Zahra Liane Guillou Luise Dürlich Joakim Nivre HILM LRM 157 0 0 29 Apr 2025
SemEval-2025 Task 3: Mu-SHROOM, the Multilingual Shared Task on Hallucinations and Related Observable Overgeneration Mistakes Raúl Vázquez Timothee Mickus Elaine Zosa Teemu Vahtola Jörg Tiedemann ... Liane Guillou Ona de Gibert Jaione Bengoetxea Joseph Attieh Marianna Apidianaki HILM VLM LRM 85 0 0 16 Apr 2025
HalluSearch at SemEval-2025 Task 3: A Search-Enhanced RAG Pipeline for Hallucination Detection Mohamed A. Abdallah S. El-Beltagy HILM 33 1 0 14 Apr 2025
HausaNLP at SemEval-2025 Task 3: Towards a Fine-Grained Model-Aware Hallucination Detection Maryam Bala Amina Imam Abubakar Abdulhamid Abubakar Abdulkadir Shehu Bichi Hafsa Kabir Ahmad Sani Abdullahi Sani Idris Abdulmumin Shamsuddeen Hassan Muhamad I. Ahmad HILM 44 1 0 25 Mar 2025
AILS-NTUA at SemEval-2025 Task 3: Leveraging Large Language Models and Translation Strategies for Multilingual Hallucination Detection Dimitra Karkani Maria Lymperaiou Giorgos Filandrianos Nikolaos Spanos Athanasios Voulodimos Giorgos Stamou HILM LRM 86 0 0 04 Mar 2025
FaithBench: A Diverse Hallucination Benchmark for Summarization by Modern LLMs F. S. Bao Miaoran Li Renyi Qu Ge Luo Erana Wan ... Ruixuan Tu Chenyu Xu Matthew Gonzales Ofer Mendelevitch Amin Ahmad VLM HILM 23 2 0 17 Oct 2024
The Two Sides of the Coin: Hallucination Generation and Detection with LLMs as Evaluators for LLMs Anh Thu Maria Bui Saskia Felizitas Brech Natalie Hußfeldt Tobias Jennert Melanie Ullrich Timo Breuer Narjes Nikzad Khasmakhi Philipp Schaer HILM 41 0 0 12 Jul 2024
SmurfCat at SemEval-2024 Task 6: Leveraging Synthetic Data for Hallucination Detection Elisei Rykov Yana Shishkina Kseniia Petrushina Kseniia Titova Sergey Petrakov Alexander Panchenko 31 1 0 09 Apr 2024
SLPL SHROOM at SemEval2024 Task 06: A comprehensive study on models ability to detect hallucination Pouya Fallah S. Gooran Mohammad Jafarinasab Pouya Sadeghi Reza Farnia Amirreza Tarabkhah Zainab Sadat Taghavi Hossein Sameti HILM 49 3 0 07 Apr 2024
SHROOM-INDElab at SemEval-2024 Task 6: Zero- and Few-Shot LLM-Based Classification for Hallucination Detection Bradley Paul Allen Fina Polat Paul T. Groth VLM 24 2 0 04 Apr 2024
AILS-NTUA at SemEval-2024 Task 6: Efficient model tuning for hallucination detection and analysis Natalia Griogoriadou Maria Lymperaiou Giorgos Filandrianos Giorgos Stamou VLM 25 0 0 01 Apr 2024
MALTO at SemEval-2024 Task 6: Leveraging Synthetic Data for LLM Hallucination Detection Federico Borra Claudio Savelli Giacomo Rosso Alkis Koudounas F. Giobergia HILM 29 3 0 01 Mar 2024
OPDAI at SemEval-2024 Task 6: Small LLMs can Accelerate Hallucination Detection with Weakly Supervised Data Chengcheng Wei Ze Chen Songtan Fang Jiarong He Max Gao 28 3 0 20 Feb 2024
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark Nouha Dziri Hannah Rashkin Tal Linzen David Reitter ALM 187 79 0 30 Apr 2021
A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation Tianyu Liu Yizhe Zhang Chris Brockett Yi Mao Zhifang Sui Weizhu Chen W. Dolan HILM 219 143 0 18 Apr 2021