Synthetic Test Collections for Retrieval Evaluation

13 May 2024

Papers citing "Synthetic Test Collections for Retrieval Evaluation"

6 / 6 papers shown

Title
LLM-Evaluation Tropes: Perspectives on the Validity of LLM-Evaluations Laura Dietz Oleg Zendel P. Bailey Charles L. A. Clarke Ellese Cotterill Jeff Dalton Faegheh Hasibi Mark Sanderson Nick Craswell ELM 50 0 0 27 Apr 2025
Judging the Judges: A Collection of LLM-Generated Relevance Judgements Hossein A. Rahmani Clemencia Siro Mohammad Aliannejadi Nick Craswell Charles L. A. Clarke Guglielmo Faggioli Bhaskar Mitra Paul Thomas Emine Yilmaz ELM 64 0 0 20 Feb 2025
SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval Hossein A. Rahmani Xi Wang Emine Yilmaz Nick Craswell Bhaskar Mitra Paul Thomas 87 4 0 28 Jan 2025
LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help? Rikiya Takehi E. Voorhees Tetsuya Sakai I. Soboroff 135 3 0 11 Nov 2024
Can Large Language Models Be an Alternative to Human Evaluations? Cheng-Han Chiang Hung-yi Lee ALM LM&MA 229 579 0 03 May 2023
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 264 975 0 17 Apr 2021