The Great Misalignment Problem in Human Evaluation of NLP Methods

12 April 2021

Papers citing "The Great Misalignment Problem in Human Evaluation of NLP Methods"

7 / 7 papers shown

Title
AGENT-CQ: Automatic Generation and Evaluation of Clarifying Questions for Conversational Search with LLMs Clemencia Siro Yifei Yuan Mohammad Aliannejadi Maarten de Rijke ELM 63 3 0 25 Oct 2024
A Perspective on Literary Metaphor in the Context of Generative AI Imke van Heerden Anil Bas 56 1 0 02 Sep 2024
ConSiDERS-The-Human Evaluation Framework: Rethinking Human Evaluation for Generative Large Language Models Aparna Elangovan Ling Liu Lei Xu S. Bodapati Dan Roth ELM 103 10 0 28 May 2024
Modern French Poetry Generation with RoBERTa and GPT-2 Mika Hämäläinen Khalid Alnajjar Thierry Poibeau BDL 66 10 0 06 Dec 2022
Automatic Generation of Factual News Headlines in Finnish Maximilian Koppatz Khalid Alnajjar Mika Hämäläinen Thierry Poibeau 69 2 0 05 Dec 2022
Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Papers Mika Hämäläinen Khalid Alnajjar ELM LM&MA 85 17 0 31 Jul 2021
A Review of Human Evaluation for Style Transfer Eleftheria Briakou Sweta Agrawal Ke Zhang Joel R. Tetreault Marine Carpuat 93 30 0 09 Jun 2021