Adaptations of ROUGE and BLEU to Better Evaluate Machine Reading
Comprehension Task

Adaptations of ROUGE and BLEU to Better Evaluate Machine Reading Comprehension Task

10 June 2018

Jing Liu

Sujian Li

Papers citing "Adaptations of ROUGE and BLEU to Better Evaluate Machine Reading Comprehension Task"

9 / 9 papers shown

Title
SQUARE: Automatic Question Answering Evaluation using Multiple Positive and Negative References Matteo Gabburo Siddhant Garg Rik Koncel-Kedziorski Alessandro Moschitti 29 1 0 21 Sep 2023
Knowing-how & Knowing-that: A New Task for Machine Comprehension of User Manuals Hongru Liang Jia-Wei Liu Weihong Du dingnan jin Wenqiang Lei Zujie Wen Jiancheng Lv 16 1 0 07 Jun 2023
Learning Answer Generation using Supervision from Automatic Question Answering Evaluators Matteo Gabburo Siddhant Garg Rik Koncel-Kedziorski Alessandro Moschitti 29 6 0 24 May 2023
PVGRU: Generating Diverse and Relevant Dialogue Responses via Pseudo-Variational Mechanism Yongkang Liu Shi Feng Daling Wang Yifei Zhang Hinrich Schütze 31 6 0 18 Dec 2022
Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation Jannis Bulian Christian Buck Wojciech Gajewski Benjamin Boerschinger Tal Schuster 26 43 0 15 Feb 2022
Multi-Narrative Semantic Overlap Task: Evaluation and Benchmark Naman Bansal Mousumi Akter Shubhra (Santu) Karmaker 36 0 0 14 Jan 2022
Semantic Answer Similarity for Evaluating Question Answering Models Julian Risch Timo Moller Julian Gutsch M. Pietsch ELM 32 67 0 13 Aug 2021
To Test Machine Comprehension, Start by Defining Comprehension Jesse Dunietz Greg Burnham Akash Bharadwaj Owen Rambow Jennifer Chu-Carroll D. Ferrucci FaML 54 65 0 04 May 2020
KPQA: A Metric for Generative Question Answering Using Keyphrase Weights Hwanhee Lee Seunghyun Yoon Franck Dernoncourt Doo Soon Kim Trung Bui Joongbo Shin Kyomin Jung 16 0 0 01 May 2020