ACES: Translation Accuracy Challenge Sets for Evaluating Machine
Translation Metrics

ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics

27 October 2022

Chantal Amrhein

Papers citing "ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics"

9 / 9 papers shown

Title
Can LLMs Detect Intrinsic Hallucinations in Paraphrasing and Machine Translation? Evangelia Gogoulou Shorouq Zahra Liane Guillou Luise Dürlich Joakim Nivre HILM LRM 160 0 0 29 Apr 2025
Can Large Language Models Analyze Graphs like Professionals? A Benchmark, Datasets and Models Xin Sky Li Weize Chen Qizhi Chu Haopeng Li Zhaojun Sun ... Yiwei Wei Zhiyuan Liu Chuan Shi Maosong Sun Cheng Yang 37 5 0 29 Sep 2024
TIGQA:An Expert Annotated Question Answering Dataset in Tigrinya Hailay Teklehaymanot Dren Fazlija Niloy Ganguly Gourab K. Patro Wolfgang Nejdl 34 0 0 26 Apr 2024
Reranking for Natural Language Generation from Logical Forms: A Study based on Large Language Models Levon Haroutunian Zhuang Li Lucian Galescu Philip R. Cohen Raj Tumuluri Gholamreza Haffari LRM 26 1 0 21 Sep 2023
BLEU Meets COMET: Combining Lexical and Neural Metrics Towards Robust Machine Translation Evaluation T. Glushkova Chrysoula Zerva André F. T. Martins 35 6 0 30 May 2023
Towards Fine-Grained Information: Identifying the Type and Location of Translation Errors Keqin Bao Boyi Deng Dayiheng Liu Baosong Yang Wenqiang Lei Xiangnan He Derek F.Wong Jun Xie 34 4 0 17 Feb 2023
Extrinsic Evaluation of Machine Translation Metrics Nikita Moghe Tom Sherborne Mark Steedman Alexandra Birch ELM 26 18 0 20 Dec 2022
Can Transformer be Too Compositional? Analysing Idiom Processing in Neural Machine Translation Verna Dankers Christopher G. Lucas Ivan Titov 38 36 0 30 May 2022
Neural versus Phrase-Based Machine Translation Quality: a Case Study L. Bentivogli Arianna Bisazza Mauro Cettolo Marcello Federico 191 328 0 16 Aug 2016