UniTE: Unified Translation Evaluation

28 April 2022

Dayiheng Liu

Papers citing "UniTE: Unified Translation Evaluation"

27 / 27 papers shown

Title
Sentence-level Aggregation of Lexical Metrics Correlates Stronger with Human Judgements than Corpus-level Aggregation Paulo Cavalin P. Domingues Claudio S. Pinhanez 40 0 0 03 Jul 2024
The Impact of Syntactic and Semantic Proximity on Machine Translation with Back-Translation Nicolas Guerin Shane Steinert-Threlkeld Emmanuel Chemla 38 1 0 26 Mar 2024
From Handcrafted Features to LLMs: A Brief Survey for Machine Translation Quality Estimation Haofei Zhao Yilun Liu Shimin Tao Weibin Meng Yimeng Chen Xiang Geng Chang Su Min Zhang Hao Yang 34 9 0 21 Mar 2024
MT-Ranker: Reference-free machine translation evaluation by inter-system ranking Ibraheem Muhammad Moosa Rui Zhang Wenpeng Yin 24 5 0 30 Jan 2024
Lost in the Source Language: How Large Language Models Evaluate the Quality of Machine Translation Xu Huang Zhirui Zhang Xiang Geng Yichao Du Jiajun Chen Shujian Huang 48 7 0 12 Jan 2024
xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection Nuno M. Guerreiro Ricardo Rei Daan van Stigt Luísa Coheur Pierre Colombo André F.T. Martins 48 113 0 16 Oct 2023
Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task Ricardo Rei Nuno M. Guerreiro José P. Pombal Daan van Stigt Marcos Vinícius Treviso Luísa Coheur José G. C. de Souza André F. T. Martins 32 57 0 21 Sep 2023
Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level Daniel Deutsch Juraj Juraska M. Finkelstein and Markus Freitag 48 11 0 25 Aug 2023
TIM: Teaching Large Language Models to Translate with Comparison Jiali Zeng Fandong Meng Yongjing Yin Jie Zhou 37 55 0 10 Jul 2023
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training Yiming Yan Tao Wang Chengqi Zhao Shujian Huang Jiajun Chen Mingxuan Wang 24 22 0 06 Jul 2023
Conformalizing Machine Translation Evaluation Chrysoula Zerva André F.T. Martins 27 3 0 09 Jun 2023
Breeding Machine Translations: Evolutionary approach to survive and thrive in the world of automated evaluation Josef Jon Ondrej Bojar 32 10 0 30 May 2023
UMSE: Unified Multi-scenario Summarization Evaluation Shen Gao Zhitao Yao Chongyang Tao Xiuying Chen Pengjie Ren Z. Ren Zhumin Chen 30 5 0 26 May 2023
Dancing Between Success and Failure: Edit-level Simplification Evaluation using SALSA David Heineman Yao Dou Mounica Maddela Wei-ping Xu 23 15 0 23 May 2023
INSTRUCTSCORE: Explainable Text Generation Evaluation with Finegrained Feedback Wenda Xu Danqing Wang Liangming Pan Zhenqiao Song Markus Freitag Luu Anh Tuan Lei Li ALM ELM 38 17 0 23 May 2023
The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics Ricardo Rei Nuno M. Guerreiro Marcos Vinícius Treviso Luísa Coheur A. Lavie André F.T. Martins 35 15 0 19 May 2023
Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models Qingyu Lu Baopu Qiu Liang Ding Liping Xie Tom Kocmi Dacheng Tao LRM ALM ELM 26 108 0 24 Mar 2023
Towards Fine-Grained Information: Identifying the Type and Location of Translation Errors Keqin Bao Boyi Deng Dayiheng Liu Baosong Yang Wenqiang Lei Xiangnan He Derek F.Wong Jun Xie 37 4 0 17 Feb 2023
Poor Man's Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference Vilém Zouhar S. Dhuliawala Wangchunshu Zhou Nico Daheim Tom Kocmi Yuchen Eleanor Jiang Mrinmaya Sachan 18 9 0 21 Jan 2023
Extrinsic Evaluation of Machine Translation Metrics Nikita Moghe Tom Sherborne Mark Steedman Alexandra Birch ELM 26 18 0 20 Dec 2022
Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality? Pei Zhang Baosong Yang Hao-Ran Wei Dayiheng Liu Kai Fan Luo Si Jun Xie 21 3 0 25 Nov 2022
Alibaba-Translate China's Submission for WMT 2022 Quality Estimation Shared Task Keqin Bao Boyi Deng Dayiheng Liu Baosong Yang Wenqiang Lei Xiangnan He Derek F.Wong Jun Xie 17 5 0 18 Oct 2022
Alibaba-Translate China's Submission for WMT 2022 Metrics Shared Task Boyi Deng Keqin Bao Dayiheng Liu Baosong Yang Derek F. Wong Lidia S. Chao Wenqiang Lei Jun Xie 30 9 0 18 Oct 2022
DATScore: Evaluating Translation with Data Augmented Translations Moussa Kamal Eddine Guokan Shang Michalis Vazirgiannis 44 5 0 12 Oct 2022
CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task Ricardo Rei Marcos Vinícius Treviso Nuno M. Guerreiro Chrysoula Zerva Ana C. Farinha ... T. Glushkova Duarte M. Alves A. Lavie Luísa Coheur André F. T. Martins 60 139 0 13 Sep 2022
MENLI: Robust Evaluation Metrics from Natural Language Inference Yanran Chen Steffen Eger 32 16 0 15 Aug 2022
USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translation Jonas Belouadi Steffen Eger 33 20 0 21 Feb 2022