Preliminary WMT24 Ranking of General MT Systems and LLMs
Tom Kocmi
Eleftherios Avramidis
Rachel Bawden
Ondrej Bojar
Anton Dvorkovich
C. Federmann
Mark Fishel
Markus Freitag
Thamme Gowda
Roman Grundkiewicz
Barry Haddow
Marzena Karpinska
Philipp Koehn
Benjamin Marie
Kenton W. Murray
Masaaki Nagata
Martin Popel
Maja Popović
Mariya Shmatova
Steinthór Steingrímsson
Vilém Zouhar

Abstract
This is the preliminary ranking of WMT24 General MT systems based on automatic metrics. The official ranking will be a human evaluation, which is superior to the automatic ranking and supersedes it. The purpose of this report is not to interpret any findings but only provide preliminary results to the participants of the General MT task that may be useful during the writing of the system submission.
View on arXivComments on this paper