To MT or not to MT: An eye-tracking study on the reception by Dutch readers of different translation and creativity levels

This article presents the results of a pilot study involving the reception of a fictional short story translated from English into Dutch under four conditions: machine translation (MT), post-editing (PE), human translation (HT) and original source text (ST). The aim is to understand how creativity and errors in different translation modalities affect readers, specifically regarding cognitive load. Eight participants filled in a questionnaire, read a story using an eye-tracker, and conducted a retrospective think-aloud (RTA) interview. The results show that units of creative potential (UCP) increase cognitive load and that this effect is highest for HT and lowest for MT; no effect of error was observed. Triangulating the data with RTAs leads us to hypothesize that the higher cognitive load in UCPs is linked to increases in reader enjoyment and immersion. The effect of translation creativity on cognitive load in different translation modalities at word-level is novel and opens up new avenues for further research. All the code and data are available atthis https URL

@article{gerrits2025_2504.19850,
  title={ To MT or not to MT: An eye-tracking study on the reception by Dutch readers of different translation and creativity levels },
  author={ Kyo Gerrits and Ana Guerberof-Arenas },
  journal={arXiv preprint arXiv:2504.19850},
  year={ 2025 }
}