BPE vs. Morphological Segmentation: A Case Study on Machine Translation
of Four Polysynthetic Languages

BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages

16 March 2022

Elisabeth Mager

ArXiv (abs)PDF HTML

Papers citing "BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages"

11 / 11 papers shown

Title
Team Ryu's Submission to SIGMORPHON 2024 Shared Task on Subword Tokenization Zilong Li 63 0 0 19 Oct 2024
The Effect of Data Partitioning Strategy on Model Generalizability: A Case Study of Morphological Segmentation Zoey Liu Bonnie J. Dorr 76 1 0 14 Apr 2024
NLP Progress in Indigenous Latin American Languages A. Tonja F. Balouchzahi S. Butt Olga Kolesnikova Hector G. Ceballos Alexander Gelbukh Thamar Solorio 78 6 0 08 Apr 2024
Greed is All You Need: An Evaluation of Tokenizer Inference Methods Omri Uzan Craig W. Schmidt Chris Tanner Yuval Pinter 77 17 0 02 Mar 2024
The Impact of Word Splitting on the Semantic Content of Contextualized Word Representations Aina Garí Soler Matthieu Labeau Chloé Clavel VLM 65 2 0 22 Feb 2024
Explicit Morphological Knowledge Improves Pre-training of Language Models for Hebrew Eylon Gueta Omer Goldman Reut Tsarfaty 37 2 0 01 Nov 2023
Analyzing Cognitive Plausibility of Subword Tokenization Lisa Beinborn Yuval Pinter 59 20 0 20 Oct 2023
Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction Manuel Mager Rajat Bhatnagar Graham Neubig Ngoc Thang Vu Katharina Kann 93 10 0 11 Jun 2023
KINLP at SemEval-2023 Task 12: Kinyarwanda Tweet Sentiment Analysis Antoine Nzeyimana 37 3 0 25 Apr 2023
Exploring Segmentation Approaches for Neural Machine Translation of Code-Switched Egyptian Arabic-English Text Marwa Gaser Manuel Mager Injy Hamed Nizar Habash Slim Abdennadher Ngoc Thang Vu 81 7 0 11 Oct 2022
Benchmarking Azerbaijani Neural Machine Translation Chih-Chen Chen William Chen 33 0 0 29 Jul 2022

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.