Romanization-based Large-scale Adaptation of Multilingual Language Models

18 April 2023

Papers citing "Romanization-based Large-scale Adaptation of Multilingual Language Models"

6 / 6 papers shown

Title
Extending LLMs to New Languages: A Case Study of Llama and Persian Adaptation Samin Mahdizadeh Sani Pouya Sadeghi Thuy-Trang Vu Yadollah Yaghoobzadeh Gholamreza Haffari 76 2 0 17 Dec 2024
Exploring the Role of Transliteration in In-Context Learning for Low-resource Languages Written in Non-Latin Scripts Chunlan Ma Yihong Liu Haotian Ye Hinrich Schütze 36 2 0 02 Jul 2024
Training a Bilingual Language Model by Mapping Tokens onto a Shared Character Space Aviad Rom Kfir Bar 40 1 0 25 Feb 2024
Does Transliteration Help Multilingual Language Modeling? Ibraheem Muhammad Moosa Mahmud Elahi Akhter Ashfia Binte Habib 45 11 0 29 Jan 2022
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models Phillip Rust Jonas Pfeiffer Ivan Vulić Sebastian Ruder Iryna Gurevych 80 235 0 31 Dec 2020
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models Benjamin Muller Antonis Anastasopoulos Benoît Sagot Djamé Seddah LRM 136 165 0 24 Oct 2020