Does Transliteration Help Multilingual Language Modeling?

29 January 2022

Papers citing "Does Transliteration Help Multilingual Language Modeling?"

13 / 13 papers shown

Title
Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignment Orgest Xhelili Yihong Liu Hinrich Schütze 36 6 0 28 Jun 2024
Script-Agnostic Language Identification Milind Agarwal Joshua Otten Antonios Anastasopoulos 28 0 0 25 Jun 2024
Training a Bilingual Language Model by Mapping Tokens onto a Shared Character Space Aviad Rom Kfir Bar 32 1 0 25 Feb 2024
RomanSetu: Efficiently unlocking multilingual capabilities of Large Language Models via Romanization Jaavid Aktar Husain Raj Dabre Aswanth Kumar Jay Gala Thanmay Jayakumar Ratish Puduppully Anoop Kunchukuttan 30 12 0 25 Jan 2024
Milestones in Bengali Sentiment Analysis leveraging Transformer-models: Fundamentals, Challenges and Future Directions Saptarshi Sengupta Shreya Ghosh Prasenjit Mitra Tarikul Islam Tamiti 35 0 0 15 Jan 2024
Hate Speech and Offensive Content Detection in Indo-Aryan Languages: A Battle of LSTM and Transformers Nikhil Narayan Mrutyunjay Biswal Pramod Goyal Abhranta Panigrahi VLM 14 3 0 09 Dec 2023
Romanization-based Large-scale Adaptation of Multilingual Language Models Sukannya Purkayastha Sebastian Ruder Jonas Pfeiffer Iryna Gurevych Ivan Vulić 23 13 0 18 Apr 2023
Language Modelling with Pixels Phillip Rust Jonas F. Lotz Emanuele Bugliarello Elizabeth Salesky Miryam de Lhoneux Desmond Elliott VLM 38 46 0 14 Jul 2022
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models Phillip Rust Jonas Pfeiffer Ivan Vulić Sebastian Ruder Iryna Gurevych 80 235 0 31 Dec 2020
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models Benjamin Muller Antonis Anastasopoulos Benoît Sagot Djamé Seddah LRM 131 165 0 24 Oct 2020
Rethinking embedding coupling in pre-trained language models Hyung Won Chung Thibault Févry Henry Tsai Melvin Johnson Sebastian Ruder 95 142 0 24 Oct 2020
Investigating Multilingual NMT Representations at Scale Sneha Kudugunta Ankur Bapna Isaac Caswell N. Arivazhagan Orhan Firat LRM 144 120 0 05 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 415 2,586 0 03 Sep 2019