Exploring the Relationship between Alignment and Cross-lingual Transfer
in Multilingual Transformers

Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers

5 June 2023

Papers citing "Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers"

10 / 10 papers shown

Title
A Practical Guide to Fine-tuning Language Models with Limited Data Márton Szép Daniel Rueckert Rüdiger von Eisenhart-Rothe Florian Hinterwimmer SyDa ALM 49 2 0 14 Nov 2024
Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Models Lucas Bandarkar Benjamin Muller Pritish Yuvraj Rui Hou Nayan Singhal Hongjiang Lv Bing-Quan Liu KELM LRM MoMe 52 3 0 02 Oct 2024
How Transliterations Improve Crosslingual Alignment Yihong Liu Mingyang Wang Amir Hossein Kargaran Ayyoob Imani Orgest Xhelili Haotian Ye Chunlan Ma François Yvon Hinrich Schütze 42 2 0 25 Sep 2024
PreAlign: Boosting Cross-Lingual Transfer by Early Establishment of Multilingual Alignment Jiahuan Li Shujian Huang Xinyu Dai Jiajun Chen LLMSV 49 6 0 23 Jul 2024
Understanding Cross-Lingual Alignment -- A Survey Katharina Hämmerl Jindvrich Libovický Alexander Fraser 41 10 0 09 Apr 2024
AdaMergeX: Cross-Lingual Transfer with Large Language Models via Adaptive Adapter Merging Yiran Zhao Wenxuan Zhang Huiming Wang Kenji Kawaguchi Lidong Bing MoMe 37 15 0 29 Feb 2024
Word Alignment by Fine-tuning Embeddings on Parallel Corpora Zi-Yi Dou Graham Neubig 96 257 0 20 Jan 2021
Multilingual BERT Post-Pretraining Alignment Lin Pan Chung-Wei Hang Haode Qi Abhishek Shah Saloni Potdar Mo Yu 114 44 0 23 Oct 2020
Fine-grained Entity Typing through Increased Discourse Context and Adaptive Classification Thresholds Sheng Zhang Kevin Duh Benjamin Van Durme 76 14 0 21 Apr 2018
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 189 1,639 0 11 Oct 2017