Cross-Lingual Optimization for Language Transfer in Large Language Models

Cross-Lingual Optimization for Language Transfer in Large Language Models

20 May 2025

ArXiv (abs)PDF HTML

Papers citing "Cross-Lingual Optimization for Language Transfer in Large Language Models"

10 / 10 papers shown

Title
Understanding and Mitigating Language Confusion in LLMs Kelly Marchisio Wei-Yin Ko Alexandre Berard Théo Dehaze Sebastian Ruder 133 32 0 28 Jun 2024
Exploratory Preference Optimization: Harnessing Implicit Q*-Approximation for Sample-Efficient RLHF Tengyang Xie Dylan J. Foster Akshay Krishnamurthy Corby Rosset Ahmed Hassan Awadallah Alexander Rakhlin 94 45 0 31 May 2024
ORPO: Monolithic Preference Optimization without Reference Model Jiwoo Hong Noah Lee James Thorne OSLM 98 266 0 12 Mar 2024
KTO: Model Alignment as Prospect Theoretic Optimization Kawin Ethayarajh Winnie Xu Niklas Muennighoff Dan Jurafsky Douwe Kiela 275 569 0 02 Feb 2024
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafael Rafailov Archit Sharma E. Mitchell Stefano Ermon Christopher D. Manning Chelsea Finn ALM 389 4,163 0 29 May 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.5K 14,748 0 15 Mar 2023
WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models Benjamin Minixhofer Fabian Paischer Navid Rekabsaz 94 85 0 13 Dec 2021
Adapting Monolingual Models: Data can be Scarce when Language Similarity is High Wietse de Vries Martijn Bartelds Malvina Nissim Martijn B. Wieling 48 23 0 06 May 2021
Beyond English-Centric Multilingual Machine Translation Angela Fan Shruti Bhosale Holger Schwenk Zhiyi Ma Ahmed El-Kishky ... Vitaliy Liptchinsky Sergey Edunov Edouard Grave Michael Auli Armand Joulin LRM 94 858 0 21 Oct 2020
From English To Foreign Languages: Transferring Pre-trained Language Models Ke M. Tran 46 52 0 18 Feb 2020