Unveiling Multilinguality in Transformer Models: Exploring Language Specificity in Feed-Forward Networks

24 October 2023

Papers citing "Unveiling Multilinguality in Transformer Models: Exploring Language Specificity in Feed-Forward Networks"

8 / 8 papers shown

Title
Language-specific Neurons Do Not Facilitate Cross-Lingual Transfer Soumen Kumar Mondal Sayambhu Sen Abhishek Singhania P. Jyothi 33 0 0 21 Mar 2025
Multilingual Knowledge Editing with Language-Agnostic Factual Neurons Xue Zhang Yunlong Liang Fandong Meng Songming Zhang Yufeng Chen Jinan Xu Jie Zhou KELM 50 5 0 24 Jun 2024
Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMs Weixuan Wang Barry Haddow Wei Peng Alexandra Birch MILM 43 9 0 13 Jun 2024
Understanding the role of FFNs in driving multilingual behaviour in LLMs Sunit Bhattacharya Ondrej Bojar 21 2 0 22 Apr 2024
Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages? Shaoyang Xu Weilong Dong Zishan Guo Xinwei Wu Deyi Xiong 41 6 0 28 Feb 2024
Unraveling Babel: Exploring Multilingual Activation Patterns of LLMs and Their Applications Weize Liu Yinlong Xu Hongxia Xu Jintai Chen Xuming Hu Jian Wu 28 0 0 26 Feb 2024
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models Terra Blevins Hila Gonen Luke Zettlemoyer LRM 59 26 0 24 May 2022
Investigating Multilingual NMT Representations at Scale Sneha Kudugunta Ankur Bapna Isaac Caswell N. Arivazhagan Orhan Firat LRM 144 120 0 05 Sep 2019