Examining Modularity in Multilingual LMs via Language-Specialized Subnetworks

14 November 2023

Papers citing "Examining Modularity in Multilingual LMs via Language-Specialized Subnetworks"

10 / 10 papers shown

Title
Local Contrastive Editing of Gender Stereotypes Marlene Lutz Rochelle Choenni M. Strohmaier Anne Lauscher 34 1 0 23 Oct 2024
Linguistically Grounded Analysis of Language Models using Shapley Head Values Marcell Richard Fekete Johannes Bjerva 31 0 0 17 Oct 2024
The Same But Different: Structural Similarities and Differences in Multilingual Language Modeling Ruochen Zhang Qinan Yu Matianyu Zang Carsten Eickhoff Ellie Pavlick 49 2 0 11 Oct 2024
Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Models Lucas Bandarkar Benjamin Muller Pritish Yuvraj Rui Hou Nayan Singhal Hongjiang Lv Bing-Quan Liu KELM LRM MoMe 52 3 0 02 Oct 2024
The Echoes of Multilinguality: Tracing Cultural Value Shifts during LM Fine-tuning Rochelle Choenni Anne Lauscher Ekaterina Shutova 40 7 0 21 May 2024
Neuron Specialization: Leveraging intrinsic task modularity for multilingual machine translation Shaomu Tan Di Wu Christof Monz MoMe 36 7 0 17 Apr 2024
The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models Adithya Bhaskar Dan Friedman Danqi Chen 35 5 0 06 Mar 2024
Discovering Language-neutral Sub-networks in Multilingual Language Models Negar Foroutan Mohammadreza Banaei R. Lebret Antoine Bosselut Karl Aberer LRM 41 25 0 25 May 2022
On the Prunability of Attention Heads in Multilingual BERT Aakriti Budhraja Madhura Pande Pratyush Kumar Mitesh M. Khapra 50 4 0 26 Sep 2021
The Lottery Ticket Hypothesis for Pre-trained BERT Networks Tianlong Chen Jonathan Frankle Shiyu Chang Sijia Liu Yang Zhang Zhangyang Wang Michael Carbin 156 345 0 23 Jul 2020