How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 671 papers shown

Title
Language-Independent Representations Improve Zero-Shot Summarization V. Solovyev Danni Liu Jan Niehues 78 0 0 08 Apr 2024
Multilingual Pretraining and Instruction Tuning Improve Cross-Lingual Knowledge Alignment, But Only Shallowly Changjiang Gao Hongda Hu Peng Hu Jiajun Chen Jixing Li Shujian Huang 94 21 0 06 Apr 2024
IITK at SemEval-2024 Task 1: Contrastive Learning and Autoencoders for Semantic Textual Relatedness in Multilingual Texts Udvas Basak Rajarshi Dutta Shivam Pandey Ashutosh Modi 72 2 0 06 Apr 2024
Adaptive Cross-lingual Text Classification through In-Context One-Shot Demonstrations Emilio Villa-Cueva A. P. López-Monroy Fernando Sánchez-Vega Thamar Solorio VLM 76 3 0 03 Apr 2024
Africa-Centric Self-Supervised Pre-Training for Multilingual Speech Representation in a Sub-Saharan Context Antoine Caubrière Elodie Gauthier 80 3 0 02 Apr 2024
A Systematic Analysis of Subwords and Cross-Lingual Transfer in Multilingual Translation Francois Meyer Jan Buys 88 1 0 29 Mar 2024
Cross-Lingual Transfer Robustness to Lower-Resource Languages on Adversarial Datasets Shadi Manafi Nikhil Krishnaswamy AAML 71 0 0 29 Mar 2024
Multilingual Sentence-T5: Scalable Sentence Encoders for Multilingual Applications Chihiro Yano Akihiko Fukuchi Shoko Fukasawa Hideyuki Tachibana Yotaro Watanabe 60 4 0 26 Mar 2024
MOGAM: A Multimodal Object-oriented Graph Attention Model for Depression Detection Junyeop Cha Seoyun Kim Dongjae Kim Eunil Park 41 2 0 21 Mar 2024
X-LLaVA: Optimizing Bilingual Large Vision-Language Alignment Dongjae Shin Hyunseok Lim Inho Won Changsu Choi Minjun Kim Seungwoo Song Hangyeol Yoo Sangmin Kim Kyungtae Lim 80 5 0 18 Mar 2024
Pre-Trained Language Models Represent Some Geographic Populations Better Than Others Jonathan Dunn Benjamin Adams Harish Tayyar Madabushi 56 4 0 16 Mar 2024
Optimizing Language Augmentation for Multilingual Large Language Models: A Case Study on Korean Changsu Choi Yongbin Jeong Seoyoon Park Inho Won HyeonSeok Lim ... Yiseul Lee HyeJin Lee Younggyun Hahm Hansaem Kim Kyungtae Lim 53 13 0 16 Mar 2024
GlossLM: Multilingual Pretraining for Low-Resource Interlinear Glossing Michael Ginn Lindia Tjuatja Taiqi He Enora Rice Graham Neubig Alexis Palmer Lori Levin University of Colorado 96 4 0 11 Mar 2024
Persian Slang Text Conversion to Formal and Deep Learning of Persian Short Texts on Social Media for Sentiment Classification Mohsen Khazeni Mohammad Heydari Amir Albadvi 56 1 0 09 Mar 2024
Tracing the Roots of Facts in Multilingual Language Models: Independent, Shared, and Transferred Knowledge Xin Zhao Naoki Yoshinaga Daisuke Oba KELM HILM 77 12 0 08 Mar 2024
Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Text Frances Adriana Laureano De Leon Harish Tayyar Madabushi Mark Lee 63 4 0 07 Mar 2024
DA-Net: A Disentangled and Adaptive Network for Multi-Source Cross-Lingual Transfer Learning Ling Ge Chunming Hu Guanghui Ma Jihong Liu Hong Zhang 54 0 0 07 Mar 2024
A Measure for Transparent Comparison of Linguistic Diversity in Multilingual NLP Data Sets Tanja Samardzic Ximena Gutierrez-Vasques Christian Bentz Steven Moran Olga Pelloni 63 6 0 06 Mar 2024
Advancing Generative AI for Portuguese with Open Decoder Gervásio PT* Rodrigo Santos Joao Silva Luís Gomes João Rodrigues António Branco 92 10 0 29 Feb 2024
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models Tianyi Tang Wenyang Luo Haoyang Huang Dongdong Zhang Xiaolei Wang Xin Zhao Furu Wei Ji-Rong Wen 105 60 0 26 Feb 2024
$C^3$ : Confidence Calibration Model Cascade for Inference-Efficient Cross-Lingual Natural Language Understanding Taixi Lu Haoyu Wang Huajie Shao Jing Gao Huaxiu Yao 69 0 0 25 Feb 2024
Zero-shot cross-lingual transfer in instruction tuning of large language models Nadezhda Chirkova Vassilina Nikoulina LRM 82 4 0 22 Feb 2024
Unveiling Linguistic Regions in Large Language Models Zhihao Zhang Jun Zhao Qi Zhang Tao Gui Xuanjing Huang 104 13 0 22 Feb 2024
Analysis of Multi-Source Language Training in Cross-Lingual Transfer Seong Hoon Lim Taejun Yun Jinhyeon Kim Jihun Choi Taeuk Kim 86 2 0 21 Feb 2024
The Hidden Space of Transformer Language Adapters Jesujoba Oluwadara Alabi Marius Mosbach Matan Eyal Dietrich Klakow Mor Geva 109 10 1 20 Feb 2024
Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks Nadezhda Chirkova Vassilina Nikoulina 78 10 0 19 Feb 2024
Share What You Already Know: Cross-Language-Script Transfer and Alignment for Sentiment Detection in Code-Mixed Data Niraj Pahari Kazutaka Shimada 86 0 0 07 Feb 2024
Stanceosaurus 2.0: Classifying Stance Towards Russian and Spanish Misinformation Anton Lavrouk Ian Ligon Tarek Naous Jonathan Zheng Alan Ritter Wei Xu 64 1 0 06 Feb 2024
BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation Jianlv Chen Shitao Xiao Peitian Zhang Kun Luo Defu Lian Zheng Liu 702 443 0 05 Feb 2024
Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Models Sara Rajaee Christof Monz 80 4 0 03 Feb 2024
LangBridge: Multilingual Reasoning Without Multilingual Supervision Dongkeun Yoon Joel Jang Sungdong Kim Seungone Kim Sheikh Shafayat Minjoon Seo LRM 54 15 0 19 Jan 2024
Cross-lingual neural fuzzy matching for exploiting target-language monolingual corpora in computer-aided translation M. Esplà-Gomis Víctor M. Sánchez-Cartagena J. A. Pérez-Ortiz F. Sánchez-Martínez 75 3 0 16 Jan 2024
Discovering Low-rank Subspaces for Language-agnostic Multilingual Representations Zhihui Xie Handong Zhao Tong Yu Shuai Li 64 15 0 11 Jan 2024
Multilingual Instruction Tuning With Just a Pinch of Multilinguality Uri Shaham Jonathan Herzig Roee Aharoni Idan Szpektor Reut Tsarfaty Matan Eyal LRM 126 52 0 03 Jan 2024
LLaMA Beyond English: An Empirical Study on Language Capability Transfer Jun Zhao Zhihao Zhang Luhui Gao Qi Zhang Tao Gui Xuanjing Huang ELM 109 79 0 02 Jan 2024
From Bytes to Biases: Investigating the Cultural Self-Perception of Large Language Models Wolfgang Messner Tatum Greene Josephine Matalone 74 5 0 21 Dec 2023
Cross-Lingual Learning in Multilingual Scene Text Recognition Jeonghun Baek Yusuke Matsui Kiyoharu Aizawa 64 0 0 17 Dec 2023
SegMix: A Simple Structure-Aware Data Augmentation Method Yuxin Pei Pushkar Bhuse Zhengzhong Liu Eric P. Xing 46 1 0 16 Nov 2023
When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages Tyler A. Chang Catherine Arnett Zhuowen Tu Benjamin Bergen LRM 135 8 0 15 Nov 2023
How Vocabulary Sharing Facilitates Multilingualism in LLaMA? Fei Yuan Shuai Yuan Zhiyong Wu Lei Li 84 13 0 15 Nov 2023
OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining Yihong Liu Peiqin Lin Mingyang Wang Hinrich Schütze 71 29 0 15 Nov 2023
A Material Lens on Coloniality in NLP William B. Held Camille Harris Michael Best Diyi Yang 94 14 0 14 Nov 2023
Examining Modularity in Multilingual LMs via Language-Specialized Subnetworks Rochelle Choenni Ekaterina Shutova Daniel H Garrette 85 8 0 14 Nov 2023
On the Analysis of Cross-Lingual Prompt Tuning for Decoder-based Multilingual Model Nohil Park Joonsuk Park Kang Min Yoo Sungroh Yoon 79 3 0 14 Nov 2023
Sharing, Teaching and Aligning: Knowledgeable Transfer Learning for Cross-Lingual Machine Reading Comprehension Tingfeng Cao Chengyu Wang Chuanqi Tan Jun Huang Jinhui Zhu 89 0 0 12 Nov 2023
Task-Agnostic Low-Rank Adapters for Unseen English Dialects Zedian Xiao William B. Held Yanchen Liu Diyi Yang 94 9 0 02 Nov 2023
Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages? Luke Gessler Nathan Schneider 46 1 0 01 Nov 2023
Two-Stage Classifier for Campaign Negativity Detection using Axis Embeddings: A Case Study on Tweets of Political Users during 2021 Presidential Election in Iran Fatemeh Rajabi Ali Mohades 70 0 0 31 Oct 2023
CreoleVal: Multilingual Multitask Benchmarks for Creoles Heather Lent Kushal Tatariya Raj Dabre Yiyi Chen Marcell Richard Fekete ... Miryam de Lhoneux Daniel Hershcovich Michel DeGraff Anders Sogaard Johannes Bjerva SLR 86 10 0 30 Oct 2023
Counterfactually Probing Language Identity in Multilingual Models Anirudh Srinivasan Venkata S Govindarajan Kyle Mahowald 70 1 0 29 Oct 2023