How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 671 papers shown

Title
Recipe for Zero-shot POS Tagging: Is It Useful in Realistic Scenarios? Zeno Vandenbulcke Lukas Vermeire Miryam de Lhoneux 84 0 0 14 Oct 2024
The Same But Different: Structural Similarities and Differences in Multilingual Language Modeling Ruochen Zhang Qinan Yu Matianyu Zang Carsten Eickhoff Ellie Pavlick 91 6 0 11 Oct 2024
M3Hop-CoT: Misogynous Meme Identification with Multimodal Multi-hop Chain-of-Thought G. Kumari Kirtan Jain Asif Ekbal 102 4 0 11 Oct 2024
DEPT: Decoupled Embeddings for Pre-training Language Models Alex Iacob Lorenzo Sani Meghdad Kurmanji William F. Shen Xinchi Qiu Dongqi Cai Yan Gao Nicholas D. Lane VLM 608 1 0 07 Oct 2024
CiMaTe: Citation Count Prediction Effectively Leveraging the Main Text Jun Hirako Ryohei Sasano Koichi Takeda 107 3 0 06 Oct 2024
IndicSentEval: How Effectively do Multilingual Transformer Models encode Linguistic Properties for Indic Languages? Akhilesh Aravapalli Mounika Marreddy Subba Reddy Oota R. Mamidi Manish Gupta 89 0 0 03 Oct 2024
Concept Space Alignment in Multilingual LLMs Qiwei Peng Anders Søgaard 91 4 0 01 Oct 2024
PclGPT: A Large Language Model for Patronizing and Condescending Language Detection Hongbo Wang Mingda Li Junyu Lu Hebin Xia Liang Yang Bo Xu Ruizhu Liu Hongfei Lin 53 0 0 01 Oct 2024
How Transliterations Improve Crosslingual Alignment Yihong Liu Mingyang Wang Amir Hossein Kargaran Ayyoob Imani Orgest Xhelili Haotian Ye Chunlan Ma François Yvon Hinrich Schütze 89 4 0 25 Sep 2024
Mitigating Semantic Leakage in Cross-lingual Embeddings via Orthogonality Constraint Dayeon Ki Cheonbok Park H. Kim FedML 54 0 0 24 Sep 2024
DSG-KD: Knowledge Distillation from Domain-Specific to General Language Models Sangyeon Cho Jangyeong Jeon Dongjoon Lee Changhee Lee Junyeong Kim 56 1 0 23 Sep 2024
Goldfish: Monolingual Language Models for 350 Languages Tyler A. Chang Catherine Arnett Zhuowen Tu Benjamin Bergen LRM 129 10 0 19 Aug 2024
LogogramNLP: Comparing Visual and Textual Representations of Ancient Logographic Writing Systems for NLP Danlu Chen Freda Shi Aditi Agarwal Jacobo Myerston Taylor Berg-Kirkpatrick 77 2 0 08 Aug 2024
DanModCap: Designing a Danmaku Moderation Tool for Video-Sharing Platforms that Leverages Impact Captions Siying Hu Huanchen Wang Yu Zhang Piaohong Wang Zhicong Lu 43 0 0 05 Aug 2024
Investigating the Impact of Semi-Supervised Methods with Data Augmentation on Offensive Language Detection in Romanian Language Elena Beatrice Nicola Dumitru-Clementin Cercel Florin-Catalin Pop 71 1 0 29 Jul 2024
FarSSiBERT: A Novel Transformer-based Model for Semantic Similarity Measurement of Persian Social Networks Informal Texts Seyed Mojtaba Sadjadi Zeinab Rajabi Leila Rabiei M. Moin 60 2 0 27 Jul 2024
Fairness Definitions in Language Models Explained Thang Viet Doan Zhibo Chu Zichong Wang Wenbin Zhang ALM 103 10 0 26 Jul 2024
ALLaM: Large Language Models for Arabic and English M Saiful Bari Yazeed Alnumay Norah A. Alzahrani Nouf M. Alotaibi H. A. Alyahya ... Jeril Kuriakose Abdalghani Abujabal Nora Al-Twairesh Areeb Alowisheq Haidar Khan 68 17 0 22 Jul 2024
An Empirical Comparison of Vocabulary Expansion and Initialization Approaches for Language Models Nandini Mundra Aditya Nanda Kishore Raj Dabre Ratish Puduppully Anoop Kunchukuttan Mitesh Khapra 67 7 0 08 Jul 2024
Sociocultural Considerations in Monitoring Anti-LGBTQ+ Content on Social Media Sidney G. -J. Wong 51 0 0 01 Jul 2024
Cross-Lingual Transfer Learning for Speech Translation Rao Ma Yassir Fathullah Mengjie Qian Siyuan Tang Mark Gales Kate Knill 167 4 0 01 Jul 2024
Self-Translate-Train: A Simple but Strong Baseline for Cross-lingual Transfer of Large Language Models Ryokan Ri Shun Kiyono Sho Takase SyDa 47 0 0 29 Jun 2024
Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignment Orgest Xhelili Yihong Liu Hinrich Schütze 107 9 0 28 Jun 2024
Multilingual Knowledge Editing with Language-Agnostic Factual Neurons Xue Zhang Yunlong Liang Fandong Meng Songming Zhang Yufeng Chen Jinan Xu Jie Zhou KELM 72 9 0 24 Jun 2024
Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models Lynn Chua Badih Ghazi Yangsibo Huang Pritish Kamath Ravi Kumar Pasin Manurangsi Amer Sinha Chulin Xie Chiyuan Zhang 154 2 0 23 Jun 2024
Teaching LLMs to Abstain across Languages via Multilingual Feedback Shangbin Feng Weijia Shi Yike Wang Wenxuan Ding Orevaoghene Ahia Shuyue Stella Li Vidhisha Balachandran Sunayana Sitaram Yulia Tsvetkov 155 8 0 22 Jun 2024
On the Evaluation Practices in Multilingual NLP: Can Machine Translation Offer an Alternative to Human Translations? Rochelle Choenni Sara Rajaee Christof Monz Ekaterina Shutova 78 2 0 20 Jun 2024
AutoCAP: Towards Automatic Cross-lingual Alignment Planning for Zero-shot Chain-of-Thought Yongheng Zhang Qiguang Chen Min Li Wanxiang Che Libo Qin LRM 83 11 0 20 Jun 2024
Probing the Emergence of Cross-lingual Alignment during LLM Training Hetong Wang Pasquale Minervini Edoardo Ponti 131 15 0 19 Jun 2024
Synergizing Foundation Models and Federated Learning: A Survey Shenghui Li Fanghua Ye Meng Fang Jiaxu Zhao Yun-Hin Chan Edith C. -H. Ngai Thiemo Voigt AI4CE 120 7 0 18 Jun 2024
Multilingual Large Language Models and Curse of Multilinguality Daniil Gurgurov Tanja Bäumel Tatiana Anikina 137 7 0 15 Jun 2024
Investigating the translation capabilities of Large Language Models trained on parallel data only Javier García Gilabert Carlos Escolano Aleix Sant Savall Francesca de Luca Fornaciari Audrey Mash Xixian Liao Maite Melero LRM 119 2 0 13 Jun 2024
Decipherment-Aware Multilingual Learning in Jointly Trained Language Models Grandee Lee 72 0 0 11 Jun 2024
ThaiCoref: Thai Coreference Resolution Dataset Pontakorn Trakuekul Wei Qi Leong Charin Polpanumas Jitkapat Sawatphol William-Chandra Tjhi Attapol T. Rutherford 39 0 0 10 Jun 2024
An Open Multilingual System for Scoring Readability of Wikipedia Mykola Trokhymovych Indira Sen Martin Gerlach 76 5 0 03 Jun 2024
Improving Pseudo Labels with Global-Local Denoising Framework for Cross-lingual Named Entity Recognition Zhuojun Ding Wei Wei Xiaoye Qu Dangyang Chen 96 2 0 03 Jun 2024
Exploring Alignment in Shared Cross-lingual Spaces Basel Mousi Nadir Durrani Fahim Dalvi Majd Hawasly Ahmed Abdelali 90 2 0 23 May 2024
TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Data Yihong Liu Chunlan Ma Haotian Ye Hinrich Schütze 63 4 0 16 May 2024
For the Misgendered Chinese in Gender Bias Research: Multi-Task Learning with Knowledge Distillation for Pinyin Name-Gender Prediction Xiaocong Du Haipeng Zhang CVBM 56 1 0 10 May 2024
From Human Judgements to Predictive Models: Unravelling Acceptability in Code-Mixed Sentences Prashant Kodali Anmol Goel Likhith Asapu Vamshi Krishna Bonagiri Anirudh Govil Monojit Choudhury Manish Shrivastava Ponnurangam Kumaraguru 74 4 0 09 May 2024
Vietnamese AI Generated Text Detection Quang-Dan Tran Van-Quan Nguyen Quang-Huy Pham K. B. T. Nguyen Trong-Hop Do DeLMO 42 1 0 06 May 2024
Unknown Script: Impact of Script on Cross-Lingual Transfer Wondimagegnhue Tufa Ilia Markov Piek Vossen 89 1 0 29 Apr 2024
Interpreting Answers to Yes-No Questions in Dialogues from Multiple Domains Zijie Wang Farzana Rashid Eduardo Blanco 65 0 0 25 Apr 2024
Understanding the role of FFNs in driving multilingual behaviour in LLMs Sunit Bhattacharya Ondrej Bojar 63 4 0 22 Apr 2024
mOthello: When Do Cross-Lingual Representation Alignment and Cross-Lingual Transfer Emerge in Multilingual Models? Tianze Hua Tian Yun Ellie Pavlick LRM 63 11 0 18 Apr 2024
Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignment Zhaofeng Wu Ananth Balashankar Yoon Kim Jacob Eisenstein Ahmad Beirami 115 15 0 18 Apr 2024
Neuron Specialization: Leveraging intrinsic task modularity for multilingual machine translation Shaomu Tan Di Wu Christof Monz MoMe 110 9 0 17 Apr 2024
ViTextVQA: A Large-Scale Visual Question Answering Dataset for Evaluating Vietnamese Text Comprehension in Images Quan Van Nguyen Dan Quang Tran Huy Quang Pham Thang Kien-Bao Nguyen Nghia Hieu Nguyen Kiet Van Nguyen Ngan Luu-Thuy Nguyen CoGe 168 5 0 16 Apr 2024
Measuring Cross-lingual Transfer in Bytes Leandro Rodrigues de Souza Thales Sales Almeida R.A. Lotufo Rodrigo Nogueira CLL 49 3 0 12 Apr 2024
The Role of Language Imbalance in Cross-lingual Generalisation: Insights from Cloned Language Experiments Anton Schäfer Shauli Ravfogel Thomas Hofmann Tiago Pimentel Imanol Schlag 130 3 0 11 Apr 2024