How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 671 papers shown

Title
Småprat: DialoGPT for Natural Language Generation of Swedish Dialogue by Transfer Learning Tosin Adewumi Rickard Brannvall Nosheen Abid M. Pahlavan Sana Sabah Sabry F. Liwicki Marcus Liwicki 50 21 0 12 Oct 2021
An Isotropy Analysis in the Multilingual BERT Embedding Space S. Rajaee Mohammad Taher Pilehvar 123 34 0 09 Oct 2021
Multilingual Counter Narrative Type Classification Yi-Ling Chung Marco Guerini Rodrigo Agerri 365 15 0 28 Sep 2021
Exploring Teacher-Student Learning Approach for Multi-lingual Speech-to-Intent Classification Bidisha Sharma Maulik C. Madhavi Xuehao Zhou Haizhou Li 52 2 0 28 Sep 2021
Rumour Detection via Zero-shot Cross-lingual Transfer Learning Lin Tian Xiuzhen Zhang Jey Han Lau 66 13 0 27 Sep 2021
On the Prunability of Attention Heads in Multilingual BERT Aakriti Budhraja Madhura Pande Pratyush Kumar Mitesh M. Khapra 72 4 0 26 Sep 2021
Cross-Lingual Language Model Meta-Pretraining Zewen Chi Heyan Huang Luyang Liu Yu Bai Xian-Ling Mao LRM 210 0 0 23 Sep 2021
Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages Tejas I. Dhamecha V. Rudramurthy Samarth Bharadwaj Karthik Sankaranarayanan P. Bhattacharyya 95 26 0 22 Sep 2021
BERT Cannot Align Characters Antonis Maronikolakis Philipp Dufter Hinrich Schütze 55 0 0 20 Sep 2021
Locating Language-Specific Information in Contextualized Embeddings Sheng Liang Philipp Dufter Hinrich Schütze 52 8 0 16 Sep 2021
Cross-lingual Transfer of Monolingual Models Evangelia Gogoulou Ariel Ekgren T. Isbister Magnus Sahlgren 88 18 0 15 Sep 2021
Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation Ke Min Wang Yangbin Shi Jiayi Wang Yuqi Zhang Yu Zhao Xiaolin Zheng 75 6 0 15 Sep 2021
On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning Marc Tanti Lonneke van der Plas Claudia Borg Albert Gatt 80 11 0 14 Sep 2021
A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Space Alex Jones Wenjie Wang Kyle Mahowald 72 8 0 13 Sep 2021
xGQA: Cross-Lingual Visual Question Answering Jonas Pfeiffer Gregor Geigle Aishwarya Kamath Jan-Martin O. Steitz Stefan Roth Ivan Vulić Iryna Gurevych 115 62 0 13 Sep 2021
Wine is Not v i n. -- On the Compatibility of Tokenizations Across Languages Antonis Maronikolakis Philipp Dufter Hinrich Schütze 78 17 0 13 Sep 2021
The Impact of Positional Encodings on Multilingual Compression Vinit Ravishankar Anders Søgaard 60 5 0 11 Sep 2021
We went to look for meaning and all we got were these lousy representations: aspects of meaning representation for computational semantics Simon Dobnik R. Cooper Adam Ek Bill Noble Staffan Larsson N. Ilinykh Vladislav Maraev Vidya Somashekarappa 64 0 0 10 Sep 2021
Examining Cross-lingual Contextual Embeddings with Orthogonal Structural Probes Tomasz Limisiewicz David Marevcek 27 3 0 10 Sep 2021
Subword Mapping and Anchoring across Languages Giorgos Vernikos Andrei Popescu-Belis 112 12 0 09 Sep 2021
Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach Koren Lazar Benny Saret Asaf Yehudai W. Horowitz N. Wasserman Gabriel Stanovsky 71 23 0 09 Sep 2021
Distributionally Robust Multilingual Machine Translation Chunting Zhou Daniel Levy Xian Li Marjan Ghazvininejad Graham Neubig 139 24 0 09 Sep 2021
Discrete and Soft Prompting for Multilingual Models Mengjie Zhao Hinrich Schütze LRM 92 72 0 08 Sep 2021
Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval Zhiqi Huang Hamed Bonab Sheikh Muhammad Sarwar Razieh Rahimi James Allan 95 11 0 07 Sep 2021
Nearest Neighbour Few-Shot Learning for Cross-lingual Classification M Saiful Bari Batool Haider Saab Mansour VLM 36 14 0 06 Sep 2021
Discovering Representation Sprachbund For Multilingual Pre-Training Yiming Fan Yaobo Liang Alexandre Muzio Hany Hassan Houqiang Li Ming Zhou Nan Duan 60 10 0 01 Sep 2021
Cross-Lingual Text Classification of Transliterated Hindi and Malayalam Jitin Krishnan Antonios Anastasopoulos Hemant Purohit Huzefa Rangwala 43 15 0 31 Aug 2021
Transfer Learning for Multi-lingual Tasks -- a Survey A. Jafari Behnam Heidary R. Farahbakhsh Mostafa Salehi Mahdi Jalili LRM 51 5 0 28 Aug 2021
UzBERT: pretraining a BERT model for Uzbek B. Mansurov A. Mansurov VLM 53 13 0 22 Aug 2021
Not All Linearizations Are Equally Data-Hungry in Sequence Labeling Parsing Alberto Muñoz-Ortiz Michalina Strzyz David Vilares 61 9 0 17 Aug 2021
Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion Alessandro Suglia Qiaozi Gao Jesse Thomason Govind Thattai Gaurav Sukhatme LM&Ro 127 78 0 10 Aug 2021
Hope Speech detection in under-resourced Kannada language Adeep Hande R. Priyadharshini Anbukkarasi Sampath K. Thamburaj Prabakaran Chandran Bharathi Raja Chakravarthi 60 29 0 10 Aug 2021
Do Images really do the Talking? Analysing the significance of Images in Tamil Troll meme classification Siddhanth U Hegde Adeep Hande R. Priyadharshini Sajeetha Thavareesan Ratnasingam Sakuntharaj S. Thangasamy B. Bharathi Bharathi Raja Chakravarthi 67 7 0 09 Aug 2021
PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining Machel Reid Mikel Artetxe VLM 96 28 0 04 Aug 2021
Transfer Learning for Mining Feature Requests and Bug Reports from Tweets and App Store Reviews Pablo Restrepo Henao Jannik Fischbach Dominik Spies Julian Frattini Andreas Vogelsang 45 26 0 02 Aug 2021
The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding Archiki Prasad Mohammad Ali Rehan Shreyasi Pathak Preethi Jyothi 60 9 0 21 Jul 2021
From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text Ishan Tarunesh Syamantak Kumar Preethi Jyothi 96 46 0 14 Jul 2021
A Primer on Pretrained Multilingual Language Models Sumanth Doddapaneni Gowtham Ramesh Mitesh M. Khapra Anoop Kunchukuttan Pratyush Kumar LRM 119 76 0 01 Jul 2021
Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer Iulia Turc Kenton Lee Jacob Eisenstein Ming-Wei Chang Kristina Toutanova 49 58 0 30 Jun 2021
It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense Reasoning Alexey Tikhonov Max Ryabinin LRM 57 64 0 22 Jun 2021
Phrase-level Active Learning for Neural Machine Translation Junjie Hu Graham Neubig AI4CE 122 13 0 21 Jun 2021
Specializing Multilingual Language Models: An Empirical Study Ethan C. Chau Noah A. Smith 127 27 0 16 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 174 863 0 14 Jun 2021
Assessing Multilingual Fairness in Pre-trained Multimodal Representations Jialu Wang Yang Liu Xinze Wang EGVM 102 37 0 12 Jun 2021
CodemixedNLP: An Extensible and Open NLP Toolkit for Code-Mixing Sai Muralidhar Jayanthi Kavya Nerella Khyathi Chandu A. Black MoE 73 8 0 10 Jun 2021
AMU-EURANOVA at CASE 2021 Task 1: Assessing the stability of multilingual BERT Léo Bouscarrat Antoine Bonnefoy Cécile Capponi Carlos Ramisch 48 3 0 10 Jun 2021
Crosslingual Embeddings are Essential in UNMT for Distant Languages: An English to IndoAryan Case Study Tamali Banerjee V. Rudra Murthy P. Bhattacharyya 74 9 0 09 Jun 2021
Probing Multilingual Language Models for Discourse Murathan Kurfali Robert Östling 72 17 0 09 Jun 2021
Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language Inference Hai Hu He Zhou Zuoyu Tian Yiwen Zhang Yina Ma Yanting Li Yixin Nie Kyle Richardson 61 11 0 07 Jun 2021
Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study Yash Khemchandani Sarvesh Mehtani Vaidehi Patil Abhijeet Awasthi Partha P. Talukdar Sunita Sarawagi 76 32 0 07 Jun 2021