How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 657 papers shown

Title
OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrieval Tong Niu Kazuma Hashimoto Yingbo Zhou Caiming Xiong VLM 29 5 0 17 May 2022
Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT Beiduo Chen Wu Guo Quan Liu Kun Tao 43 1 0 17 May 2022
TiBERT: Tibetan Pre-trained Language Model Yuan Sun Sisi Liu Junjie Deng Xiaobing Zhao 69 9 0 15 May 2022
Domain Adaptation in Multilingual and Multi-Domain Monolingual Settings for Complex Word Identification George-Eduard Zaharia Razvan-Alexandru Smadu Dumitru-Clementin Cercel M. Dascalu 32 3 0 15 May 2022
Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages Kabir Ahuja Sandipan Dandapat Sunayana Sitaram Monojit Choudhury LRM 39 16 0 12 May 2022
On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data Kabir Ahuja Monojit Choudhury Sandipan Dandapat 29 3 0 12 May 2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers Jonas Pfeiffer Naman Goyal Xi Lin Xian Li James Cross Sebastian Riedel Mikel Artetxe LRM 40 139 0 12 May 2022
Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models Kabir Ahuja Shanu Kumar Sandipan Dandapat Monojit Choudhury 19 25 0 12 May 2022
A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank Daniel Malkin Tomasz Limisiewicz Gabriel Stanovsky 30 24 0 09 May 2022
Bridging the Domain Gap for Stance Detection for the Zulu language Gcinizwe Dlamini I. E. I. Bekkouch A. Khan Leon Derczynski 28 3 0 06 May 2022
Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models Karolina Stañczak Edoardo Ponti Lucas Torroba Hennigen Ryan Cotterell Isabelle Augenstein MILM LRM 38 10 0 04 May 2022
Por Qué Não Utiliser Alla Språk? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfer Haoran Xu Kenton W. Murray 32 12 0 29 Apr 2022
Translation between Molecules and Natural Language Carl Edwards T. Lai Kevin Ros Garrett Honke Kyunghyun Cho Heng Ji 33 158 0 25 Apr 2022
Cross-Lingual Query-Based Summarization of Crisis-Related Social Media: An Abstractive Approach Using Transformers Fedor Vitiugin Carlos Castillo 26 12 0 21 Apr 2022
You Are What You Write: Preserving Privacy in the Era of Large Language Models Richard Plant V. Giuffrida Dimitra Gkatzia PILM 40 19 0 20 Apr 2022
Analyzing Gender Representation in Multilingual Models Hila Gonen Shauli Ravfogel Yoav Goldberg 25 11 0 20 Apr 2022
ALBETO and DistilBETO: Lightweight Spanish Language Models J. Canete S. Donoso Felipe Bravo-Marquez Andrés Carvallo Vladimir Araujo 48 20 0 19 Apr 2022
IndicXNLI: Evaluating Multilingual Inference for Indian Languages Divyanshu Aggarwal V. Gupta Anoop Kunchukuttan 31 27 0 19 Apr 2022
Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi Abhishek Velankar H. Patil Raviraj Joshi 45 31 0 19 Apr 2022
MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages Jack G. M. FitzGerald C. Hench Charith Peris Scott Mackie Kay Rottmann ... Laurie Crist Misha Britan Wouter Leeuwis Gokhan Tur Premkumar Natarajan 23 126 0 18 Apr 2022
L3Cube-HingCorpus and HingBERT: A Code Mixed Hindi-English Dataset and BERT Language Models Ravindra Nayak Raviraj Joshi 25 41 0 18 Apr 2022
AfriWOZ: Corpus for Exploiting Cross-Lingual Transferability for Generation of Dialogues in Low-Resource, African Languages Tosin Adewumi Mofetoluwa Adeyemi Aremu Anuoluwapo Bukola Peters Happy Buzaaba ... Phylis Ngigi Orevaoghene Ahia Ruqayya Nasir F. Liwicki Marcus Liwicki 21 1 0 17 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 51 149 0 15 Apr 2022
The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer Pavel Efimov Leonid Boytsov E. Arslanova Pavel Braslavski 30 7 0 13 Apr 2022
IIITDWD-ShankarB@ Dravidian-CodeMixi-HASOC2021: mBERT based model for identification of offensive content in south Indian languages Shankar Biradar Sunil Saumya 22 10 0 13 Apr 2022
L3Cube-MahaNER: A Marathi Named Entity Recognition Dataset and BERT models Parth Patil Aparna Ranade Maithili Sabane Onkar Litake Raviraj Joshi 32 20 0 12 Apr 2022
Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling Nuo Chen Linjun Shou Ming Gong Jian Pei Daxin Jiang 27 10 0 11 Apr 2022
A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition Yuxuan Chen Jonas Mikkelsen Arne Binder Christoph Alt Leonhard Hennig 40 2 0 11 Apr 2022
Few-Shot Cross-lingual Transfer for Coarse-grained De-identification of Code-Mixed Clinical Texts Saadullah Amin N. Goldstein M. Wixted Alejandro García-Rudolph Catalina Martínez-Costa G. Neumann 25 5 0 10 Apr 2022
Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning Wooyoung Kim Chaerin Jo Minjung Kim Wooju Kim 24 1 0 08 Apr 2022
BERTuit: Understanding Spanish language in Twitter through a native transformer Javier Huertas-Tato Alejandro Martín David Camacho 26 9 0 07 Apr 2022
Towards Best Practices for Training Multilingual Dense Retrieval Models Xinyu Crystina Zhang Kelechi Ogueji Xueguang Ma Jimmy J. Lin RALM 32 34 0 05 Apr 2022
On Efficiently Acquiring Annotations for Multilingual Models Joel Ruben Antony Moniz Barun Patra Matthew R. Gormley 33 7 0 03 Apr 2022
Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages Ehsan Aghazadeh Mohsen Fayyaz Yadollah Yaghoobzadeh 33 51 0 26 Mar 2022
Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability Yoshinari Fujinuma Jordan L. Boyd-Graber Katharina Kann AAML 62 23 0 21 Mar 2022
Pretraining with Artificial Language: Studying Transferable Knowledge in Language Models Ryokan Ri Yoshimasa Tsuruoka 32 26 0 19 Mar 2022
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation Xinyi Wang Sebastian Ruder Graham Neubig 42 61 0 17 Mar 2022
Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation? E. Lee Sarubi Thillainathan Shravan Nayak Surangika Ranathunga David Ifeoluwa Adelani Ruisi Su Arya D. McCarthy VLM 21 43 0 16 Mar 2022
Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning Miryam de Lhoneux Shenmin Zhang Anders Søgaard 35 11 0 16 Mar 2022
Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure Yuan Chai Yaobo Liang Nan Duan LRM 27 21 0 16 Mar 2022
Does Corpus Quality Really Matter for Low-Resource Languages? Mikel Artetxe Itziar Aldabe Rodrigo Agerri Olatz Perez-de-Viñaspre Aitor Soroa Etxabe 49 19 0 15 Mar 2022
A new approach to calculating BERTScore for automatic assessment of translation quality A. Vetrov E. Gorn 21 1 0 10 Mar 2022
A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges Wenxuan Zhang Xin Li Yang Deng Lidong Bing W. Lam 48 242 0 02 Mar 2022
Multilingual Abusiveness Identification on Code-Mixed Social Media Text Ekagra Ranjan Naman Poddar 29 0 0 01 Mar 2022
Cross-Lingual Text Classification with Multilingual Distillation and Zero-Shot-Aware Training Ziqing Yang Yiming Cui Zhigang Chen Shijin Wang VLM 35 3 0 28 Feb 2022
Semi-Structured Query Grounding for Document-Oriented Databases with Deep Retrieval and Its Application to Receipt and POI Matching Geewook Kim Wonseok Hwang Minjoon Seo Seunghyun Park 28 0 0 23 Feb 2022
Delving Deeper into Cross-lingual Visual Question Answering Chen Cecilia Liu Jonas Pfeiffer Anna Korhonen Ivan Vulić Iryna Gurevych 37 8 0 15 Feb 2022
Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmark Jiaxi Gu Xiaojun Meng Guansong Lu Lu Hou Minzhe Niu ... Runhu Huang Wei Zhang Xingda Jiang Chunjing Xu Hang Xu VLM 48 88 0 14 Feb 2022
Toward a traceable, explainable, and fairJD/Resume recommendation system Amine Barrak Bram Adams Amal Zouaq 21 2 0 02 Feb 2022
L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resources Raviraj Joshi 51 52 0 02 Feb 2022