How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 671 papers shown

Title
"Diversity and Uncertainty in Moderation" are the Key to Data Selection for Multilingual Few-shot Transfer Shanu Kumar Sandipan Dandapat Monojit Choudhury 75 6 0 30 Jun 2022
Extreme compression of sentence-transformer ranker models: faster inference, longer battery life, and less storage on edge devices Amit Chaulwar Lukas Malik Maciej Krajewski Felix Reichel Leif-Nissen Lundbæk M. Huth B. Matejczyk VLM 32 3 0 29 Jun 2022
SPBERTQA: A Two-Stage Question Answering System Based on Sentence Transformers for Medical Texts N. T. Nguyen Phuong Phan-Dieu Ha Luan Thanh Nguyen Kiet Van Nguyen Ngan Luu-Thuy Nguyen MedIm 45 11 0 20 Jun 2022
BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformers Shaz Furniturewala V. Kumari Amulya Ratna Dash Hriday Kedia Yashvardhan Sharma 58 2 0 17 Jun 2022
PreCogIIITH at HinglishEval : Leveraging Code-Mixing Metrics & Language Model Embeddings To Estimate Code-Mix Quality Prashant Kodali Tanmay Sachan Akshay Goindani Anmol Goel Naman Ahuja Manish Shrivastava Ponnurangam Kumaraguru 46 2 0 16 Jun 2022
1Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Task Zhiyong Wang Ge Zhang Nineli Lashkarashvili 60 3 0 08 Jun 2022
Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detection J. Eronen M. Ptaszynski Fumito Masui Masaki Arata Gniewosz Leliwa Michal Wroczynski 81 32 0 02 Jun 2022
Punctuation Restoration in Spanish Customer Support Transcripts using Transfer Learning Xiliang Zhu Shayna Gardiner David Rossouw T. Roldán Simon Corston-Oliver 62 1 0 27 May 2022
Discovering Language-neutral Sub-networks in Multilingual Language Models Negar Foroutan Mohammadreza Banaei R. Lebret Antoine Bosselut Karl Aberer LRM 126 25 0 25 May 2022
Analysing the Greek Parliament Records with Emotion Classification John Pavlopoulos Vanessa Lislevand 52 2 0 24 May 2022
Word-order typology in Multilingual BERT: A case study in subordinate-clause detection Dmitry Nikolaev Sebastian Padó 55 6 0 24 May 2022
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models Terra Blevins Hila Gonen Luke Zettlemoyer LRM 119 31 0 24 May 2022
The Geometry of Multilingual Language Model Representations Tyler A. Chang Zhuowen Tu Benjamin Bergen 108 69 0 22 May 2022
Phylogeny-Inspired Adaptation of Multilingual Models to New Languages Fahim Faisal Antonios Anastasopoulos AI4CE LRM 99 27 0 19 May 2022
OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrieval Tong Niu Kazuma Hashimoto Yingbo Zhou Caiming Xiong VLM 47 5 0 17 May 2022
Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT Beiduo Chen Wu Guo Quan Liu Kun Tao 76 1 0 17 May 2022
TiBERT: Tibetan Pre-trained Language Model Yuan Sun Sisi Liu Junjie Deng Xiaobing Zhao 94 10 0 15 May 2022
Domain Adaptation in Multilingual and Multi-Domain Monolingual Settings for Complex Word Identification George-Eduard Zaharia Razvan-Alexandru Smadu Dumitru-Clementin Cercel M. Dascalu 91 3 0 15 May 2022
Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages Kabir Ahuja Sandipan Dandapat Sunayana Sitaram Monojit Choudhury LRM 95 16 0 12 May 2022
On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data Kabir Ahuja Monojit Choudhury Sandipan Dandapat 58 3 0 12 May 2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers Jonas Pfeiffer Naman Goyal Xi Lin Xian Li James Cross Sebastian Riedel Mikel Artetxe LRM 103 146 0 12 May 2022
Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models Kabir Ahuja Shanu Kumar Sandipan Dandapat Monojit Choudhury 57 25 0 12 May 2022
A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank Daniel Malkin Tomasz Limisiewicz Gabriel Stanovsky 80 24 0 09 May 2022
Bridging the Domain Gap for Stance Detection for the Zulu language Gcinizwe Dlamini I. E. I. Bekkouch A. Khan Leon Derczynski 34 3 0 06 May 2022
Same Neurons, Different Languages: Probing Morphosyntax in Multilingual Pre-trained Models Karolina Stañczak Edoardo Ponti Lucas Torroba Hennigen Ryan Cotterell Isabelle Augenstein MILM LRM 96 10 0 04 May 2022
Por Qué Não Utiliser Alla Språk? Mixed Training with Gradient Optimization in Few-Shot Cross-Lingual Transfer Haoran Xu Kenton W. Murray 81 12 0 29 Apr 2022
Translation between Molecules and Natural Language Carl Edwards T. Lai Kevin Ros Garrett Honke Kyunghyun Cho Heng Ji 136 172 0 25 Apr 2022
Cross-Lingual Query-Based Summarization of Crisis-Related Social Media: An Abstractive Approach Using Transformers Fedor Vitiugin Carlos Castillo 60 12 0 21 Apr 2022
You Are What You Write: Preserving Privacy in the Era of Large Language Models Richard Plant V. Giuffrida Dimitra Gkatzia PILM 97 19 0 20 Apr 2022
Analyzing Gender Representation in Multilingual Models Hila Gonen Shauli Ravfogel Yoav Goldberg 51 12 0 20 Apr 2022
ALBETO and DistilBETO: Lightweight Spanish Language Models J. Canete S. Donoso Felipe Bravo-Marquez Andrés Carvallo Vladimir Araujo 74 21 0 19 Apr 2022
IndicXNLI: Evaluating Multilingual Inference for Indian Languages Divyanshu Aggarwal V. Gupta Anoop Kunchukuttan 79 28 0 19 Apr 2022
Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi Abhishek Velankar H. Patil Raviraj Joshi 88 33 0 19 Apr 2022
MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages Jack G. M. FitzGerald C. Hench Charith Peris Scott Mackie Kay Rottmann ... Laurie Crist Misha Britan Wouter Leeuwis Gokhan Tur Premkumar Natarajan 91 136 0 18 Apr 2022
L3Cube-HingCorpus and HingBERT: A Code Mixed Hindi-English Dataset and BERT Language Models Ravindra Nayak Raviraj Joshi 59 42 0 18 Apr 2022
AfriWOZ: Corpus for Exploiting Cross-Lingual Transferability for Generation of Dialogues in Low-Resource, African Languages Tosin Adewumi Mofetoluwa Adeyemi Aremu Anuoluwapo Bukola Peters Happy Buzaaba ... Phylis Ngigi Orevaoghene Ahia Ruqayya Nasir F. Liwicki Marcus Liwicki 42 1 0 17 Apr 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 128 155 0 15 Apr 2022
The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer Pavel Efimov Leonid Boytsov E. Arslanova Pavel Braslavski 56 7 0 13 Apr 2022
IIITDWD-ShankarB@ Dravidian-CodeMixi-HASOC2021: mBERT based model for identification of offensive content in south Indian languages Shankar Biradar Sunil Saumya 44 10 0 13 Apr 2022
L3Cube-MahaNER: A Marathi Named Entity Recognition Dataset and BERT models Parth Patil Aparna Ranade Maithili Sabane Onkar Litake Raviraj Joshi 94 20 0 12 Apr 2022
Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling Nuo Chen Linjun Shou Ming Gong Jian Pei Daxin Jiang 65 10 0 11 Apr 2022
A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition Yuxuan Chen Jonas Mikkelsen Arne Binder Christoph Alt Leonhard Hennig 70 2 0 11 Apr 2022
Few-Shot Cross-lingual Transfer for Coarse-grained De-identification of Code-Mixed Clinical Texts Saadullah Amin N. Goldstein M. Wixted Alejandro García-Rudolph Catalina Martínez-Costa G. Neumann 71 5 0 10 Apr 2022
Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learning Wooyoung Kim Chaerin Jo Minjung Kim Wooju Kim 26 1 0 08 Apr 2022
BERTuit: Understanding Spanish language in Twitter through a native transformer Javier Huertas-Tato Alejandro Martín David Camacho 49 9 0 07 Apr 2022
Towards Best Practices for Training Multilingual Dense Retrieval Models Xinyu Crystina Zhang Kelechi Ogueji Xueguang Ma Jimmy J. Lin RALM 64 34 0 05 Apr 2022
On Efficiently Acquiring Annotations for Multilingual Models Joel Ruben Antony Moniz Barun Patra Matthew R. Gormley 80 7 0 03 Apr 2022
Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages Ehsan Aghazadeh Mohsen Fayyaz Yadollah Yaghoobzadeh 60 53 0 26 Mar 2022
Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferability Yoshinari Fujinuma Jordan L. Boyd-Graber Katharina Kann AAML 143 26 0 21 Mar 2022
Pretraining with Artificial Language: Studying Transferable Knowledge in Language Models Ryokan Ri Yoshimasa Tsuruoka 89 28 0 19 Mar 2022