How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 671 papers shown

Title
A Call for More Rigor in Unsupervised Cross-lingual Learning Mikel Artetxe Sebastian Ruder Dani Yogatama Gorka Labaka Eneko Agirre 78 72 0 30 Apr 2020
MLSUM: The Multilingual Summarization Corpus Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 96 177 0 30 Apr 2020
Universal Dependencies according to BERT: both more specific and more general Tomasz Limisiewicz Rudolf Rosa David Marevcek 74 18 0 30 Apr 2020
A Supervised Word Alignment Method based on Cross-Language Span Prediction using Multilingual BERT Masaaki Nagata Katsuki Chousa Masaaki Nishino 50 47 0 29 Apr 2020
End-to-End Slot Alignment and Recognition for Cross-Lingual NLU Weijia Xu Batool Haider Saab Mansour 77 155 0 29 Apr 2020
UDapter: Language Adaptation for Truly Universal Dependency Parsing Ahmet Üstün Arianna Bisazza G. Bouma Gertjan van Noord 74 117 0 29 Apr 2020
Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual Learning Zihan Liu Genta Indra Winata Andrea Madotto Pascale Fung CLL 92 18 0 29 Apr 2020
Enhancing Answer Boundary Detection for Multilingual Machine Reading Comprehension Fei Yuan Linjun Shou X. Bai Ming Gong Yaobo Liang Nan Duan Yan Fu Daxin Jiang 88 23 0 29 Apr 2020
Evaluating Transformer-Based Multilingual Text Classification Sophie Groenwold Samhita Honnavalli Li-hsueh Ou Aesha Parekh Sharon Levy Diba Mirza William Yang Wang 98 2 0 29 Apr 2020
Extending Multilingual BERT to Low-Resource Languages Zihan Wang Karthikeyan K Stephen D. Mayhew Dan Roth VLM 71 132 0 28 Apr 2020
UXLA: A Robust Unsupervised Data Augmentation Framework for Zero-Resource Cross-Lingual NLP M Saiful Bari Tasnim Mohiuddin Shafiq Joty 85 24 0 28 Apr 2020
GLUECoS : An Evaluation Benchmark for Code-Switched NLP Simran Khanuja Sandipan Dandapat A. Srinivasan Sunayana Sitaram Monojit Choudhury ELM 73 148 0 26 Apr 2020
QURIOUS: Question Generation Pretraining for Text Generation Shashi Narayan Gonçalo Simães Ji Ma Hannah Craighead Ryan T. McDonald 83 15 0 23 Apr 2020
When and Why is Unsupervised Neural Machine Translation Useless? Yunsu Kim Miguel Graça Hermann Ney SSL 97 71 0 22 Apr 2020
A Study of Cross-Lingual Ability and Language-specific Information in Multilingual BERT Chi-Liang Liu Tsung-Yuan Hsu Yung-Sung Chuang Hung-yi Lee 65 15 0 20 Apr 2020
The State and Fate of Linguistic Diversity and Inclusion in the NLP World Pratik M. Joshi Sebastin Santy A. Budhiraja Kalika Bali Monojit Choudhury LMTD 146 858 0 20 Apr 2020
What's so special about BERT's layers? A closer look at the NLP pipeline in monolingual and multilingual models Wietse de Vries Andreas van Cranenburgh Malvina Nissim MILM SSeg MoE 142 66 0 14 Apr 2020
LAReQA: Language-agnostic answer retrieval from a multilingual pool Uma Roy Noah Constant Rami Al-Rfou Aditya Barua Aaron B. Phillips Yinfei Yang RALM 65 56 0 11 Apr 2020
A New Dataset for Natural Language Inference from Code-mixed Conversations Simran Khanuja Sandipan Dandapat Sunayana Sitaram Monojit Choudhury 94 42 0 10 Apr 2020
On the Language Neutrality of Pre-trained Multilingual Representations Jindrich Libovický Rudolf Rosa Alexander Fraser 79 107 0 09 Apr 2020
Learning to Scale Multilingual Representations for Vision-Language Tasks Andrea Burns Donghyun Kim Derry Wijaya Kate Saenko Bryan A. Plummer 50 35 0 09 Apr 2020
Structure-Level Knowledge Distillation For Multilingual Sequence Labeling Xinyu Wang Yong Jiang Nguyen Bach Tao Wang Fei Huang Kewei Tu 96 36 0 08 Apr 2020
Dynamic Data Selection and Weighting for Iterative Back-Translation Zi-Yi Dou Antonios Anastasopoulos Graham Neubig 76 50 0 07 Apr 2020
Machine Translation Pre-training for Data-to-Text Generation -- A Case Study in Czech Mihir Kale Scott Roy 51 14 0 05 Apr 2020
Give your Text Representation Models some Love: the Case for Basque Rodrigo Agerri Iñaki San Vicente Jon Ander Campos Ander Barrena X. Saralegi Aitor Soroa Etxabe Eneko Agirre 56 63 0 31 Mar 2020
Understanding Cross-Lingual Syntactic Transfer in Multilingual Recurrent Neural Networks Prajit Dhar Arianna Bisazza 44 10 0 31 Mar 2020
BERT Fine-tuning For Arabic Text Summarization Khalid N. Elmadani Mukhtar Elgezouli Anas Showk 32 22 0 29 Mar 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 232 978 0 24 Mar 2020
Data-driven models and computational tools for neurolinguistics: a language technology perspective Ekaterina Artemova Amir Bakarov A. Artemov Evgeny Burnaev M. Sharaev 46 4 0 23 Mar 2020
Probing Word Translations in the Transformer and Trading Decoder for Encoder Layers Hongfei Xu Josef van Genabith Qiuhui Liu Deyi Xiong 30 3 0 21 Mar 2020
The value of text for small business default prediction: A deep learning approach Matthew Stevenson Christophe Mues Cristián Bravo 104 80 0 19 Mar 2020
X-Stance: A Multilingual Multi-Target Dataset for Stance Detection Jannis Vamvas Rico Sennrich 101 90 0 18 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 390 1,498 0 18 Mar 2020
XPersona: Evaluating Multilingual Personalized Chatbot Zhaojiang Lin Zihan Liu Genta Indra Winata Samuel Cahyawijaya Andrea Madotto Yejin Bang Etsuko Ishii Pascale Fung 115 60 0 17 Mar 2020
Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity Ivan Vulić Simon Baker Edoardo Ponti Ulla Petti Ira Leviant ... Eden Bar Matt Malone Thierry Poibeau Roi Reichart Anna Korhonen 90 83 0 10 Mar 2020
What the [MASK]? Making Sense of Language-Specific BERT Models Debora Nozza Federico Bianchi Dirk Hovy 162 108 0 05 Mar 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 137 1,511 0 27 Feb 2020
Language-Independent Tokenisation Rivals Language-Specific Tokenisation for Word Similarity Prediction Danushka Bollegala Ryuichi Kiryo K. Tsujino Haruki Yukawa 21 7 0 25 Feb 2020
What BERT Sees: Cross-Modal Transfer for Visual Question Generation Thomas Scialom Patrick Bordes Paul-Alexis Dray Jacopo Staiano Patrick Gallinari 55 6 0 25 Feb 2020
Contextual Lensing of Universal Sentence Representations J. Kiros 57 5 0 20 Feb 2020
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng ... Linjun Shou Bing Qin Ting Liu Daxin Jiang Ming Zhou 208 2,717 0 19 Feb 2020
Multilingual Alignment of Contextual Word Representations Steven Cao Nikita Kitaev Dan Klein 125 194 0 10 Feb 2020
Parameter Space Factorization for Zero-Shot Learning across Tasks and Languages Edoardo Ponti Ivan Vulić Ryan Cotterell Marinela Parović Roi Reichart Anna Korhonen BDL 114 29 0 30 Jan 2020
On the Importance of Word Order Information in Cross-lingual Sequence Labeling Zihan Liu Genta Indra Winata Samuel Cahyawijaya Andrea Madotto Zhaojiang Lin Pascale Fung 119 3 0 30 Jan 2020
Multilingual Denoising Pre-training for Neural Machine Translation Yinhan Liu Jiatao Gu Naman Goyal Xian Li Sergey Edunov Marjan Ghazvininejad M. Lewis Luke Zettlemoyer AI4CE AIMat 128 1,817 0 22 Jan 2020
Contextualized Embeddings in Named-Entity Recognition: An Empirical Study on Generalization Bruno Taillé Vincent Guigue Patrick Gallinari 83 26 0 22 Jan 2020
RobBERT: a Dutch RoBERTa-based Language Model Pieter Delobelle Thomas Winters Bettina Berendt 86 240 0 17 Jan 2020
A Comprehensive Survey of Multilingual Neural Machine Translation Raj Dabre Chenhui Chu Anoop Kunchukuttan LRM 116 33 0 04 Jan 2020
SberQuAD -- Russian Reading Comprehension Dataset: Description and Analysis Pavel Efimov Andrey Chertok Leonid Boytsov Pavel Braslavski 147 61 0 20 Dec 2019
Cross-Lingual Ability of Multilingual BERT: An Empirical Study Karthikeyan K Zihan Wang Stephen D. Mayhew Dan Roth LRM 96 340 0 17 Dec 2019