How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 671 papers shown

Title
El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsing Arash Einolghozati Abhinav Arora Lorena Sainz-Maza Lecanda Anuj Kumar Sonal Gupta 112 9 0 26 Jan 2021
Meta-Learning for Effective Multi-task and Multilingual Modelling Ishan Tarunesh Sushil Khyalia Vishwajeet Kumar Ganesh Ramakrishnan Preethi Jyothi 81 16 0 25 Jan 2021
Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval Robert Litschko Ivan Vulić Simone Paolo Ponzetto Goran Glavaš 74 23 0 21 Jan 2021
Experimental Evaluation of Deep Learning models for Marathi Text Classification Atharva Kulkarni Meet Mandhane Manali Likhitkar G. Kshirsagar J. Jagdale Raviraj Joshi 101 29 0 13 Jan 2021
A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters Mengjie Zhao Yi Zhu Ehsan Shareghi Ivan Vulić Roi Reichart Anna Korhonen Hinrich Schütze 112 64 0 31 Dec 2020
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models Phillip Rust Jonas Pfeiffer Ivan Vulić Sebastian Ruder Iryna Gurevych 166 256 0 31 Dec 2020
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 114 133 0 31 Dec 2020
Evaluating Cross-Lingual Transfer Learning Approaches in Multilingual Conversational Agent Models Lizhen Tan O. Yu. Golovneva 92 2 0 07 Dec 2020
Towards Label-Agnostic Emotion Embeddings Sven Buechel Luise Modersohn U. Hahn 59 10 0 01 Dec 2020
Enhancing deep neural networks with morphological information Matej Klemen Luka Krsnik Marko Robnik-Šikonja 88 12 0 24 Nov 2020
CalibreNet: Calibration Networks for Multilingual Sequence Labeling Shining Liang Linjun Shou J. Pei Ming Gong Wanli Zuo Daxin Jiang 69 8 0 11 Nov 2020
Multilingual AMR-to-Text Generation Angela Fan Claire Gardent 51 33 0 10 Nov 2020
To What Degree Can Language Borders Be Blurred In BERT-based Multilingual Spoken Language Understanding? Q. Do Judith Gaspers Tobias Röding Melanie Bradford 59 4 0 10 Nov 2020
Low-Resource Adaptation of Neural NLP Models Farhad Nooralahzadeh 83 0 0 09 Nov 2020
Entity Linking in 100 Languages Jan A. Botha Zifei Shan D. Gillick VLM 57 78 0 05 Nov 2020
MTLB-STRUCT @PARSEME 2020: Capturing Unseen Multiword Expressions Using Multi-task Learning and Pre-trained Masked Language Models Shiva Taslimipoor S. Bahaadini E. Kochmar 46 27 0 04 Nov 2020
Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages Kushal Kumar Jain Adwait Deshpande Kumar Shridhar F. Laumann Ayushman Dash 78 52 0 04 Nov 2020
Probing Multilingual BERT for Genetic and Typological Signals Taraka Rama Lisa Beinborn Steffen Eger 63 25 0 04 Nov 2020
TransQuest: Translation Quality Estimation with Cross-lingual Transformers Tharindu Ranasinghe Constantin Orasan R. Mitkov ViT 109 110 0 01 Nov 2020
RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark Tatiana Shavrina Alena Fenogenova Anton A. Emelyanov Denis Shevelev Ekaterina Artemova Valentin Malykh Vladislav Mikhailov Maria Tikhonova Andrey Chertok Andrey Evlampiev VLM ELM 89 82 0 29 Oct 2020
Cross-lingual Machine Reading Comprehension with Language Branch Knowledge Distillation Junhao Liu Linjun Shou J. Pei Ming Gong Min Yang Daxin Jiang 70 13 0 27 Oct 2020
UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models Mircea-Adrian Tanase Dumitru-Clementin Cercel Costin-Gabriel Chiru 42 15 0 26 Oct 2020
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models Benjamin Muller Antonis Anastasopoulos Benoît Sagot Djamé Seddah LRM 215 170 0 24 Oct 2020
Rethinking embedding coupling in pre-trained language models Hyung Won Chung Thibault Févry Henry Tsai Melvin Johnson Sebastian Ruder 177 143 0 24 Oct 2020
DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionaries Aditi Chaudhary K. Raman Krishna Srinivasan Jiecao Chen 81 25 0 23 Oct 2020
Multilingual BERT Post-Pretraining Alignment Lin Pan Chung-Wei Hang Haode Qi Abhishek Shah Saloni Potdar Mo Yu 177 44 0 23 Oct 2020
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond Xin Li Lidong Bing Wenxuan Zhang Zheng Li Wai Lam 125 25 0 23 Oct 2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 349 301 0 23 Oct 2020
Towards Fully Bilingual Deep Language Modeling Li-Hsin Chang S. Pyysalo Jenna Kanerva Filip Ginter 67 3 0 22 Oct 2020
What makes multilingual BERT multilingual? Chi-Liang Liu Tsung-Yuan Hsu Yung-Sung Chuang Hung-yi Lee 66 6 0 20 Oct 2020
Looking for Clues of Language in Multilingual BERT to Improve Cross-lingual Generalization Chi-Liang Liu Tsung-Yuan Hsu Yung-Sung Chuang Chung-Yi Li Hung-yi Lee 61 3 0 20 Oct 2020
Cross-Lingual Transfer in Zero-Shot Cross-Language Entity Linking Elliot Schumacher J. Mayfield Mark Dredze 19 6 0 19 Oct 2020
The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classification Abdullatif Köksal Arzucan Özgür 89 19 0 19 Oct 2020
Mixed-Lingual Pre-training for Cross-lingual Summarization Ruochen Xu Chenguang Zhu Yu Shi Michael Zeng Xuedong Huang 57 26 0 18 Oct 2020
TweetBERT: A Pretrained Language Representation Model for Twitter Text Analysis Mohiuddin Md Abdul Qudar Vijay K. Mago SSeg 52 38 0 17 Oct 2020
Cross-Lingual Relation Extraction with Transformers Jian Ni Taesun Moon Parul Awasthy Radu Florian ViT 35 6 0 16 Oct 2020
Delaying Interaction Layers in Transformer-based Encoders for Efficient Open Domain Question Answering W. Siblini Mohamed Challal Charlotte Pasqual 56 3 0 16 Oct 2020
It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT Hila Gonen Shauli Ravfogel Yanai Elazar Yoav Goldberg 64 51 0 16 Oct 2020
Explicit Alignment Objectives for Multilingual Bidirectional Encoders Junjie Hu Melvin Johnson Orhan Firat Aditya Siddhant Graham Neubig 70 58 0 15 Oct 2020
No Rumours Please! A Multi-Indic-Lingual Approach for COVID Fake-Tweet Detection Debanjana Kar M. Bhardwaj Suranjana Samanta A. Azad 99 66 0 14 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 391 628 0 13 Oct 2020
Modeling the Music Genre Perception across Language-Bound Cultures Elena V. Epure Guillaume Salha-Galvan Manuel Moussallam Romain Hennequin 40 5 0 13 Oct 2020
Model Selection for Cross-Lingual Transfer Yang Chen Alan Ritter 78 12 0 13 Oct 2020
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models Zirui Wang Yulia Tsvetkov Orhan Firat Yuan Cao 85 203 0 12 Oct 2020
Multilingual Offensive Language Identification with Cross-lingual Embeddings Tharindu Ranasinghe Marcos Zampieri 58 156 0 11 Oct 2020
Detecting Foodborne Illness Complaints in Multiple Languages Using English Annotations Only Ziyi Liu Giannis Karamanolakis Daniel J. Hsu Luis Gravano 15 1 0 11 Oct 2020
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor Xinyu Wang Yong Jiang Zhaohui Yan Zixia Jia Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 84 10 0 10 Oct 2020
Automated Concatenation of Embeddings for Structured Prediction Xinyu Wang Yong Jiang Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 109 177 0 10 Oct 2020
Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task Thibault Sellam Amy Pu Hyung Won Chung Sebastian Gehrmann Qijun Tan Markus Freitag Dipanjan Das Ankur P. Parikh VLM 78 37 0 08 Oct 2020
Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages Michael A. Hedderich David Ifeoluwa Adelani D. Zhu Jesujoba Oluwadara Alabi Udia Markus Dietrich Klakow 77 74 0 07 Oct 2020