Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT

19 April 2019

Papers citing "Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT"

35 / 185 papers shown

Title
Finding Universal Grammatical Relations in Multilingual BERT Ethan A. Chi John Hewitt Christopher D. Manning 18 151 0 09 May 2020
From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers Anne Lauscher Vinit Ravishankar Ivan Vulić Goran Glavaš 32 56 0 01 May 2020
Don't Use English Dev: On the Zero-Shot Cross-Lingual Evaluation of Contextual Embeddings Phillip Keung Y. Lu Julian Salazar Vikas Bhardwaj 35 14 0 30 Apr 2020
UDapter: Language Adaptation for Truly Universal Dependency Parsing Ahmet Üstün Arianna Bisazza G. Bouma Gertjan van Noord 27 113 0 29 Apr 2020
Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual Learning Zihan Liu Genta Indra Winata Andrea Madotto Pascale Fung CLL 51 18 0 29 Apr 2020
Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language Qianhui Wu Zijia Lin Börje F. Karlsson Jian-Guang Lou Biqing Huang 24 69 0 26 Apr 2020
A Study of Cross-Lingual Ability and Language-specific Information in Multilingual BERT Chi-Liang Liu Tsung-Yuan Hsu Yung-Sung Chuang Hung-yi Lee 34 14 0 20 Apr 2020
Balancing Training for Multilingual Neural Machine Translation Xinyi Wang Yulia Tsvetkov Graham Neubig 26 99 0 14 Apr 2020
On the Language Neutrality of Pre-trained Multilingual Representations Jindrich Libovický Rudolf Rosa Alexander Fraser 25 101 0 09 Apr 2020
Structure-Level Knowledge Distillation For Multilingual Sequence Labeling Xinyu Wang Yong-jia Jiang Nguyen Bach Tao Wang Fei Huang Kewei Tu 35 36 0 08 Apr 2020
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu Sebastian Ruder Aditya Siddhant Graham Neubig Orhan Firat Melvin Johnson ELM 98 957 0 24 Mar 2020
X-Stance: A Multilingual Multi-Target Dataset for Stance Detection Jannis Vamvas Rico Sennrich 29 84 0 18 Mar 2020
Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity Ivan Vulić Simon Baker Edoardo Ponti Ulla Petti Ira Leviant ... Eden Bar Matt Malone Thierry Poibeau Roi Reichart Anna Korhonen 26 82 0 10 Mar 2020
Sensitive Data Detection and Classification in Spanish Clinical Text: Experiments with BERT Aitor García-Pablos Naiara Pérez Montse Cuadros 37 34 0 06 Mar 2020
PhoBERT: Pre-trained language models for Vietnamese Dat Quoc Nguyen A. Nguyen 174 343 0 02 Mar 2020
From English To Foreign Languages: Transferring Pre-trained Language Models Ke M. Tran 30 49 0 18 Feb 2020
RobBERT: a Dutch RoBERTa-based Language Model Pieter Delobelle Thomas Winters Bettina Berendt 18 233 0 17 Jan 2020
BERTje: A Dutch BERT Model Wietse de Vries Andreas van Cranenburgh Arianna Bisazza Tommaso Caselli Gertjan van Noord Malvina Nissim VLM SSeg 25 291 0 19 Dec 2019
Cross-Lingual Ability of Multilingual BERT: An Empirical Study Karthikeyan K Zihan Wang Stephen D. Mayhew Dan Roth LRM 36 333 0 17 Dec 2019
Enhanced Meta-Learning for Cross-lingual Named Entity Recognition with Minimal Resources Qianhui Wu Zijia Lin Guoxin Wang Hui Chen Börje F. Karlsson Biqing Huang Chin-Yew Lin 22 68 0 14 Nov 2019
Can Monolingual Pretrained Models Help Cross-Lingual Classification? Zewen Chi Li Dong Furu Wei Xian-Ling Mao Heyan Huang LRM VLM 30 13 0 10 Nov 2019
CamemBERT: a Tasty French Language Model Louis Martin Benjamin Muller Pedro Ortiz Suarez Yoann Dupont Laurent Romary Eric Villemonte de la Clergerie Djamé Seddah Benoît Sagot 42 956 0 10 Nov 2019
How Language-Neutral is Multilingual BERT? Jindrich Libovický Rudolf Rosa Alexander Fraser 21 115 0 08 Nov 2019
Phenotyping of Clinical Notes with Improved Document Classification Models Using Contextualized Neural Language Models Andriy Mulyar Elliot Schumacher Masoud Rouhizadeh Mark Dredze 24 39 0 30 Oct 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 28 780 0 25 Oct 2019
Cross-Lingual Natural Language Generation via Pre-Training Zewen Chi Li Dong Furu Wei Wenhui Wang Xian-Ling Mao Heyan Huang 27 136 0 23 Sep 2019
Zero-shot Reading Comprehension by Cross-lingual Transfer Learning with Multi-lingual Language Representation Model Tsung-Yuan Hsu Chi-Liang Liu Hung-yi Lee 26 60 0 15 Sep 2019
Investigating Multilingual NMT Representations at Scale Sneha Kudugunta Ankur Bapna Isaac Caswell N. Arivazhagan Orhan Firat LRM 144 121 0 05 Sep 2019
Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks Haoyang Huang Yaobo Liang Nan Duan Ming Gong Linjun Shou Daxin Jiang M. Zhou 47 230 0 03 Sep 2019
Cross-Lingual Syntactic Transfer through Unsupervised Adaptation of Invertible Projections Junxian He Zhisong Zhang Taylor Berg-Kirkpatrick Graham Neubig 33 21 0 06 Jun 2019
75 Languages, 1 Model: Parsing Universal Dependencies Universally Dan Kondratyuk Milan Straka 39 263 0 03 Apr 2019
Exploiting Cross-Lingual Subword Similarities in Low-Resource Document Classification Mozhi Zhang Yoshinari Fujinuma Jordan L. Boyd-Graber 19 21 0 22 Dec 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 304 7,005 0 20 Apr 2018
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 189 1,639 0 11 Oct 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhehuai Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 718 6,750 0 26 Sep 2016