Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT

19 April 2019

Papers citing "Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT"

50 / 185 papers shown

Title
Specializing Multilingual Language Models: An Empirical Study Ethan C. Chau Noah A. Smith 27 27 0 16 Jun 2021
Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment Zewen Chi Li Dong Bo Zheng Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei 45 67 0 11 Jun 2021
AdvPicker: Effectively Leveraging Unlabeled Data via Adversarial Discriminator for Cross-Lingual NER Weile Chen Huiqiang Jiang Qianhui Wu Börje F. Karlsson Yingjun Guan 23 35 0 04 Jun 2021
Minimax and Neyman-Pearson Meta-Learning for Outlier Languages Edoardo Ponti Rahul Aralikatte Disha Shrivastava Siva Reddy Anders Søgaard 42 16 0 02 Jun 2021
Reinforced Iterative Knowledge Distillation for Cross-Lingual Named Entity Recognition Shining Liang Ming Gong J. Pei Linjun Shou Wanli Zuo Xianglin Zuo Daxin Jiang 39 34 0 01 Jun 2021
Cross-lingual Text Classification with Heterogeneous Graph Neural Network ZiYun Wang Xuan Liu Pei-Yin Yang Shixing Liu Zhisheng Wang 39 32 0 24 May 2021
Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining Ivana Kvapilíková Mikel Artetxe Gorka Labaka Eneko Agirre Ondrej Bojar SSL 24 36 0 21 May 2021
A cost-benefit analysis of cross-lingual transfer methods G. Rosa L. Bonifacio Leandro Rodrigues de Souza R. Lotufo Rodrigo Nogueira 32 12 0 14 May 2021
CLIPScore: A Reference-free Evaluation Metric for Image Captioning Jack Hessel Ari Holtzman Maxwell Forbes Ronan Le Bras Yejin Choi CLIP 17 1,454 0 18 Apr 2021
DiS-ReX: A Multilingual Dataset for Distantly Supervised Relation Extraction Abhyuday Bhartiya Kartikeya Badola Mausam 32 16 0 17 Apr 2021
AM2iCo: Evaluating Word Meaning in Context across Low-Resource Languages with Adversarial Examples Qianchu Liu Edoardo Ponti Diana McCarthy Ivan Vulić Anna Korhonen 35 17 0 17 Apr 2021
Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systems E. Razumovskaia Goran Glavaš Olga Majewska Edoardo Ponti Anna Korhonen Ivan Vulić 36 32 0 17 Apr 2021
A multilabel approach to morphosyntactic probing Naomi Tachikawa Shapiro Amandalynne Paullada Shane Steinert-Threlkeld 39 10 0 17 Apr 2021
MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning Mengzhou Xia Guoqing Zheng Subhabrata Mukherjee Milad Shokouhi Graham Neubig Ahmed Hassan Awadallah 30 31 0 16 Apr 2021
Code-Mixing on Sesame Street: Dawn of the Adversarial Polyglots Samson Tan Chenyu You AAML 39 35 0 17 Mar 2021
Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models Po-Yao (Bernie) Huang Mandela Patrick Junjie Hu Graham Neubig Florian Metze Alexander G. Hauptmann MLLM VLM 24 56 0 16 Mar 2021
The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models Go Inoue Bashar Alhafni Nurpeiis Baimukan Houda Bouamor Nizar Habash 35 226 0 11 Mar 2021
WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learning Krishna Srinivasan K. Raman Jiecao Chen Michael Bendersky Marc Najork VLM 213 310 0 02 Mar 2021
LOME: Large Ontology Multilingual Extraction Patrick Xia Guanghui Qin Siddharth Vashishtha Yunmo Chen Tongfei Chen Chandler May Craig Harman Kyle Rawlins A. White Benjamin Van Durme 21 40 0 28 Jan 2021
First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT Benjamin Muller Yanai Elazar Benoît Sagot Djamé Seddah LRM 29 71 0 26 Jan 2021
Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT Isabel Papadimitriou Ethan A. Chi Richard Futrell Kyle Mahowald 27 44 0 26 Jan 2021
Meta-Learning for Effective Multi-task and Multilingual Modelling Ishan Tarunesh Sushil Khyalia Vishwajeet Kumar Ganesh Ramakrishnan Preethi Jyothi 39 16 0 25 Jan 2021
A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matters Mengjie Zhao Yi Zhu Ehsan Shareghi Ivan Vulić Roi Reichart Anna Korhonen Hinrich Schütze 32 64 0 31 Dec 2020
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 24 128 0 31 Dec 2020
CalibreNet: Calibration Networks for Multilingual Sequence Labeling Shining Liang Linjun Shou J. Pei Ming Gong Wanli Zuo Daxin Jiang 31 8 0 11 Nov 2020
Multilingual AMR-to-Text Generation Angela Fan Claire Gardent 17 32 0 10 Nov 2020
To What Degree Can Language Borders Be Blurred In BERT-based Multilingual Spoken Language Understanding? Q. Do Judith Gaspers Tobias Röding Melanie Bradford 21 4 0 10 Nov 2020
Emergent Communication Pretraining for Few-Shot Machine Translation Yaoyiran Li Edoardo Ponti Ivan Vulić Anna Korhonen 25 19 0 02 Nov 2020
Rethinking embedding coupling in pre-trained language models Hyung Won Chung Thibault Févry Henry Tsai Melvin Johnson Sebastian Ruder 95 142 0 24 Oct 2020
Unsupervised Cross-lingual Adaptation for Sequence Tagging and Beyond Xin Li Lidong Bing Wenxuan Zhang Zheng Li Wai Lam 59 25 0 23 Oct 2020
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 224 287 0 23 Oct 2020
The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classification Abdullatif Köksal Arzucan Özgür 38 19 0 19 Oct 2020
Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy J. Lin Rodrigo Nogueira Andrew Yates VLM 244 612 0 13 Oct 2020
Model Selection for Cross-Lingual Transfer Yang Chen Alan Ritter 23 12 0 13 Oct 2020
Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models Zirui Wang Yulia Tsvetkov Orhan Firat Yuan Cao 33 196 0 12 Oct 2020
Probing Pretrained Language Models for Lexical Semantics Ivan Vulić Edoardo Ponti Robert Litschko Goran Glavaš Anna Korhonen KELM 43 235 0 12 Oct 2020
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor Xinyu Wang Yong-jia Jiang Zhaohui Yan Zixia Jia Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 26 10 0 10 Oct 2020
Automated Concatenation of Embeddings for Structured Prediction Xinyu Wang Yong-jia Jiang Nguyen Bach Tao Wang Zhongqiang Huang Fei Huang Kewei Tu 35 172 0 10 Oct 2020
Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages Michael A. Hedderich David Ifeoluwa Adelani D. Zhu Jesujoba Oluwadara Alabi Udia Markus Dietrich Klakow 17 72 0 07 Oct 2020
The Multilingual Amazon Reviews Corpus Phillip Keung Y. Lu György Szarvas Noah A. Smith 25 190 0 06 Oct 2020
Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher Giannis Karamanolakis Daniel J. Hsu Luis Gravano VLM 36 17 0 06 Oct 2020
Cross-lingual Alignment Methods for Multilingual BERT: A Comparative Study Saurabh Kulshreshtha José Luis Redondo García Ching-Yun Chang 24 46 0 29 Sep 2020
Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank Ethan C. Chau Lucy H. Lin Noah A. Smith 22 15 0 29 Sep 2020
What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties Rochelle Choenni Ekaterina Shutova 25 37 0 27 Sep 2020
RecoBERT: A Catalog Language Model for Text-Based Recommendations Itzik Malkiel Oren Barkan Avi Caciularu Noam Razin Ori Katz Noam Koenigstein 20 13 0 25 Sep 2020
How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks Keyulu Xu Mozhi Zhang Jingling Li S. Du Ken-ichi Kawarabayashi Stefanie Jegelka MLT 30 306 0 24 Sep 2020
UniTrans: Unifying Model Transfer and Data Transfer for Cross-Lingual Named Entity Recognition with Unlabeled Data Qianhui Wu Zijia Lin Börje F. Karlsson Biqing Huang Jian-Guang Lou 21 46 0 15 Jul 2020
CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLP Libo Qin Minheng Ni Yue Zhang Wanxiang Che 40 149 0 11 Jun 2020
Adversarial Alignment of Multilingual Models for Extracting Temporal Expressions from Text Lukas Lange Anastasiia Iurshina Heike Adel Jannik Strötgen 30 29 0 19 May 2020
Are All Languages Created Equal in Multilingual BERT? Shijie Wu Mark Dredze 25 316 0 18 May 2020