How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 671 papers shown

Title
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation Xinyi Wang Sebastian Ruder Graham Neubig 98 63 0 17 Mar 2022
Pre-Trained Multilingual Sequence-to-Sequence Models: A Hope for Low-Resource Language Translation? E. Lee Sarubi Thillainathan Shravan Nayak Surangika Ranathunga David Ifeoluwa Adelani Ruisi Su Arya D. McCarthy VLM 110 44 0 16 Mar 2022
Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning Miryam de Lhoneux Shenmin Zhang Anders Søgaard 74 11 0 16 Mar 2022
Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure Yuan Chai Yaobo Liang Nan Duan LRM 66 23 0 16 Mar 2022
Does Corpus Quality Really Matter for Low-Resource Languages? Mikel Artetxe Itziar Aldabe Rodrigo Agerri Olatz Perez-de-Viñaspre Aitor Soroa Etxabe 65 20 0 15 Mar 2022
A new approach to calculating BERTScore for automatic assessment of translation quality A. Vetrov E. Gorn 46 1 0 10 Mar 2022
A Survey on Aspect-Based Sentiment Analysis: Tasks, Methods, and Challenges Wenxuan Zhang Xin Li Yang Deng Lidong Bing W. Lam 108 255 0 02 Mar 2022
Multilingual Abusiveness Identification on Code-Mixed Social Media Text Ekagra Ranjan Naman Poddar 31 0 0 01 Mar 2022
Cross-Lingual Text Classification with Multilingual Distillation and Zero-Shot-Aware Training Ziqing Yang Yiming Cui Zhigang Chen Shijin Wang VLM 136 3 0 28 Feb 2022
Semi-Structured Query Grounding for Document-Oriented Databases with Deep Retrieval and Its Application to Receipt and POI Matching Geewook Kim Wonseok Hwang Minjoon Seo Seunghyun Park 72 0 0 23 Feb 2022
Delving Deeper into Cross-lingual Visual Question Answering Chen Cecilia Liu Jonas Pfeiffer Anna Korhonen Ivan Vulić Iryna Gurevych 105 8 0 15 Feb 2022
Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmark Jiaxi Gu Xiaojun Meng Guansong Lu Lu Hou Minzhe Niu ... Runhu Huang Wei Zhang Xingda Jiang Chunjing Xu Hang Xu VLM 161 95 0 14 Feb 2022
Toward a traceable, explainable, and fairJD/Resume recommendation system Amine Barrak Bram Adams Payel Das 46 2 0 02 Feb 2022
L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resources Raviraj Joshi 90 54 0 02 Feb 2022
Constrained Density Matching and Modeling for Cross-lingual Alignment of Contextualized Representations Wei Zhao Steffen Eger 54 1 0 31 Jan 2022
Does Transliteration Help Multilingual Language Modeling? Ibraheem Muhammad Moosa Mahmud Elahi Akhter Ashfia Binte Habib 94 12 0 29 Jan 2022
Systematic Investigation of Strategies Tailored for Low-Resource Settings for Low-Resource Dependency Parsing Jivnesh Sandhan Laxmidhar Behera Pawan Goyal 74 1 0 27 Jan 2022
CsFEVER and CTKFacts: Acquiring Czech data for fact verification Herbert Ullrich Jan Drchal Martin Rýpar Hana Vincourová Václav Moravec HILM 79 9 0 26 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 93 104 0 15 Jan 2022
A Warm Start and a Clean Crawled Corpus -- A Recipe for Good Language Models Vésteinn Snæbjarnarson Haukur Barri Símonarson Pétur Orri Ragnarsson Svanhvít Lilja Ingólfsdóttir H. Jónsson Vilhjálmur Þorsteinsson H. Einarsson 81 26 0 14 Jan 2022
The Dark Side of the Language: Pre-trained Transformers in the DarkNet Leonardo Ranaldi Aria Nourbakhsh Arianna Patrizi Elena Sofia Ruzzetti Dario Onorati Francesca Fallucchi Fabio Massimo Zanzotto VLM 63 21 0 14 Jan 2022
Pretrained Language Models for Text Generation: A Survey Junyi Li Tianyi Tang Wayne Xin Zhao J. Nie Ji-Rong Wen AI4CE 173 151 0 14 Jan 2022
QEMind: Alibaba's Submission to the WMT21 Quality Estimation Shared Task Jiayi Wang Ke Min Wang Boxing Chen Yu Zhao Weihua Luo Yuqi Zhang 111 13 0 30 Dec 2021
Do Multi-Lingual Pre-trained Language Models Reveal Consistent Token Attributions in Different Languages? Junxiang Wang Xuchao Zhang Bo Zong Yanchi Liu Wei Cheng Jingchao Ni Haifeng Chen Liang Zhao AAML 57 0 0 23 Dec 2021
On Cross-Lingual Retrieval with Multilingual Text Encoders Robert Litschko Ivan Vulić Simone Paolo Ponzetto Goran Glavaš 89 38 0 21 Dec 2021
Few-shot Learning with Multilingual Language Models Xi Lin Todor Mihaylov Mikel Artetxe Tianlu Wang Shuohui Chen ... Luke Zettlemoyer Zornitsa Kozareva Mona T. Diab Ves Stoyanov Xian Li BDL ELM LRM 153 308 0 20 Dec 2021
Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP Sabrina J. Mielke Zaid Alyafeai Elizabeth Salesky Colin Raffel Manan Dey ... Arun Raja Chenglei Si Wilson Y. Lee Benoît Sagot Samson Tan 107 151 0 20 Dec 2021
Cascading Adaptors to Leverage English Data to Improve Performance of Question Answering for Low-Resource Languages Hariom A. Pandya Bhavik Ardeshna Brijesh S. Bhatt 79 6 0 18 Dec 2021
Harnessing Cross-lingual Features to Improve Cognate Detection for Low-resource Languages Diptesh Kanojia Raj Dabre Shubham Dewangan P. Bhattacharyya Gholamreza Haffari Malhar A. Kulkarni 55 5 0 16 Dec 2021
WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models Benjamin Minixhofer Fabian Paischer Navid Rekabsaz 109 85 0 13 Dec 2021
From Good to Best: Two-Stage Training for Cross-lingual Machine Reading Comprehension Nuo Chen Linjun Shou Ming Gong Jian Pei Daxin Jiang 59 16 0 09 Dec 2021
JABER and SABER: Junior and Senior Arabic BERt Abbas Ghaddar Yimeng Wu Ahmad Rashid Khalil Bibi Mehdi Rezagholizadeh ... Zhefeng Wang Baoxing Huai Xin Jiang Qun Liu Philippe Langlais 55 5 0 08 Dec 2021
DPRK-BERT: The Supreme Language Model Arda Akdemir Yeojoo Jeon OffRL 41 1 0 01 Dec 2021
Tapping BERT for Preposition Sense Disambiguation Siddhesh Pawar S. Thombre Anirudh Mittal Girishkumar Ponkiya P. Bhattacharyya 54 2 0 27 Nov 2021
TunBERT: Pretrained Contextualized Text Representation for Tunisian Dialect Abir Messaoudi Ahmed Cheikhrouhou Hatem Haddad Nourchene Ferchichi Moez BenHajhmida Abir Korched Malek Naski Faten Ghriss Amine Kerkeni 23 10 0 25 Nov 2021
IIITT@Dravidian-CodeMix-FIRE2021: Transliterate or translate? Sentiment analysis of code-mixed text in Dravidian languages Karthik Puranik B. Bharathi Senthil Kumar B 56 9 0 15 Nov 2021
Deep Learning Transformer Architecture for Named Entity Recognition on Low Resourced Languages: State of the art results Ridewaan Hanslo 40 12 0 01 Nov 2021
AdvCodeMix: Adversarial Attack on Code-Mixed Data Sourya Dipta Das Ayan Basak Soumil Mandal Dipankar Das AAML 21 4 0 30 Oct 2021
When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer Ameet Deshpande Partha P. Talukdar Karthik Narasimhan 109 39 0 27 Oct 2021
Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios? Arij Riabi Benoît Sagot Djamé Seddah 85 15 0 26 Oct 2021
Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction Shubhanshu Mishra A. Haghighi VLM 43 4 0 20 Oct 2021
Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapters Asa Cooper Stickland Alexandre Berard Vassilina Nikoulina AI4CE 67 29 0 18 Oct 2021
A Data Bootstrapping Recipe for Low Resource Multilingual Relation Classification Arijit Nag Bidisha Samanta Animesh Mukherjee Niloy Ganguly Soumen Chakrabarti 64 13 0 18 Oct 2021
Ceasing hate withMoH: Hate Speech Detection in Hindi-English Code-Switched Language Arushi Sharma Anubha Kabra Minni Jain 51 53 0 18 Oct 2021
Contextual Hate Speech Detection in Code Mixed Text using Transformer Based Approaches Ravindra Nayak Raviraj Joshi 32 20 0 18 Oct 2021
Predicting the Performance of Multilingual NLP Models A. Srinivasan Sunayana Sitaram T. Ganu Sandipan Dandapat Kalika Bali Monojit Choudhury LRM 65 29 0 17 Oct 2021
Substructure Distribution Projection for Zero-Shot Cross-Lingual Dependency Parsing Freda Shi Kevin Gimpel Karen Livescu 180 7 0 16 Oct 2021
Cross-Lingual Fine-Grained Entity Typing N. Selvaraj Yasumasa Onoe Greg Durrett 52 2 0 15 Oct 2021
Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation Benjamin Muller Luca Soldaini Rik Koncel-Kedziorski Eric Lind Alessandro Moschitti LRM 73 9 0 14 Oct 2021
Learning Compact Metrics for MT Amy Pu Hyung Won Chung Ankur P. Parikh Sebastian Gehrmann Thibault Sellam 77 101 0 12 Oct 2021