How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 657 papers shown

Title
Understanding BLOOM: An empirical study on diverse NLP tasks Parag Dakle Sai Krishna Rallabandi Preethi Raghavan AI4CE 39 3 0 27 Nov 2022
ALIGN-MLM: Word Embedding Alignment is Crucial for Multilingual Pre-training Henry Tang Ameet Deshpande Karthik Narasimhan 32 5 0 15 Nov 2022
Persian Emotion Detection using ParsBERT and Imbalanced Data Handling Approaches Amirhossein Abaskohi Nazanin Sabri B. Bahrak 31 4 0 15 Nov 2022
High-Resource Methodological Bias in Low-Resource Investigations Maartje ter Hoeve David Grangier Natalie Schluter 35 2 0 14 Nov 2022
GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost Qingcheng Zeng Lucas Garay Peilin Zhou Dading Chong Yining Hua Jiageng Wu Yi-Cheng Pan Han Zhou Rob Voigt Jie Yang VLM 26 24 0 13 Nov 2022
English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddings Yau-Shian Wang Ashley Wu Graham Neubig SSL 38 31 0 11 Nov 2022
Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twitter Maram Hasanain Tamer Elsayed 37 4 0 09 Nov 2022
Detecting Languages Unintelligible to Multilingual Models through Local Structure Probes Louis Clouâtre Prasanna Parthasarathi Amal Zouaq Sarath Chandar 38 3 0 09 Nov 2022
Parameter and Data Efficient Continual Pre-training for Robustness to Dialectal Variance in Arabic Soumajyoti Sarkar Kaixiang Lin Sailik Sengupta Leonard Lausen Sheng Zha Saab Mansour CLL 23 3 0 08 Nov 2022
Intriguing Properties of Compression on Multilingual Models Kelechi Ogueji Orevaoghene Ahia Gbemileke Onilude Sebastian Gehrmann Sara Hooker Julia Kreutzer 31 12 0 04 Nov 2022
Data-Efficient Cross-Lingual Transfer with Language-Specific Subnetworks Rochelle Choenni Dan Garrette Ekaterina Shutova 33 2 0 31 Oct 2022
Benchmarking Language Models for Code Syntax Understanding Da Shen Xinyun Chen Chenguang Wang Koushik Sen Dawn Song ELM 28 16 0 26 Oct 2022
Progressive Sentiment Analysis for Code-Switched Text Data Sudhanshu Ranjan Dheeraj Mekala Jingbo Shang 34 4 0 25 Oct 2022
Adapters for Enhanced Modeling of Multilingual Knowledge and Text Yifan Hou Wenxiang Jiao Mei-Jun Liu Carl Allen Zhaopeng Tu Mrinmaya Sachan 41 11 0 24 Oct 2022
Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation O. Serikov Vitaly Protasov E. Voloshina V. Knyazkova Tatiana Shavrina 35 3 0 24 Oct 2022
Model and Data Transfer for Cross-Lingual Sequence Labelling in Zero-Resource Settings Iker García-Ferrero Rodrigo Agerri German Rigau 69 21 0 23 Oct 2022
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition David Ifeoluwa Adelani Graham Neubig Sebastian Ruder Shruti Rijhwani Michael Beukman ... Idris Abdulmumin Odunayo Ogundepo Oreen Yousuf Tatiana Moteu Ngoli Dietrich Klakow 49 44 0 22 Oct 2022
Prompt-Tuning Can Be Much Better Than Fine-Tuning on Cross-lingual Understanding With Multilingual Language Models Lifu Tu Caiming Xiong Yingbo Zhou VLM AAML LRM 97 27 0 22 Oct 2022
Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages Paul Röttger Debora Nozza Federico Bianchi Dirk Hovy 34 10 0 20 Oct 2022
Synergy with Translation Artifacts for Training and Inference in Multilingual Tasks Jaehoon Oh Jongwoo Ko Se-Young Yun 44 9 0 18 Oct 2022
Shapley Head Pruning: Identifying and Removing Interference in Multilingual Transformers William B. Held Diyi Yang VLM 45 5 0 11 Oct 2022
Robustification of Multilingual Language Models to Real-world Noise in Crosslingual Zero-shot Settings with Robust Contrastive Pretraining Asa Cooper Stickland Sailik Sengupta Jason Krone Saab Mansour He He 55 7 0 10 Oct 2022
Language Models are Multilingual Chain-of-Thought Reasoners Freda Shi Mirac Suzgun Markus Freitag Xuezhi Wang Suraj Srivats ... Yi Tay Sebastian Ruder Denny Zhou Dipanjan Das Jason W. Wei ReLM LRM 174 337 0 06 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 129 95 0 06 Oct 2022
MonoByte: A Pool of Monolingual Byte-level Language Models Hugo Queiroz Abonizio Leandro Rodrigues de Souza R. Lotufo Rodrigo Nogueira 46 1 0 22 Sep 2022
Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines Anmol Bansal Arjun Choudhry Anubhav Sharma Seba Susan MedIm 21 4 0 22 Sep 2022
Language Chameleon: Transformation analysis between languages using Cross-lingual Post-training based on Pre-trained language models Suhyune Son Chanjun Park Jungseob Lee Midan Shim Chanhee Lee Yoonna Jang Jaehyung Seo Heu-Jeoung Lim 31 0 0 14 Sep 2022
Multilingual Transformer Language Model for Speech Recognition in Low-resource Languages Li Miao Jian Wu Piyush Behre Shuangyu Chang S. Parthasarathy 21 2 0 08 Sep 2022
Trust in Language Grounding: a new AI challenge for human-robot teams David M. Bossens C. Evers 42 1 0 05 Sep 2022
KoCHET: a Korean Cultural Heritage corpus for Entity-related Tasks Gyeongmin Kim Jinsung Kim Junyoung Son Heu-Jeoung Lim 27 7 0 01 Sep 2022
Massively Multilingual Lexical Specialization of Multilingual Transformers Tommaso Green Simone Paolo Ponzetto Goran Glavaš 30 0 0 01 Aug 2022
On the cross-lingual transferability of multilingual prototypical models across NLU tasks Oralie Cattan Christophe Servan S. Rosset 34 9 0 19 Jul 2022
On the Usability of Transformers-based models for a French Question-Answering task Oralie Cattan Christophe Servan Sophie Rosset 24 14 0 19 Jul 2022
Multilingual Transformer Encoders: a Word-Level Task-Agnostic Evaluation Félix Gaschi François Plesse Parisa Rastin Y. Toussaint 22 8 0 19 Jul 2022
u-HuBERT: Unified Mixed-Modal Speech Pretraining And Zero-Shot Transfer to Unlabeled Modality Wei-Ning Hsu Bowen Shi SSL VLM 29 42 0 14 Jul 2022
Language Modelling with Pixels Phillip Rust Jonas F. Lotz Emanuele Bugliarello Elizabeth Salesky Miryam de Lhoneux Desmond Elliott VLM 40 46 0 14 Jul 2022
"Diversity and Uncertainty in Moderation" are the Key to Data Selection for Multilingual Few-shot Transfer Shanu Kumar Sandipan Dandapat Monojit Choudhury 29 6 0 30 Jun 2022
Extreme compression of sentence-transformer ranker models: faster inference, longer battery life, and less storage on edge devices Amit Chaulwar Lukas Malik Maciej Krajewski Felix Reichel Leif-Nissen Lundbæk M. Huth B. Matejczyk VLM 17 3 0 29 Jun 2022
SPBERTQA: A Two-Stage Question Answering System Based on Sentence Transformers for Medical Texts N. T. Nguyen Phuong Phan-Dieu Ha Luan Thanh Nguyen Kiet Van Nguyen Ngan Luu-Thuy Nguyen MedIm 28 10 0 20 Jun 2022
BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformers Shaz Furniturewala V. Kumari Amulya Ratna Dash Hriday Kedia Yashvardhan Sharma 27 2 0 17 Jun 2022
PreCogIIITH at HinglishEval : Leveraging Code-Mixing Metrics & Language Model Embeddings To Estimate Code-Mix Quality Prashant Kodali Tanmay Sachan Akshay Goindani Anmol Goel Naman Ahuja Manish Shrivastava Ponnurangam Kumaraguru 15 2 0 16 Jun 2022
1Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Task Zhiyong Wang Ge Zhang Nineli Lashkarashvili 24 3 0 08 Jun 2022
Transfer Language Selection for Zero-Shot Cross-Lingual Abusive Language Detection J. Eronen M. Ptaszynski Fumito Masui Masaki Arata Gniewosz Leliwa Michal Wroczynski 19 31 0 02 Jun 2022
Punctuation Restoration in Spanish Customer Support Transcripts using Transfer Learning Xiliang Zhu Shayna Gardiner David Rossouw T. Roldán Simon Corston-Oliver 41 1 0 27 May 2022
Discovering Language-neutral Sub-networks in Multilingual Language Models Negar Foroutan Mohammadreza Banaei R. Lebret Antoine Bosselut Karl Aberer LRM 43 25 0 25 May 2022
Analysing the Greek Parliament Records with Emotion Classification John Pavlopoulos Vanessa Lislevand 22 2 0 24 May 2022
Word-order typology in Multilingual BERT: A case study in subordinate-clause detection Dmitry Nikolaev Sebastian Padó 27 6 0 24 May 2022
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models Terra Blevins Hila Gonen Luke Zettlemoyer LRM 59 28 0 24 May 2022
The Geometry of Multilingual Language Model Representations Tyler A. Chang Zhuowen Tu Benjamin Bergen 31 58 0 22 May 2022
Phylogeny-Inspired Adaptation of Multilingual Models to New Languages Fahim Faisal Antonios Anastasopoulos AI4CE LRM 34 26 0 19 May 2022