How multilingual is Multilingual BERT?

4 June 2019

Papers citing "How multilingual is Multilingual BERT?"

50 / 671 papers shown

Title
Distilling Efficient Language-Specific Models for Cross-Lingual Transfer Alan Ansell Edoardo Ponti Anna Korhonen Ivan Vulić 79 6 0 02 Jun 2023
Leveraging Auxiliary Domain Parallel Data in Intermediate Task Fine-tuning for Low-resource Translation Shravan Nayak Surangika Ranathunga Sarubi Thillainathan Rikki Hung Anthony Rinaldi Yining Wang Jonah Mackey Andrew Ho E. Lee 47 5 0 02 Jun 2023
Why Does Zero-Shot Cross-Lingual Generation Fail? An Explanation and a Solution Tianjian Li Kenton W. Murray 104 26 0 27 May 2023
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averaging Fabian David Schmidt Ivan Vulić Goran Glavaš 75 9 0 26 May 2023
Towards a Common Understanding of Contributing Factors for Cross-Lingual Transfer in Multilingual Language Models: A Review Fred Philippy Siwen Guo Shohreh Haddadan LRM 72 37 0 26 May 2023
An Efficient Multilingual Language Model Compression through Vocabulary Trimming Asahi Ushio Yi Zhou Jose Camacho-Collados 114 8 0 24 May 2023
Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank Adaptation Haonan Li Fajri Koto Minghao Wu Alham Fikri Aji Timothy Baldwin ALM 70 76 0 24 May 2023
Beyond Shared Vocabulary: Increasing Representational Word Similarities across Languages for Multilingual Machine Translation Di Wu Christof Monz 118 9 0 23 May 2023
Target-Agnostic Gender-Aware Contrastive Learning for Mitigating Bias in Multilingual Machine Translation Minwoo Lee Hyukhun Koh Kang-il Lee Dongdong Zhang Minsu Kim Kyomin Jung 99 12 0 23 May 2023
mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models Peiqin Lin Chengzhi Hu Zheyu Zhang André F. T. Martins Hinrich Schütze 59 1 0 23 May 2023
How do languages influence each other? Studying cross-lingual data sharing during LM fine-tuning Rochelle Choenni Dan Garrette Ekaterina Shutova 98 16 0 22 May 2023
Discovering Universal Geometry in Embeddings with ICA Hiroaki Yamagiwa Momose Oyama Hidetoshi Shimodaira 51 15 0 22 May 2023
Extrapolating Multilingual Understanding Models as Multilingual Generators Bohong Wu Fei Yuan Hai Zhao Lei Li Jingjing Xu AI4CE 75 2 0 22 May 2023
Cross-lingual Transfer Can Worsen Bias in Sentiment Analysis Seraphina Goldfarb-Tarrant Bjorn Ross Adam Lopez 74 8 0 22 May 2023
Measuring Cross-Lingual Transferability of Multilingual Transformers on Sentence Classification Zewen Chi Heyan Huang Xian-Ling Mao 124 0 0 15 May 2023
A Crosslingual Investigation of Conceptualization in 1335 Languages Yihong Liu Haotian Ye Leonie Weissweiler Philipp Wicke Renhao Pei Robert Zangenfeind Hinrich Schütze 97 12 0 15 May 2023
The MuSe 2023 Multimodal Sentiment Analysis Challenge: Mimicked Emotions, Cross-Cultural Humour, and Personalisation Lukas Christ Shahin Amiriparian Alice Baird Alexander Kathan Niklas Muller ... Eva-Maria Messner Andreas Konig Alan S. Cowen Min Zhang Björn W. Schuller 117 30 0 05 May 2023
Investigating Lexical Sharing in Multilingual Machine Translation for Indian Languages Sonal Sannigrahi Rachel Bawden 57 0 0 04 May 2023
Evaluating Inter-Bilingual Semantic Parsing for Indian Languages Divyanshu Aggarwal V. Gupta Anoop Kunchukuttan 78 3 0 25 Apr 2023
CHEAT: A Large-scale Dataset for Detecting ChatGPT-writtEn AbsTracts Peipeng Yu Jiahan Chen Xuan Feng Zhihua Xia 167 45 0 24 Apr 2023
L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERT Samruddhi Deode Janhavi Gadre Aditi Kajale Ananya Joshi Raviraj Joshi 59 22 0 22 Apr 2023
Does Manipulating Tokenization Aid Cross-Lingual Transfer? A Study on POS Tagging for Non-Standardized Languages Verena Blaschke Hinrich Schütze Barbara Plank 80 15 0 20 Apr 2023
Low-resource Bilingual Dialect Lexicon Induction with Large Language Models Ekaterina Artemova Barbara Plank 52 1 0 19 Apr 2023
ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning Viet Dac Lai Nghia Trung Ngo Amir Pouran Ben Veyseh Hieu Man Franck Dernoncourt Trung Bui Thien Huu Nguyen ELM LM&MA 69 290 0 12 Apr 2023
Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models Emilio Ferrara SILM 121 263 0 07 Apr 2023
Efficiently Aligned Cross-Lingual Transfer Learning for Conversational Tasks using Prompt-Tuning Lifu Tu Jin Qu Semih Yavuz Shafiq Joty Wenhao Liu Caiming Xiong Yingbo Zhou 82 9 0 03 Apr 2023
ScandEval: A Benchmark for Scandinavian Natural Language Processing Dan Saattrup Nielsen ELM 80 14 0 03 Apr 2023
ContraSim -- A Similarity Measure Based on Contrastive Learning Adir Rahamim Yonatan Belinkov SSL 62 3 0 29 Mar 2023
MEGA: Multilingual Evaluation of Generative AI Kabir Ahuja Harshita Diddee Rishav Hada Millicent Ochieng Krithika Ramesh ... T. Ganu Sameer Segal Maxamed Axmed Kalika Bali Sunayana Sitaram LM&MA LRM ELM 117 292 0 22 Mar 2023
Lexical Complexity Prediction: An Overview Kai North Marcos Zampieri Matthew Shardlow 58 26 0 08 Mar 2023
Quantifying Valence and Arousal in Text with Multilingual Pre-trained Transformers Gonccalo Azevedo Mendes Bruno Martins 53 11 0 27 Feb 2023
Cross-Lingual Transfer of Cognitive Processing Complexity C. Pouw Nora Hollenstein Lisa Beinborn 99 3 0 24 Feb 2023
In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages Asim Ersoy Gerson Vizcarra T. Mayeesha Benjamin Muller 67 2 0 23 Feb 2023
A Two-Sided Discussion of Preregistration of NLP Research Anders Søgaard Daniel Hershcovich Miryam de Lhoneux OnRL AI4CE 83 4 0 20 Feb 2023
Intent Identification and Entity Extraction for Healthcare Queries in Indic Languages Ankan Mullick Ishani Mondal Sourjyadip Ray R. Raghav G. Chaitanya Pawan Goyal 61 13 0 19 Feb 2023
Vision, Deduction and Alignment: An Empirical Study on Multi-modal Knowledge Graph Alignment Yongqian Li Jiaoyan Chen Hai-Tao Zheng Yuejia Xiang Xi Chen Haitao Zheng 99 25 0 17 Feb 2023
Meeting the Needs of Low-Resource Languages: The Value of Automatic Alignments via Pretrained Models Abteen Ebrahimi Arya D. McCarthy Arturo Oncevay Luis Chiruzzo J. Ortega Gustavo A. Giménez-Lugo Rolando A. Coto Solano Katharina Kann 70 6 0 15 Feb 2023
A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends Xiaoye Qu Yingjie Gu Qingrong Xia Zechang Li Zhefeng Wang Baoxing Huai 92 20 0 07 Feb 2023
Zero-shot cross-lingual transfer language selection using linguistic similarity J. Eronen M. Ptaszynski Fumito Masui 92 38 0 31 Jan 2023
Learning to Speak from Text: Zero-Shot Multilingual Text-to-Speech with Unsupervised Text Pretraining Takaaki Saeki Soumi Maiti Xinjian Li Shinji Watanabe Shinnosuke Takamichi Hiroshi Saruwatari 107 18 0 30 Jan 2023
Cross-lingual German Biomedical Information Extraction: from Zero-shot to Human-in-the-Loop Siting Liang Mareike Hartmann Daniel Sonntag 50 3 0 24 Jan 2023
Exploring Methods for Building Dialects-Mandarin Code-Mixing Corpora: A Case Study in Taiwanese Hokkien Sin-En Lu Bo-Han Lu Chaohong Lu Richard Tzong-Han Tsai 58 6 0 21 Jan 2023
ProKD: An Unsupervised Prototypical Knowledge Distillation Network for Zero-Resource Cross-Lingual Named Entity Recognition Ling Ge Chuming Hu Guanghui Ma Hong Zhang Jihong Liu 54 4 0 21 Jan 2023
Dissociating language and thought in large language models Kyle Mahowald Anna A. Ivanova I. Blank Nancy Kanwisher J. Tenenbaum Evelina Fedorenko ELM ReLM 108 215 0 16 Jan 2023
A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies A. Seza Doğruöz Sunayana Sitaram Barbara E. Bullock Almeida Jacqueline Toribio 130 79 0 05 Jan 2023
MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning Luke Gessler Amir Zeldes 73 14 0 23 Dec 2022
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer? Ningyu Xu Tao Gui Ruotian Ma Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 91 13 0 21 Dec 2022
Character-Aware Models Improve Visual Text Rendering Rosanne Liu Daniel H Garrette Chitwan Saharia William Chan Adam Roberts Sharan Narang Irina Blok R. Mical Mohammad Norouzi Noah Constant VLM 117 74 0 20 Dec 2022
Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training Kelly Marchisio Patrick Lewis Yihong Chen Mikel Artetxe 78 19 0 20 Dec 2022
On the Role of Parallel Data in Cross-lingual Transfer Learning Machel Reid Mikel Artetxe 66 11 0 20 Dec 2022