Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is
It and How Does It Affect Transfer?

Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?

21 December 2022

Xuanjing Huang

Papers citing "Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?"

11 / 11 papers shown

Title
InstaTrans: An Instruction-Aware Translation Framework for Non-English Instruction Datasets Yungi Kim Chanjun Park 26 0 0 02 Oct 2024
Unveiling Linguistic Regions in Large Language Models Zhihao Zhang Jun Zhao Qi Zhang Tao Gui Xuanjing Huang 47 11 0 22 Feb 2024
What is "Typological Diversity" in NLP? Esther Ploeger Wessel Poelman Miryam de Lhoneux Johannes Bjerva 24 2 0 06 Feb 2024
Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Models Sara Rajaee Christof Monz 30 3 0 03 Feb 2024
Knowledge Trees: Gradient Boosting Decision Trees on Knowledge Neurons as Probing Classifier Sergey A. Saltykov 22 0 0 17 Dec 2023
CreoleVal: Multilingual Multitask Benchmarks for Creoles Heather Lent Kushal Tatariya Raj Dabre Yiyi Chen Marcell Richard Fekete ... Miryam de Lhoneux Daniel Hershcovich Michel DeGraff Anders Sogaard Johannes Bjerva SLR 41 9 0 30 Oct 2023
Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization Ningyu Xu Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 38 4 0 19 Oct 2023
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models Phillip Rust Jonas Pfeiffer Ivan Vulić Sebastian Ruder Iryna Gurevych 80 235 0 31 Dec 2020
Geometric Dataset Distances via Optimal Transport David Alvarez-Melis Nicolò Fusi OT 72 194 0 07 Feb 2020
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 201 882 0 03 May 2018
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 174 1,635 0 11 Oct 2017