What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties

27 September 2020

Papers citing "What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties"

28 / 28 papers shown

Title
From Zero to Hero: On the Limitations of Zero-Shot Cross-Lingual Transfer with Multilingual Transformers Anne Lauscher Vinit Ravishankar Ivan Vulić Goran Glavaš 72 58 0 01 May 2020
What the [MASK]? Making Sense of Language-Specific BERT Models Debora Nozza Federico Bianchi Dirk Hovy 140 108 0 05 Mar 2020
Cross-Lingual Ability of Multilingual BERT: An Empirical Study Karthikeyan K Zihan Wang Stephen D. Mayhew Dan Roth LRM 77 339 0 17 Dec 2019
A Comparison of Architectures and Pretraining Methods for Contextualized Multilingual Word Embeddings Niels van der Heijden Samira Abnar Ekaterina Shutova 62 16 0 15 Dec 2019
How Language-Neutral is Multilingual BERT? Jindrich Libovický Rudolf Rosa Alexander Fraser 75 116 0 08 Nov 2019
Unsupervised Cross-lingual Representation Learning at Scale Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 228 6,593 0 05 Nov 2019
Zero-shot Dependency Parsing with Pre-trained Multilingual Sentence Representations Ke M. Tran Arianna Bisazza 51 28 0 12 Oct 2019
Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks Haoyang Huang Yaobo Liang Nan Duan Ming Gong Linjun Shou Daxin Jiang M. Zhou 100 233 0 03 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 689 24,557 0 26 Jul 2019
Probing Multilingual Sentence Representations With X-Probe Vinit Ravishankar Lilja Øvrelid Erik Velldal 39 20 0 12 Jun 2019
How multilingual is Multilingual BERT? Telmo Pires Eva Schlinger Dan Garrette LRM VLM 161 1,414 0 04 Jun 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 187 865 0 15 May 2019
BERT Rediscovers the Classical NLP Pipeline Ian Tenney Dipanjan Das Ellie Pavlick MILM SSeg 145 1,482 0 15 May 2019
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT Shijie Wu Mark Dredze VLM SSeg 114 679 0 19 Apr 2019
LINSPECTOR: Multilingual Probing Tasks for Word Representations Gözde Gül Sahin Clara Vania Ilia Kuznetsov Iryna Gurevych 67 44 0 22 Mar 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 113 2,749 0 22 Jan 2019
Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond Mikel Artetxe Holger Schwenk 3DV 156 1,017 0 26 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,229 0 11 Oct 2018
XNLI: Evaluating Cross-lingual Sentence Representations Alexis Conneau Guillaume Lample Ruty Rinott Adina Williams Samuel R. Bowman Holger Schwenk Veselin Stoyanov ELM 90 1,388 0 13 Sep 2018
Dissecting Contextual Word Embeddings: Architecture and Representation Matthew E. Peters Mark Neumann Luke Zettlemoyer Wen-tau Yih 104 431 0 27 Aug 2018
Unsupervised Multilingual Word Embeddings Xilun Chen Claire Cardie 54 132 0 27 Aug 2018
Deep RNNs Encode Soft Hierarchical Syntax Terra Blevins Omer Levy Luke Zettlemoyer 79 111 0 11 May 2018
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 353 897 0 03 May 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 233 11,565 0 15 Feb 2018
What do Neural Machine Translation Models Learn about Morphology? Yonatan Belinkov Nadir Durrani Fahim Dalvi Hassan Sajjad James R. Glass 111 415 0 11 Apr 2017
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies Tal Linzen Emmanuel Dupoux Yoav Goldberg 119 906 0 04 Nov 2016
Massively Multilingual Word Embeddings Bridger Waleed Ammar George Mulcaire Yulia Tsvetkov Guillaume Lample Chris Dyer Noah A. Smith 119 271 0 05 Feb 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.1K 150,364 0 22 Dec 2014