Understanding Cross-Lingual Syntactic Transfer in Multilingual Recurrent Neural Networks

31 March 2020

Papers citing "Understanding Cross-Lingual Syntactic Transfer in Multilingual Recurrent Neural Networks"

43 / 43 papers shown

Title
Finding Universal Grammatical Relations in Multilingual BERT Ethan A. Chi John Hewitt Christopher D. Manning 30 151 0 09 May 2020
Cross-Linguistic Syntactic Evaluation of Word Prediction Models Aaron Mueller Garrett Nicolai Panayiota Petrou-Zeniou N. Talmina Tal Linzen 37 56 0 01 May 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 46 1,478 0 27 Feb 2020
Single Headed Attention RNN: Stop Thinking With Your Head Stephen Merity 36 68 0 26 Nov 2019
How Language-Neutral is Multilingual BERT? Jindrich Libovický Rudolf Rosa Alexander Fraser 33 115 0 08 Nov 2019
On the Cross-lingual Transferability of Monolingual Representations Mikel Artetxe Sebastian Ruder Dani Yogatama 75 786 0 25 Oct 2019
Zero-shot Dependency Parsing with Pre-trained Multilingual Sentence Representations Ke M. Tran Arianna Bisazza 25 28 0 12 Oct 2019
Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing Yuxuan Wang Wanxiang Che Jiang Guo Yijia Liu Ting Liu 29 118 0 15 Sep 2019
Designing and Interpreting Probes with Control Tasks John Hewitt Percy Liang 44 531 0 08 Sep 2019
Investigating Multilingual NMT Representations at Scale Sneha Kudugunta Ankur Bapna Isaac Caswell N. Arivazhagan Orhan Firat LRM 148 124 0 05 Sep 2019
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges N. Arivazhagan Ankur Bapna Orhan Firat Dmitry Lepikhin Melvin Johnson ... George F. Foster Colin Cherry Wolfgang Macherey Zhiwen Chen Yonghui Wu 45 424 0 11 Jul 2019
Theoretical Limitations of Self-Attention in Neural Sequence Models Michael Hahn 31 266 0 16 Jun 2019
Analyzing the Limitations of Cross-lingual Word Embedding Mappings Aitor Ormazabal Mikel Artetxe Gorka Labaka Aitor Soroa Etxabe Eneko Agirre 49 62 0 12 Jun 2019
How multilingual is Multilingual BERT? Telmo Pires Eva Schlinger Dan Garrette LRM VLM 120 1,392 0 04 Jun 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 147 852 0 15 May 2019
BERT Rediscovers the Classical NLP Pipeline Ian Tenney Dipanjan Das Ellie Pavlick MILM SSeg 73 1,458 0 15 May 2019
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT Shijie Wu Mark Dredze VLM SSeg 46 675 0 19 Apr 2019
75 Languages, 1 Model: Parsing Universal Dependencies Universally Dan Kondratyuk Milan Straka 49 264 0 03 Apr 2019
Massively Multilingual Neural Machine Translation Roee Aharoni Melvin Johnson Orhan Firat LRM AI4CE 41 485 0 28 Feb 2019
Cross-lingual Language Model Pretraining Guillaume Lample Alexis Conneau 41 2,727 0 22 Jan 2019
Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond Mikel Artetxe Holger Schwenk 3DV 60 1,008 0 26 Dec 2018
Analysis Methods in Neural Language Processing: A Survey Yonatan Belinkov James R. Glass 48 553 0 21 Dec 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 629 93,936 0 11 Oct 2018
Language Modeling Teaches You More Syntax than Translation Does: Lessons Learned Through Auxiliary Task Analysis Kelly W. Zhang Samuel R. Bowman 46 72 0 26 Sep 2018
XNLI: Evaluating Cross-lingual Sentence Representations Alexis Conneau Guillaume Lample Ruty Rinott Adina Williams Samuel R. Bowman Holger Schwenk Veselin Stoyanov ELM 42 1,366 0 13 Sep 2018
Can LSTM Learn to Capture Agreement? The Case of Basque Shauli Ravfogel Francis M. Tyers Yoav Goldberg 37 43 0 11 Sep 2018
Targeted Syntactic Evaluation of Language Models Rebecca Marvin Tal Linzen 47 414 0 27 Aug 2018
Rapid Adaptation of Neural Machine Translation to New Languages Graham Neubig Junjie Hu AI4CE 35 208 0 13 Aug 2018
Deep RNNs Encode Soft Hierarchical Syntax Terra Blevins Omer Levy Luke Zettlemoyer 57 110 0 11 May 2018
Colorless green recurrent networks dream hierarchically Kristina Gulordava Piotr Bojanowski Edouard Grave Tal Linzen Marco Baroni 59 503 0 29 Mar 2018
The Importance of Being Recurrent for Modeling Hierarchical Structure Ke M. Tran Arianna Bisazza Christof Monz 49 150 0 09 Mar 2018
From Phonology to Syntax: Unsupervised Linguistic Typology at Different Levels with Language Embeddings Johannes Bjerva Isabelle Augenstein 28 41 0 23 Feb 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 56 11,520 0 15 Feb 2018
Unsupervised Machine Translation Using Monolingual Corpora Only Guillaume Lample Alexis Conneau Ludovic Denoyer MarcÁurelio Ranzato SSL 78 1,091 0 31 Oct 2017
Word Translation Without Parallel Data Alexis Conneau Guillaume Lample MarcÁurelio Ranzato Ludovic Denoyer Hervé Jégou 253 1,646 0 11 Oct 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 256 129,831 0 12 Jun 2017
What do Neural Machine Translation Models Learn about Morphology? Yonatan Belinkov Nadir Durrani Fahim Dalvi Hassan Sajjad James R. Glass 74 414 0 11 Apr 2017
Continuous multilinguality with language vectors Robert Östling Jörg Tiedemann 41 81 0 22 Dec 2016
Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation Melvin Johnson M. Schuster Quoc V. Le M. Krikun Yonghui Wu ... F. Viégas Martin Wattenberg Gregory S. Corrado Macduff Hughes Jeffrey Dean 82 2,081 0 14 Nov 2016
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies Tal Linzen Emmanuel Dupoux Yoav Goldberg 64 898 0 04 Nov 2016
Many Languages, One Parser Bridger Waleed Ammar George Mulcaire Miguel Ballesteros Chris Dyer Noah A. Smith 37 227 0 04 Feb 2016
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism Orhan Firat Kyunghyun Cho Yoshua Bengio LRM AIMat 249 626 0 06 Jan 2016
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 277 27,205 0 01 Sep 2014