What do Neural Machine Translation Models Learn about Morphology?

11 April 2017

Papers citing "What do Neural Machine Translation Models Learn about Morphology?"

50 / 245 papers shown

Title
It's Easier to Translate out of English than into it: Measuring Neural Translation Difficulty by Cross-Mutual Information Emanuele Bugliarello Sabrina J. Mielke Antonios Anastasopoulos Ryan Cotterell Naoaki Okazaki 34 23 0 05 May 2020
Similarity Analysis of Contextual Word Representation Models John M. Wu Yonatan Belinkov Hassan Sajjad Nadir Durrani Fahim Dalvi James R. Glass 51 73 0 03 May 2020
Emergence of Syntax Needs Minimal Supervision Raphaël Bailly Kata Gábor 31 5 0 03 May 2020
Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance? Abhilasha Ravichander Yonatan Belinkov Eduard H. Hovy 31 123 0 02 May 2020
A Matter of Framing: The Impact of Linguistic Formalism on Probing Results Ilia Kuznetsov Iryna Gurevych 14 26 0 30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual Representations Julian Michael Jan A. Botha Ian Tenney 28 42 0 29 Apr 2020
What Happens To BERT Embeddings During Fine-tuning? Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney 17 176 0 29 Apr 2020
Do Neural Language Models Show Preferences for Syntactic Formalisms? Artur Kulmizev Vinit Ravishankar Mostafa Abdou Joakim Nivre MILM 11 43 0 29 Apr 2020
Assessing the Bilingual Knowledge Learned by Neural Machine Translation Models Shilin He Xing Wang Shuming Shi M. Lyu Zhaopeng Tu 22 5 0 28 Apr 2020
Word Interdependence Exposes How LSTMs Compose Representations Naomi Saphra Adam Lopez 33 3 0 27 Apr 2020
Probing Linguistic Features of Sentence-Level Representations in Neural Relation Extraction Christoph Alt Aleksandra Gabryszak Leonhard Hennig NAI 13 34 0 17 Apr 2020
On the Effect of Dropping Layers of Pre-trained Transformer Models Hassan Sajjad Fahim Dalvi Nadir Durrani Preslav Nakov 31 132 0 08 Apr 2020
A Systematic Analysis of Morphological Content in BERT Models for Multiple Languages Daniel Edmiston 20 32 0 06 Apr 2020
On the Integration of LinguisticFeatures into Statistical and Neural Machine Translation Eva Vanmassenhove 6 0 0 31 Mar 2020
Understanding Cross-Lingual Syntactic Transfer in Multilingual Recurrent Neural Networks Prajit Dhar Arianna Bisazza 16 10 0 31 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,452 0 18 Mar 2020
On the impressive performance of randomly weighted encoders in summarization tasks Jonathan Pilault Jaehong Park C. Pal BDL 23 5 0 21 Feb 2020
Bi-Decoder Augmented Network for Neural Machine Translation Boyuan Pan Yazheng Yang Zhou Zhao Yueting Zhuang Deng Cai 19 5 0 14 Jan 2020
Neural Machine Translation: A Review and Survey Felix Stahlberg 3DV AI4TS MedIm 20 311 0 04 Dec 2019
COSTRA 1.0: A Dataset of Complex Sentence Transformations P. Barancíková Ondrej Bojar 16 7 0 03 Dec 2019
How Can We Know What Language Models Know? Zhengbao Jiang Frank F. Xu Jun Araki Graham Neubig KELM 21 1,372 0 28 Nov 2019
On the Linguistic Representational Power of Neural Machine Translation Models Yonatan Belinkov Nadir Durrani Fahim Dalvi Hassan Sajjad James R. Glass MILM 33 68 0 01 Nov 2019
Whatcha lookin' at? DeepLIFTing BERT's Attention in Question Answering Ekaterina Arkhangelskaia Sourav Dutta AIMat 17 9 0 14 Oct 2019
How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer Representations Betty van Aken B. Winter Alexander Loser Felix Alexander Gers 27 152 0 11 Sep 2019
Designing and Interpreting Probes with Control Tasks John Hewitt Percy Liang 32 523 0 08 Sep 2019
Investigating Multilingual NMT Representations at Scale Sneha Kudugunta Ankur Bapna Isaac Caswell N. Arivazhagan Orhan Firat LRM 144 120 0 05 Sep 2019
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives Elena Voita Rico Sennrich Ivan Titov 198 181 0 03 Sep 2019
Towards Understanding Neural Machine Translation with Word Importance Shilin He Zhaopeng Tu Xing Wang Longyue Wang Michael R. Lyu Shuming Shi AAML 18 39 0 01 Sep 2019
Encoders Help You Disambiguate Word Senses in Neural Machine Translation Gongbo Tang Rico Sennrich Joakim Nivre 11 22 0 30 Aug 2019
Visual Interaction with Deep Learning Models through Collaborative Semantic Inference Sebastian Gehrmann Hendrik Strobelt Robert Krüger Hanspeter Pfister Alexander M. Rush HAI 21 57 0 24 Jul 2019
Understanding Neural Machine Translation by Simplification: The Case of Encoder-free Models Gongbo Tang Rico Sennrich Joakim Nivre AI4CE 19 14 0 18 Jul 2019
What Should/Do/Can LSTMs Learn When Parsing Auxiliary Verb Constructions? Miryam de Lhoneux Sara Stymne Joakim Nivre 12 3 0 18 Jul 2019
An Intrinsic Nearest Neighbor Analysis of Neural Machine Translation Architectures Hamidreza Ghader Christof Monz 22 2 0 08 Jul 2019
Widening the Representation Bottleneck in Neural Machine Translation with Lexical Shortcuts Denis Emelin Ivan Titov Rico Sennrich 19 10 0 28 Jun 2019
Tabula nearly rasa: Probing the Linguistic Knowledge of Character-Level Neural Language Models Trained on Unsegmented Text Michael Hahn Marco Baroni LMTD 22 15 0 17 Jun 2019
Scalable Syntax-Aware Language Models Using Knowledge Distillation A. Kuncoro Chris Dyer Laura Rimell S. Clark Phil Blunsom 35 26 0 14 Jun 2019
Probing Multilingual Sentence Representations With X-Probe Vinit Ravishankar Lilja Øvrelid Erik Velldal 14 20 0 12 Jun 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 69 1,581 0 11 Jun 2019
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves Classification Tu Vu Mohit Iyyer 27 2 0 09 Jun 2019
Better Character Language Modeling Through Morphology Terra Blevins Luke Zettlemoyer 19 8 0 03 Jun 2019
Assessing the Ability of Self-Attention Networks to Learn Word Order Baosong Yang Longyue Wang Derek F. Wong Lidia S. Chao Zhaopeng Tu 11 31 0 03 Jun 2019
Pretraining Methods for Dialog Context Representation Learning Shikib Mehri E. Razumovskaia Tiancheng Zhao M. Eskénazi 16 84 0 02 Jun 2019
Examining Structure of Word Embeddings with PCA Tomáš Musil 19 12 0 31 May 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned Elena Voita David Talbot F. Moiseev Rico Sennrich Ivan Titov 28 1,097 0 23 May 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 91 848 0 15 May 2019
Contextualization of Morphological Inflection Ekaterina Vylomova Ryan Cotterell Timothy Baldwin Trevor Cohn Jason Eisner 19 3 0 04 May 2019
Multi-Head Multi-Layer Attention to Deep Language Representations for Grammatical Error Detection Masahiro Kaneko Mamoru Komachi 22 31 0 15 Apr 2019
LINSPECTOR: Multilingual Probing Tasks for Word Representations Gözde Gül Sahin Clara Vania Ilia Kuznetsov Iryna Gurevych 33 43 0 22 Mar 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 52 717 0 21 Mar 2019
Still a Pain in the Neck: Evaluating Text Representations on Lexical Composition Vered Shwartz Ido Dagan CoGe 24 78 0 27 Feb 2019