Why Self-Attention? A Targeted Evaluation of Neural Machine Translation Architectures

27 August 2018

Gongbo Tang

Mathias Müller

Annette Rios Gonzales

Rico Sennrich

ArXiv PDF HTML

Papers citing "Why Self-Attention? A Targeted Evaluation of Neural Machine Translation Architectures"

21 / 21 papers shown

Title
An Evaluation of Neural Machine Translation Models on Historical Spelling Normalization Gongbo Tang Fabienne Cap Eva Pettersson Joakim Nivre 21 43 0 13 Jun 2018
The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation Mengzhao Chen Orhan Firat Ankur Bapna Melvin Johnson Wolfgang Macherey ... Niki Parmar M. Schuster Zhifeng Chen Yonghui Wu Macduff Hughes AIMat 43 457 0 26 Apr 2018
A Call for Clarity in Reporting BLEU Scores Matt Post 81 2,941 0 23 Apr 2018
Marian: Fast Neural Machine Translation in C++ Marcin Junczys-Dowmunt Roman Grundkiewicz Tomasz Dwojak Hieu T. Hoang Kenneth Heafield ... Ulrich Germann Alham Fikri Aji Nikolay Bogoychev André F. T. Martins Alexandra Birch 75 713 0 01 Apr 2018
The Importance of Being Recurrent for Modeling Hierarchical Structure Ke M. Tran Arianna Bisazza Christof Monz 56 150 0 09 Mar 2018
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 75 4,759 0 04 Mar 2018
Sockeye: A Toolkit for Neural Machine Translation Felix Hieber Tobias Domhan Michael J. Denkowski David Vilar Artem Sokolov Ann Clifton Matt Post 32 215 0 15 Dec 2017
The University of Edinburgh's Neural MT Systems for WMT17 Rico Sennrich Alexandra Birch Anna Currey Ulrich Germann Barry Haddow Kenneth Heafield Antonio Valerio Miceli Barone Philip Williams MoE 50 182 0 02 Aug 2017
Deep Architectures for Neural Machine Translation Antonio Valerio Miceli Barone Jindřich Helcl Rico Sennrich Barry Haddow Alexandra Birch 36 111 0 24 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 453 129,831 0 12 Jun 2017
Comparative Study of CNN and RNN for Natural Language Processing Wenpeng Yin Katharina Kann Mo Yu Hinrich Schütze 54 984 0 07 Feb 2017
How Grammatical is Character-level Neural Machine Translation? Assessing MT Quality with Contrastive Translation Pairs Rico Sennrich 66 165 0 14 Dec 2016
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies Tal Linzen Emmanuel Dupoux Yoav Goldberg 75 901 0 04 Nov 2016
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems Tianqi Chen Mu Li Yutian Li Min Lin Naiyan Wang Minjie Wang Tianjun Xiao Bing Xu Chiyuan Zhang Zheng Zhang 125 2,243 0 03 Dec 2015
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 157 7,683 0 31 Aug 2015
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 316 7,951 0 17 Aug 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 844 149,474 0 22 Dec 2014
Scale-Invariant Convolutional Neural Networks Yichong Xu Tianjun Xiao Jiaxing Zhang Kuiyuan Yang Zheng Zhang 65 138 0 24 Nov 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 287 20,491 0 10 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 390 27,205 0 01 Sep 2014
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho B. V. Merrienboer Çağlar Gülçehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk Yoshua Bengio AIMat 647 23,235 0 03 Jun 2014