Syntax-Infused Transformer and BERT models for Machine Translation and
Natural Language Understanding

Syntax-Infused Transformer and BERT models for Machine Translation and Natural Language Understanding

10 November 2019

Dhanasekar Sundararaman

Vivek Subramanian

Dong Wang

Lawrence Carin

Papers citing "Syntax-Infused Transformer and BERT models for Machine Translation and Natural Language Understanding"

16 / 16 papers shown

Title
Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention Biao Zhang Ivan Titov Rico Sennrich 55 103 0 29 Aug 2019
Multi-Head Attention with Disagreement Regularization Jian Li Zhaopeng Tu Baosong Yang Michael R. Lyu Tong Zhang 66 146 0 24 Oct 2018
Modeling Localness for Self-Attention Networks Baosong Yang Zhaopeng Tu Derek F. Wong Fandong Meng Lidia S. Chao Tong Zhang MILM 60 177 0 24 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.5K 94,511 0 11 Oct 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 904 7,141 0 20 Apr 2018
Self-Attention with Relative Position Representations Peter Shaw Jakob Uszkoreit Ashish Vaswani 154 2,285 0 06 Mar 2018
Distance-based Self-Attention Network for Natural Language Inference Jinbae Im Sungzoon Cho 70 76 0 06 Dec 2017
Exploiting Linguistic Resources for Neural Machine Translation Using Multi-task Learning Jan Niehues Eunah Cho 44 115 0 03 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 636 130,942 0 12 Jun 2017
Modeling Source Syntax for Neural Machine Translation Junhui Li Deyi Xiong Zhaopeng Tu Muhua Zhu Min Zhang Guodong Zhou 57 146 0 02 May 2017
Graph Convolutional Encoders for Syntax-aware Neural Machine Translation Jasmijn Bastings Ivan Titov Wilker Aziz Diego Marcheggiani K. Simaán GNN 87 492 0 15 Apr 2017
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies Tal Linzen Emmanuel Dupoux Yoav Goldberg 99 903 0 04 Nov 2016
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 579 28,999 0 09 Sep 2016
Linguistic Input Features Improve Neural Machine Translation Rico Sennrich Barry Haddow AI4CE 71 380 0 09 Jun 2016
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 195 7,729 0 31 Aug 2015
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 356 7,955 0 17 Aug 2015