v1v2 (latest)

Tree Transformer: Integrating Tree Structures into Self-Attention

14 September 2019

Papers citing "Tree Transformer: Integrating Tree Structures into Self-Attention"

22 / 22 papers shown

Title
Bringing Structure to Naturalness: On the Naturalness of ASTs Profir-Petru Pârţachi Mahito Sugiyama 77 1 0 11 Apr 2025
Tabular Embeddings for Tables with Bi-Dimensional Hierarchical Metadata and Nesting Gyanendra Shrestha Chutain Jiang Sai Akula Vivek Yannam Anna Pyayt Michael Gubanov LMTD 143 0 0 20 Feb 2025
Sneaking Syntax into Transformer Language Models with Tree Regularization Ananjan Nandi Christopher D. Manning Shikhar Murty 121 0 0 28 Nov 2024
PhoBERT: Pre-trained language models for Vietnamese Dat Quoc Nguyen A. Nguyen 226 355 0 02 Mar 2020
Compound Probabilistic Context-Free Grammars for Grammar Induction Yoon Kim Chris Dyer Alexander M. Rush 88 152 0 24 Jun 2019
Unified Language Model Pre-training for Natural Language Understanding and Generation Li Dong Nan Yang Wenhui Wang Furu Wei Xiaodong Liu Yu Wang Jianfeng Gao M. Zhou H. Hon ELM AI4CE 227 1,560 0 08 May 2019
Unsupervised Recurrent Neural Network Grammars Yoon Kim Alexander M. Rush Lei Yu A. Kuncoro Chris Dyer Gábor Melis LRM RALM SSL 75 115 0 07 Apr 2019
Unsupervised Latent Tree Induction with Deep Inside-Outside Recursive Autoencoders Andrew Drozdov Pat Verga Mohit Yadav Mohit Iyyer Andrew McCallum 50 123 0 03 Apr 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 135 735 0 21 Mar 2019
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks Songlin Yang Shawn Tan Alessandro Sordoni Aaron Courville 122 324 0 22 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Linguistically-Informed Self-Attention for Semantic Role Labeling Emma Strubell Pat Verga D. Andor David J. Weiss Andrew McCallum OffRL 87 380 0 23 Apr 2018
Incorporating Syntactic Uncertainty in Neural Machine Translation with Forest-to-Sequence Model Poorya Zaremoodi Gholamreza Haffari 48 16 0 19 Nov 2017
Neural Language Modeling by Jointly Learning Syntax and Lexicon Songlin Yang Zhouhan Lin Chin-Wei Huang Aaron Courville 60 178 0 02 Nov 2017
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 524 4,494 0 18 Apr 2017
Towards String-to-Tree Neural Machine Translation Roee Aharoni Yoav Goldberg NAI 49 154 0 16 Apr 2017
Learning to Parse and Translate Improves Neural Machine Translation Akiko Eriguchi Yoshimasa Tsuruoka Kyunghyun Cho AI4CE AIMat 72 150 0 12 Feb 2017
Learning to Compose Words into Sentences with Reinforcement Learning Dani Yogatama Phil Blunsom Chris Dyer Edward Grefenstette Wang Ling NAI 63 159 0 28 Nov 2016
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhiwen Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 911 6,796 0 26 Sep 2016
Recurrent Neural Network Grammars Chris Dyer A. Kuncoro Miguel Ballesteros Noah A. Smith GNN 91 527 0 25 Feb 2016
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks Kai Sheng Tai R. Socher Christopher D. Manning AIMat 142 3,122 0 28 Feb 2015
One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling Ciprian Chelba Tomas Mikolov M. Schuster Qi Ge T. Brants P. Koehn T. Robinson 190 1,109 0 11 Dec 2013