Tree Transformer: Integrating Tree Structures into Self-Attention

14 September 2019

Papers citing "Tree Transformer: Integrating Tree Structures into Self-Attention"

26 / 26 papers shown

Title
Bringing Structure to Naturalness: On the Naturalness of ASTs Profir-Petru Pârţachi Mahito Sugiyama 30 0 0 11 Apr 2025
Tabular Embeddings for Tables with Bi-Dimensional Hierarchical Metadata and Nesting Gyanendra Shrestha Chutain Jiang Sai Akula Vivek Yannam Anna Pyayt Michael Gubanov LMTD 100 0 0 20 Feb 2025
Sneaking Syntax into Transformer Language Models with Tree Regularization Ananjan Nandi Christopher D. Manning Shikhar Murty 75 0 0 28 Nov 2024
HDT: Hierarchical Document Transformer Haoyu He Markus Flicke Jan Buchmann Iryna Gurevych Andreas Geiger 43 0 0 11 Jul 2024
Misalign, Contrast then Distill: Rethinking Misalignments in Language-Image Pretraining Bumsoo Kim Yeonsik Jo Jinhyung Kim S. Kim VLM 32 8 0 19 Dec 2023
Sparse Attention-Based Neural Networks for Code Classification Ziyang Xiang Zaixin Zhang Qi Liu 17 0 0 11 Nov 2023
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model Hao Fei Shengqiong Wu Jingye Li Bobo Li Fei Li Libo Qin Meishan Zhang Hao Fei Tat-Seng Chua 28 76 0 13 Apr 2023
Learning Trajectory-Word Alignments for Video-Language Tasks Xu Yang Zhang Li Haiyang Xu Hanwang Zhang Qinghao Ye Chenliang Li Ming Yan Yu Zhang Fei Huang Songfang Huang 38 7 0 05 Jan 2023
Bird-Eye Transformers for Text Generation Models Lei Sha Yuhang Song Yordan Yordanov Tommaso Salvatori Thomas Lukasiewicz 30 0 0 08 Oct 2022
An Interpretability Evaluation Benchmark for Pre-trained Language Models Ya-Ming Shen Lijie Wang Ying-Cong Chen Xinyan Xiao Jing Liu Hua Wu 42 4 0 28 Jul 2022
Forming Trees with Treeformers Nilay Patel Jeffrey Flanigan AI4CE 28 3 0 14 Jul 2022
Transformer with Tree-order Encoding for Neural Program Generation Klaudia Thellmann Bernhard Stadler Ricardo Usbeck Jens Lehmann 29 1 0 30 May 2022
RSTGen: Imbuing Fine-Grained Interpretable Control into Long-FormText Generators Rilwan A. Adewoyin Ritabrata Dutta Yulan He 27 2 0 25 May 2022
Dependency-based Mixture Language Models Zhixian Yang Xiaojun Wan 49 2 0 19 Mar 2022
Co-training an Unsupervised Constituency Parser with Weak Supervision Nickil Maveli Shay B. Cohen SSL 51 3 0 05 Oct 2021
Auto-Parsing Network for Image Captioning and Visual Question Answering Xu Yang Chongyang Gao Hanwang Zhang Jianfei Cai 24 35 0 24 Aug 2021
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation Xin Wang Yasheng Wang Fei Mi Pingyi Zhou Yao Wan Xiao Liu Li Li Hao Wu Jin Liu Xin Jiang 39 114 0 10 Aug 2021
Structural Guidance for Transformer Language Models Peng Qian Tahira Naseem R. Levy Ramón Fernández Astudillo 47 31 0 30 Jul 2021
Link Prediction on N-ary Relational Facts: A Graph-based Approach Quan Wang Haifeng Wang Yajuan Lyu Yong Zhu 24 46 0 18 May 2021
SG-Net: Syntax Guided Transformer for Language Representation ZhuoSheng Zhang Yuwei Wu Junru Zhou Sufeng Duan Hai Zhao Rui-cang Wang 51 36 0 27 Dec 2020
How Does Selective Mechanism Improve Self-Attention Networks? Xinwei Geng Longyue Wang Xing Wang Bing Qin Ting Liu Zhaopeng Tu AAML 41 35 0 03 May 2020
Capsule-Transformer for Neural Machine Translation Sufeng Duan Juncheng Cao Hai Zhao MedIm 32 4 0 30 Apr 2020
Image Captioning through Image Transformer Sen He Wentong Liao Hamed R. Tavakoli M. Yang Bodo Rosenhahn N. Pugeault ViT 36 91 0 29 Apr 2020
Code Prediction by Feeding Trees to Transformers Seohyun Kim Jinman Zhao Yuchi Tian S. Chandra 48 217 0 30 Mar 2020
PhoBERT: Pre-trained language models for Vietnamese Dat Quoc Nguyen A. Nguyen 174 343 0 02 Mar 2020
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhehuai Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 718 6,750 0 26 Sep 2016