Do Transformers Really Perform Bad for Graph Representation?

9 June 2021

Tianle Cai

Papers citing "Do Transformers Really Perform Bad for Graph Representation?"

47 / 247 papers shown

Title
Equivariant Graph Attention Networks for Molecular Property Prediction Tuan Le Frank Noé Djork-Arné Clevert 16 21 0 20 Feb 2022
Improving Molecular Contrastive Learning via Faulty Negative Mitigation and Decomposed Fragment Contrast Yuyang Wang Rishikesh Magar Chen Liang A. Farimani 48 78 0 18 Feb 2022
Transformer for Graphs: An Overview from Architecture Perspective Erxue Min Runfa Chen Yatao Bian Tingyang Xu Kangfei Zhao Wenbing Huang P. Zhao Junzhou Huang Sophia Ananiadou Yu Rong 16 137 0 17 Feb 2022
Graph Masked Autoencoders with Transformers Sixiao Zhang Hongxu Chen Haoran Yang Xiangguo Sun Philip S. Yu Guandong Xu 21 18 0 17 Feb 2022
XAI for Transformers: Better Explanations through Conservative Propagation Ameen Ali Thomas Schnake Oliver Eberle G. Montavon Klaus-Robert Muller Lior Wolf FAtt 15 89 0 15 Feb 2022
Learning to Discover Medicines T. Nguyen Thin Nguyen T. Tran 34 1 0 14 Feb 2022
Exploring Transformer Backbones for Heterogeneous Treatment Effect Estimation Yi-Fan Zhang Hanlin Zhang Zachary Chase Lipton Li Erran Li Eric P. Xing OODD 28 29 0 02 Feb 2022
GRPE: Relative Positional Encoding for Graph Transformer Wonpyo Park Woonggi Chang Donggeon Lee Juntae Kim Seung-won Hwang 41 75 0 30 Jan 2022
Rewiring with Positional Encodings for Graph Neural Networks Rickard Brüel-Gabrielsson Mikhail Yurochkin Justin Solomon AI4CE 25 32 0 29 Jan 2022
Retroformer: Pushing the Limits of Interpretable End-to-end Retrosynthesis Transformer Yue Wan Ben Liao Chang-Yu Hsieh Shengyu Zhang 25 10 0 29 Jan 2022
Neighbour Interaction based Click-Through Rate Prediction via Graph-masked Transformer Erxue Min Yu Rong Tingyang Xu Yatao Bian P. Zhao Junzhou Huang Da Luo Kangyi Lin Sophia Ananiadou 34 33 0 25 Jan 2022
DrugOOD: Out-of-Distribution (OOD) Dataset Curator and Benchmark for AI-aided Drug Discovery -- A Focus on Affinity Prediction Problems with Noise Annotations Yuanfeng Ji Lu Zhang Jiaxiang Wu Bing Wu Long-Kai Huang ... Ping Luo Shuigeng Zhou Junzhou Huang Peilin Zhao Yatao Bian OOD 73 73 0 24 Jan 2022
How Expressive are Transformers in Spectral Domain for Graphs? Anson Bastos Abhishek Nadgeri Kuldeep Singh H. Kanezashi Toyotaro Suzumura I. Mulang' 27 12 0 23 Jan 2022
Accelerate Model Parallel Training by Using Efficient Graph Traversal Order in Device Placement Tianze Wang A. H. Payberah D. Hagos Vladimir Vlassov GNN 28 0 0 21 Jan 2022
Knee Cartilage Defect Assessment by Graph Representation and Surface Convolution Zixu Zhuang Liping Si Sheng Wang Kai Xuan Xi Ouyang ... Zhong Xue Lichi Zhang Dinggang Shen Weiwu Yao Qian Wang 37 5 0 12 Jan 2022
Graph Neural Networks for Double-Strand DNA Breaks Prediction Xiaobei Wang Huan Zhao Weiwei Tu Hao Li Yu Sun Xiaochen Bo 19 2 0 04 Jan 2022
Knowledge Matters: Radiology Report Generation with General and Specific Knowledge Shuxin Yang Xian Wu Shen Ge S.Kevin Zhou Li Xiao MedIm 27 109 0 30 Dec 2021
EvoMoE: An Evolutional Mixture-of-Experts Training Framework via Dense-To-Sparse Gate Xiaonan Nie Xupeng Miao Shijie Cao Lingxiao Ma Qibin Liu Jilong Xue Youshan Miao Yi Liu Zhi-Xin Yang Bin Cui MoMe MoE 29 23 0 29 Dec 2021
D-HYPR: Harnessing Neighborhood Modeling and Asymmetry Preservation for Digraph Representation Learning Honglu Zhou Advith Chegu Samuel S. Sohn Zuohui Fu Gerard de Melo Mubbasir Kapadia 37 6 0 22 Dec 2021
Graph Representation Learning via Contrasting Cluster Assignments Chun-Yang Zhang Hong-Yu Yao F. I. C. L. Philip Chen Yue-Na Lin SSL 26 2 0 15 Dec 2021
A New Perspective on the Effects of Spectrum in Graph Neural Networks Mingqi Yang Yanming Shen Rui Li Heng Qi Qian Zhang Baocai Yin GNN 15 27 0 14 Dec 2021
SHGNN: Structure-Aware Heterogeneous Graph Neural Network Wentao Xu Yingce Xia Weiqing Liu Jiang Bian Jian Yin Tie-Yan Liu 30 6 0 12 Dec 2021
UniLog: Deploy One Model and Specialize it for All Log Analysis Tasks Yichen Zhu Weibin Meng Ying Liu Shenglin Zhang Tao Han Shimin Tao Dan Pei MoE 46 14 0 06 Dec 2021
Distance and Hop-wise Structures Encoding Enhanced Graph Attention Networks Zhiyi Huang Xiaowei Chen Bojuan Wang 36 0 0 06 Dec 2021
Hierarchical Text Classification As Sub-Hierarchy Sequence Generation Sanghun Im Gibaeg Kim Heung-Seon Oh Seong-Mok Jo Donghwan Kim BDL 57 4 0 22 Nov 2021
DyFormer: A Scalable Dynamic Graph Transformer with Provable Benefits on Generalization Ability Weilin Cong Yanhong Wu Yuandong Tian Mengting Gu Yinglong Xia C. Chen Mehrdad Mahdavi AI4CE 25 8 0 19 Nov 2021
MassFormer: Tandem Mass Spectrum Prediction for Small Molecules using Graph Transformers A. Young Bo Wang Hannes L. Röst 29 5 0 08 Nov 2021
Gophormer: Ego-Graph Transformer for Node Classification Jianan Zhao Chaozhuo Li Qian Wen Yiqi Wang Yuming Liu Hao Sun Xing Xie Yanfang Ye 24 76 0 25 Oct 2021
SEA: Graph Shell Attention in Graph Neural Networks Christian Frey Yunpu Ma Matthias Schubert 36 1 0 20 Oct 2021
Permutation invariant graph-to-sequence model for template-free retrosynthesis and reaction prediction Zhengkai Tu Connor W. Coley 30 90 0 19 Oct 2021
Graph Neural Networks with Learnable Structural and Positional Representations Vijay Prakash Dwivedi A. Luu T. Laurent Yoshua Bengio Xavier Bresson GNN 197 312 0 15 Oct 2021
From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness Lingxiao Zhao Wei Jin Leman Akoglu Neil Shah GNN 24 159 0 07 Oct 2021
Molformer: Motif-based Transformer on 3D Heterogeneous Molecular Graphs Fang Wu Dragomir R. Radev Huabin Xing ViT 36 54 0 04 Oct 2021
Graph Pointer Neural Networks Tian-bao Yang Yujing Wang Z. Yue Yaming Yang Yunhai Tong Jing Bai 24 34 0 03 Oct 2021
RaWaNet: Enriching Graph Neural Network Input via Random Walks on Graphs Anahita Iravanizad E. Medina Martin Stoll GNN 36 1 0 15 Sep 2021
Global Self-Attention as a Replacement for Graph Convolution Md Shamim Hussain Mohammed J Zaki D. Subramanian ViT 40 123 0 07 Aug 2021
From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers K. Choromanski Han Lin Haoxian Chen Tianyi Zhang Arijit Sehanobish Valerii Likhosherstov Jack Parker-Holder Tamás Sarlós Adrian Weller Thomas Weingarten 35 33 0 16 Jul 2021
First Place Solution of KDD Cup 2021 & OGB Large-Scale Challenge Graph Prediction Track Chengxuan Ying Mingqi Yang Shuxin Zheng Guolin Ke Shengjie Luo Tianle Cai Chenglin Wu Yuxin Wang Yanming Shen Di He 16 11 0 15 Jun 2021
Simple GNN Regularisation for 3D Molecular Property Prediction & Beyond Jonathan Godwin Michael Schaarschmidt Alex Gaunt Alvaro Sanchez-Gonzalez Yulia Rubanova Petar Velivcković J. Kirkpatrick Peter W. Battaglia 41 60 0 15 Jun 2021
OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphs Weihua Hu Matthias Fey Hongyu Ren Maho Nakata Yuxiao Dong J. Leskovec AI4CE 23 401 0 17 Mar 2021
SPAGAN: Shortest Path Graph Attention Network Yiding Yang Xinchao Wang Xiuming Zhang Junsong Yuan Dacheng Tao GNN 148 96 0 10 Jan 2021
A Practical Tutorial on Graph Neural Networks I. Ward J. Joyner C. Lickfold Yulan Guo Bennamoun GNN AI4CE 30 12 0 11 Oct 2020
GraphNorm: A Principled Approach to Accelerating Graph Neural Network Training Tianle Cai Shengjie Luo Keyulu Xu Di He Tie-Yan Liu Liwei Wang GNN 32 159 0 07 Sep 2020
Zero-Shot Learning with Common Sense Knowledge Graphs Nihal V. Nayak Stephen H. Bach VLM 26 36 0 18 Jun 2020
Heterogeneous Graph Transformer Ziniu Hu Yuxiao Dong Kuansan Wang Yizhou Sun 187 1,171 0 03 Mar 2020
Benchmarking Graph Neural Networks Vijay Prakash Dwivedi Chaitanya K. Joshi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson 189 918 0 02 Mar 2020
FreeLB: Enhanced Adversarial Training for Natural Language Understanding Chen Zhu Yu Cheng Zhe Gan S. Sun Tom Goldstein Jingjing Liu AAML 232 438 0 25 Sep 2019