Transformer for Graphs: An Overview from Architecture Perspective

17 February 2022

Papers citing "Transformer for Graphs: An Overview from Architecture Perspective"

38 / 38 papers shown

Title
Transformer-based Graph Neural Networks for Battery Range Prediction in AIoT Battery-Swap Services Zhao Li Yang Liu Chuan Zhou Xuanwu Liu Xuming Pan Buqing Cao Xindong Wu 161 1 0 17 Feb 2025
Can Classic GNNs Be Strong Baselines for Graph-level Tasks? Simple Architectures Meet Excellence Yuankai Luo Lei Shi Xiao-Ming Wu AI4CE 216 0 0 13 Feb 2025
Sparse Decomposition of Graph Neural Networks Yaochen Hu Mai Zeng Ge Zhang Pavel Rumiantsev Liheng Ma Yingxue Zhang Mark Coates 203 0 0 25 Oct 2024
TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentials Philipp Thölke Gianni De Fabritiis AI4CE 101 197 0 05 Feb 2022
Representing Long-Range Context for Graph Neural Networks with Global Attention Zhanghao Wu Paras Jain Matthew A. Wright Azalia Mirhoseini Joseph E. Gonzalez Ion Stoica GNN 121 291 0 21 Jan 2022
Gophormer: Ego-Graph Transformer for Node Classification Jianan Zhao Chaozhuo Li Qian Wen Yiqi Wang Yuming Liu Hao Sun Xing Xie Yanfang Ye 63 82 0 25 Oct 2021
GraphiT: Encoding Graph Structure in Transformers Grégoire Mialon Dexiong Chen Margot Selosse Julien Mairal 117 171 0 10 Jun 2021
Do Transformers Really Perform Bad for Graph Representation? Chengxuan Ying Tianle Cai Shengjie Luo Shuxin Zheng Guolin Ke Di He Yanming Shen Tie-Yan Liu GNN 107 443 0 09 Jun 2021
Rethinking Graph Transformers with Spectral Attention Devin Kreuzer Dominique Beaini William L. Hamilton Vincent Létourneau Prudencio Tossou 109 548 0 07 Jun 2021
Evaluating Neural Word Embeddings for Sanskrit Kevin Qinghong Lin Om Adideva Digumarthi Komal Laxmidhar Behera Pawan Goyal 97 12 0 01 Apr 2021
OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphs Weihua Hu Matthias Fey Hongyu Ren Maho Nakata Yuxiao Dong J. Leskovec AI4CE 77 415 0 17 Mar 2021
A Generalization of Transformer Networks to Graphs Vijay Prakash Dwivedi Xavier Bresson AI4CE 109 761 0 17 Dec 2020
Deep Graph Neural Networks with Shallow Subgraph Samplers Hanqing Zeng Muhan Zhang Yinglong Xia Ajitesh Srivastava Andrey Malevich Rajgopal Kannan Viktor Prasanna Long Jin Ren Chen GNN 83 24 0 02 Dec 2020
The Open Catalyst 2020 (OC20) Dataset and Community Challenges L. Chanussot Abhishek Das Siddharth Goyal Thibaut Lavril Muhammed Shuaibi ... Brandon M. Wood Junwoong Yoon Devi Parikh C. L. Zitnick Zachary W. Ulissi 301 535 0 20 Oct 2020
Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classification Yunsheng Shi Zhengjie Huang Shikun Feng Hui Zhong Wenjin Wang Yu Sun AI4CE 106 794 0 08 Sep 2020
SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networks F. Fuchs Daniel E. Worrall Volker Fischer Max Welling 3DPC 158 697 0 18 Jun 2020
Convolutional Kernel Networks for Graph-Structured Data Dexiong Chen Laurent Jacob Julien Mairal GNN 86 55 0 11 Mar 2020
Interpretable Rumor Detection in Microblogs by Attending to User Interactions Ling Min Serena Khoo Hai Leong Chieu Zhong Qian Jing Jiang 65 197 0 29 Jan 2020
Graph-Bert: Only Attention is Needed for Learning Graph Representations Jiawei Zhang Haopeng Zhang Congying Xia Li Sun 100 306 0 15 Jan 2020
Graph Transformer for Graph-to-Sequence Learning Deng Cai W. Lam 82 226 0 18 Nov 2019
PairNorm: Tackling Oversmoothing in GNNs Lingxiao Zhao Leman Akoglu 74 510 0 26 Sep 2019
Universal Graph Transformer Self-Attention Networks Dai Quoc Nguyen T. Nguyen Dinh Q. Phung ViT 79 66 0 26 Sep 2019
GResNet: Graph Residual Network for Reviving Deep GNNs from Suspended Animation Jiawei Zhang Lin Meng 86 54 0 12 Sep 2019
Self-Attention with Structural Position Representations Xing Wang Zhaopeng Tu Longyue Wang Shuming Shi MILM 51 72 0 01 Sep 2019
Modeling Graph Structure in Transformer for Better AMR-to-Text Generation Jiehan Zhu Junhui Li Muhua Zhu Longhua Qian Min Zhang Guodong Zhou 66 102 0 31 Aug 2019
Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernel Yao-Hung Hubert Tsai Shaojie Bai M. Yamada Louis-Philippe Morency Ruslan Salakhutdinov 129 261 0 30 Aug 2019
DropEdge: Towards Deep Graph Convolutional Networks on Node Classification Yu Rong Wenbing Huang Tingyang Xu Junzhou Huang 113 1,349 0 25 Jul 2019
Provably Powerful Graph Networks Haggai Maron Heli Ben-Hamu Hadar Serviansky Y. Lipman 135 582 0 27 May 2019
Deep Learning for Audio Signal Processing Hendrik Purwins Yue Liu Tuomas Virtanen Jan Schlüter Shuo-yiin Chang Tara N. Sainath VLM 111 596 0 30 Apr 2019
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 261 7,710 0 01 Oct 2018
Representation Learning on Graphs with Jumping Knowledge Networks Keyulu Xu Chengtao Li Yonglong Tian Tomohiro Sonobe Ken-ichi Kawarabayashi Stefanie Jegelka GNN 518 1,991 0 09 Jun 2018
Link Prediction Based on Graph Neural Networks Muhan Zhang Yixin Chen GNN 112 1,945 0 27 Feb 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 484 20,265 0 30 Oct 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 805 132,725 0 12 Jun 2017
Neural Message Passing for Quantum Chemistry Justin Gilmer S. Schoenholz Patrick F. Riley Oriol Vinyals George E. Dahl 598 7,500 0 04 Apr 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 682 29,183 0 09 Sep 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 435 10,541 0 21 Jul 2016
Revisiting Semi-Supervised Learning with Graph Embeddings Zhilin Yang William W. Cohen Ruslan Salakhutdinov GNN SSL 176 2,107 0 29 Mar 2016