A Survey of Graph Transformers: Architectures, Theories and Applications

23 February 2025

Papers citing "A Survey of Graph Transformers: Architectures, Theories and Applications"

50 / 145 papers shown

Title
On the Connection Between MPNN and Graph Transformer Chen Cai Truong-Son Hy Rose Yu Yusu Wang 89 55 0 27 Jan 2023
Rethinking the Expressive Power of GNNs via Graph Biconnectivity Bohang Zhang Shengjie Luo Liwei Wang Di He 36 121 0 23 Jan 2023
Conditional Diffusion Based on Discrete Graph Structures for Molecular Graph Generation Han Huang Leilei Sun Bowen Du Weifeng Lv 100 42 0 01 Jan 2023
A Generalization of ViT/MLP-Mixer to Graphs Xiaoxin He Bryan Hooi T. Laurent Adam Perold Yann LeCun Xavier Bresson 74 95 0 27 Dec 2022
A Retrieve-and-Read Framework for Knowledge Graph Link Prediction Vardaan Pahuja Boshi Wang Hugo Latapie Jayanth Srinivasa Yu-Chuan Su 55 13 0 19 Dec 2022
BatmanNet: Bi-branch Masked Graph Transformer Autoencoder for Molecular Representation Zhen Wang Zheng Feng Yanjun Li Bowen Li Yongrui Wang C. Sha Min He Xiaolin Li AI4CE 64 9 0 25 Nov 2022
Inductive Graph Transformer for Delivery Time Estimation Xin Zhou Jinglong Wang Yong Liu Xin Wu Zhiqi Shen Cyril Leung 46 16 0 05 Nov 2022
Brain Network Transformer Xuan Kan Wei Dai Hejie Cui Zilong Zhang Ying Guo Carl Yang MedIm 55 105 0 13 Oct 2022
Periodic Graph Transformers for Crystal Material Property Prediction Keqiang Yan Yi Liu Yu-Ching Lin Shuiwang Ji AI4TS 109 88 0 23 Sep 2022
Mask and Reason: Pre-Training Knowledge Graph Transformers for Complex Logical Queries Xiao Liu Shiyu Zhao Kai Su Yukuo Cen J. Qiu Mengdi Zhang Wei Wu Yuxiao Dong Jie Tang 54 58 0 16 Aug 2022
Pure Transformers are Powerful Graph Learners Jinwoo Kim Tien Dat Nguyen Seonwoo Min Sungjun Cho Moontae Lee Honglak Lee Seunghoon Hong 86 200 0 06 Jul 2022
Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphs Yi-Lun Liao Tess E. Smidt 128 241 0 23 Jun 2022
Long Range Graph Benchmark Vijay Prakash Dwivedi Ladislav Rampášek Mikhail Galkin Alipanah Parviz Guy Wolf Anh Tuan Luu Dominique Beaini 84 211 0 16 Jun 2022
NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphs Jinsong Chen Kaiyuan Gao Gaichao Li Kun He 70 113 0 10 Jun 2022
PEER: A Comprehensive and Multi-Task Benchmark for Protein Sequence Understanding Minghao Xu Zuobai Zhang Jiarui Lu Zhaocheng Zhu Yang Zhang Chang Ma Runcheng Liu Jian Tang 44 104 0 05 Jun 2022
KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction Han Li Dan Zhao Jianyang Zeng 49 64 0 02 Jun 2022
Pre-training via Denoising for Molecular Property Prediction Sheheryar Zaidi Michael Schaarschmidt James Martens Hyunjik Kim Yee Whye Teh Alvaro Sanchez-Gonzalez Peter W. Battaglia Razvan Pascanu Jonathan Godwin DiffM AI4CE 95 127 0 31 May 2022
Recipe for a General, Powerful, Scalable Graph Transformer Ladislav Rampášek Mikhail Galkin Vijay Prakash Dwivedi Anh Tuan Luu Guy Wolf Dominique Beaini 122 565 0 25 May 2022
Relphormer: Relational Graph Transformer for Knowledge Graph Representations Zhen Bi Shuyang Cheng Jing Chen Xiaozhuan Liang Feiyu Xiong Ningyu Zhang 66 39 0 22 May 2022
Heterformer: Transformer-based Deep Node Representation Learning on Heterogeneous Text-Rich Networks Bowen Jin Yu Zhang Qi Zhu Jiawei Han 108 41 0 20 May 2022
A graph-transformer for whole slide image classification Yi Zheng R. Gindra Emily J. Green E. Burks Margrit Betke J. Beane V. Kolachalama MedIm 100 129 0 19 May 2022
Translation between Molecules and Natural Language Carl Edwards T. Lai Kevin Ros Garrett Honke Kyunghyun Cho Heng Ji 99 164 0 25 Apr 2022
Sign and Basis Invariant Networks for Spectral Graph Representation Learning Derek Lim Joshua Robinson Lingxiao Zhao Tess E. Smidt S. Sra Haggai Maron Stefanie Jegelka 80 147 0 25 Feb 2022
Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation Shizhe Chen Pierre-Louis Guhur Makarand Tapaswi Cordelia Schmid Ivan Laptev LM&Ro 89 142 0 23 Feb 2022
Message passing all the way up Petar Velickovic 148 66 0 22 Feb 2022
Revisiting Over-smoothing in BERT from the Perspective of Graph Han Shi Jiahui Gao Hang Xu Xiaodan Liang Zhenguo Li Lingpeng Kong Stephen M. S. Lee James T. Kwok 72 75 0 17 Feb 2022
Transformer for Graphs: An Overview from Architecture Perspective Erxue Min Runfa Chen Yatao Bian Tingyang Xu Kangfei Zhao Wenbing Huang P. Zhao Junzhou Huang Sophia Ananiadou Yu Rong 79 143 0 17 Feb 2022
Structure-Aware Transformer for Graph Representation Learning Dexiong Chen Leslie O’Bray Karsten Borgwardt 84 250 0 07 Feb 2022
TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentials Philipp Thölke Gianni De Fabritiis AI4CE 91 196 0 05 Feb 2022
Neighbour Interaction based Click-Through Rate Prediction via Graph-masked Transformer Erxue Min Yu Rong Tingyang Xu Yatao Bian P. Zhao Junzhou Huang Da Luo Kangyi Lin Sophia Ananiadou 85 35 0 25 Jan 2022
Weisfeiler and Leman go Machine Learning: The Story so far Christopher Morris Y. Lipman Haggai Maron Bastian Rieck Nils M. Kriege Martin Grohe Matthias Fey Karsten Borgwardt GNN 83 117 0 18 Dec 2021
Graph Structure Learning with Variational Information Bottleneck Qingyun Sun Jianxin Li Hao Peng Hongzhi Zhang Xingcheng Fu Cheng Ji Philip S. Yu 74 162 0 16 Dec 2021
SSAGCN: Social Soft Attention Graph Convolution Network for Pedestrian Trajectory Prediction Pei Lv Wentong Wang Yunxin Wang Yuzhen Zhang Mingliang Xu Changsheng Xu 69 42 0 05 Dec 2021
A Lightweight Graph Transformer Network for Human Mesh Reconstruction from 2D Human Pose Ce Zheng Matías Mendieta Pu Wang Aidong Lu Chong Chen 3DH 61 34 0 24 Nov 2021
Graph Neural Networks with Learnable Structural and Positional Representations Vijay Prakash Dwivedi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson GNN 266 327 0 15 Oct 2021
Improved Drug-target Interaction Prediction with Intermolecular Graph Transformer Siyuan Liu Yusong Wang Tong Wang Yifan Deng Liang He Jia Zhang Jian Yin Nanning Zheng Tie-Yan Liu 40 17 0 14 Oct 2021
Relative Molecule Self-Attention Transformer Lukasz Maziarka Dawid Majchrowski Tomasz Danel Piotr Gaiñski Jacek Tabor Igor T. Podolak Pawel M. Morkisz Stanislaw Jastrzebski MedIm 75 34 0 12 Oct 2021
Hybrid Graph Embedding Techniques in Estimated Time of Arrival Task Vadim Porvatov Natalia Semenova A. Chertok GNN AI4TS 43 3 0 08 Oct 2021
Geometric Transformers for Protein Interface Contact Prediction Alex Morehead Chen Chen Jianlin Cheng 81 29 0 06 Oct 2021
Molecule3D: A Benchmark for Predicting 3D Geometries from Molecular Graphs Zhao Xu Youzhi Luo Xuan Zhang Xinyi Xu Yaochen Xie Meng Liu Kaleb Dickerson Cheng Deng Maho Nakata Shuiwang Ji 68 40 0 30 Sep 2021
Global Self-Attention as a Replacement for Graph Convolution Md Shamim Hussain Mohammed J Zaki D. Subramanian ViT 62 127 0 07 Aug 2021
From block-Toeplitz matrices to differential equations on graphs: towards a general theory for scalable masked Transformers K. Choromanski Han Lin Haoxian Chen Tianyi Zhang Arijit Sehanobish Valerii Likhosherstov Jack Parker-Holder Tamás Sarlós Adrian Weller Thomas Weingarten 65 34 0 16 Jul 2021
Property-Aware Relation Networks for Few-Shot Molecular Property Prediction Yaqing Wang Abulikemu Abuduweili Quanming Yao Dejing Dou 77 70 0 16 Jul 2021
GraphiT: Encoding Graph Structure in Transformers Grégoire Mialon Dexiong Chen Margot Selosse Julien Mairal 103 168 0 10 Jun 2021
Rethinking Graph Transformers with Spectral Attention Devin Kreuzer Dominique Beaini William L. Hamilton Vincent Létourneau Prudencio Tossou 96 536 0 07 Jun 2021
GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graph Junhan Yang Zheng Liu Shitao Xiao Chaozhuo Li Defu Lian Sanjay Agrawal Amit Singh Guangzhong Sun Xing Xie AI4CE 47 157 0 06 May 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 278 2,453 0 20 Apr 2021
Evaluating Neural Word Embeddings for Sanskrit Kevin Qinghong Lin Om Adideva Digumarthi Komal Laxmidhar Behera Pawan Goyal 84 12 0 01 Apr 2021
SOON: Scenario Oriented Object Navigation with Graph-based Exploration Fengda Zhu Xiwen Liang Yi Zhu Xiaojun Chang Xiaodan Liang 57 123 0 31 Mar 2021
OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphs Weihua Hu Matthias Fey Hongyu Ren Maho Nakata Yuxiao Dong J. Leskovec AI4CE 72 413 0 17 Mar 2021