Global Self-Attention as a Replacement for Graph Convolution

7 August 2021

Papers citing "Global Self-Attention as a Replacement for Graph Convolution"

30 / 80 papers shown

Title
Expressive Sign Equivariant Networks for Spectral Geometric Learning Derek Lim Joshua Robinson Stefanie Jegelka Haggai Maron 71 16 0 04 Dec 2023
Recurrent Distance Filtering for Graph Representation Learning Yuhui Ding Antonio Orvieto Bobby He Thomas Hofmann GNN 34 6 0 03 Dec 2023
Hybrid Focal and Full-Range Attention Based Graph Transformers Minhong Zhu Zhenhao Zhao Weiran Cai 32 0 0 08 Nov 2023
Facilitating Graph Neural Networks with Random Walk on Simplicial Complexes Cai Zhou Xiyuan Wang Muhan Zhang 36 14 0 30 Oct 2023
Multi-omics Sampling-based Graph Transformer for Synthetic Lethality Prediction Xusheng Zhao Hao Liu Qiong Dai Hao Peng Xu Bai Huailiang Peng 15 2 0 17 Oct 2023
Enhancing Graph Transformers with Hierarchical Distance Structural Encoding Yuan Luo Hongkang Li Lei Shi Xiao-Ming Wu 28 7 0 22 Aug 2023
SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learning Keyu Duan Qian Liu Tat-Seng Chua Shuicheng Yan Wei Tsang Ooi Qizhe Xie Junxian He 27 56 0 03 Aug 2023
SGFormer: Simplifying and Empowering Transformers for Large-Graph Representations Qitian Wu Wen-Long Zhao Chenxiao Yang Hengrui Zhang Fan Nie Haitian Jiang Yatao Bian Junchi Yan AI4CE 35 76 0 19 Jun 2023
Automated 3D Pre-Training for Molecular Property Prediction Xu Wang Huan Zhao Weiwei Tu Quanming Yao AI4CE 28 35 0 13 Jun 2023
The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles Md Shamim Hussain Mohammed J. Zaki D. Subramanian 37 3 0 02 Jun 2023
Graph Inductive Biases in Transformers without Message Passing Liheng Ma Chen Lin Derek Lim Adriana Romero Soriano P. Dokania Mark J. Coates Philip H. S. Torr Ser-Nam Lim AI4CE 28 85 0 27 May 2023
On Structural Expressive Power of Graph Transformers Wenhao Zhu Tianyu Wen Guojie Song Liangji Wang Bo Zheng 27 15 0 23 May 2023
GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphs Pengcheng Jiang Cao Xiao Adam Cross Jimeng Sun AI4MH 31 20 0 22 May 2023
Tokenized Graph Transformer with Neighborhood Augmentation for Node Classification in Large Graphs Jinsong Chen Chang-Shu Liu Kai-Xin Gao Gaichao Li Kun He 21 4 0 22 May 2023
Graph Propagation Transformer for Graph Representation Learning Zhe Chen Hao Hao Tan Tao Wang Tianrun Shen Tong Lu Qiuying Peng Cheng Cheng Yue Qi 27 11 0 19 May 2023
Self-Attention in Colors: Another Take on Encoding Graph Structure in Transformers Romain Menegaux Emmanuel Jehanno Margot Selosse Julien Mairal 21 6 0 21 Apr 2023
Highly Accurate Quantum Chemical Property Prediction with Uni-Mol+ Shuqi Lu Zhifeng Gao Di He Linfeng Zhang Guolin Ke 37 24 0 16 Mar 2023
Energy Transformer Benjamin Hoover Yuchen Liang Bao Pham Rameswar Panda Hendrik Strobelt Duen Horng Chau Mohammed J. Zaki Dmitry Krotov ViT 28 40 0 14 Feb 2023
Attending to Graph Transformers Luis Muller Mikhail Galkin Christopher Morris Ladislav Rampášek 49 86 0 08 Feb 2023
GPS++: Reviving the Art of Message Passing for Molecular Property Prediction Dominic Masters Josef Dean Kerstin Klaser Zhiyi Li Sam Maddrell-Mander ... D. Beker Andrew Fitzgibbon Shenyang Huang Ladislav Rampášek Dominique Beaini 30 8 0 06 Feb 2023
Transformers Meet Directed Graphs Simon Geisler Yujia Li D. Mankowitz A. Cemgil Stephan Günnemann Cosmin Paduraru 27 35 0 31 Jan 2023
On the Connection Between MPNN and Graph Transformer Chen Cai Truong Son-Hy Rose Yu Yusu Wang 33 51 0 27 Jan 2023
Coordinating Cross-modal Distillation for Molecular Property Prediction Hao Zhang N. Zhang Ruixin Zhang Lei Shen Yingyi Zhang Meng Liu 22 1 0 30 Nov 2022
GPS++: An Optimised Hybrid MPNN/Transformer for Molecular Property Prediction Dominic Masters Josef Dean Kerstin Klaser Zhiyi Li Sam Maddrell-Mander Adam Sanders Hatem Helal D. Beker Ladislav Rampášek Dominique Beaini 29 23 0 18 Nov 2022
NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphs Jinsong Chen Kaiyuan Gao Gaichao Li Kun He 16 64 0 10 Jun 2022
Empowering GNNs via Edge-Aware Weisfeiler-Leman Algorithm Meng Liu Haiyang Yu Shuiwang Ji 33 1 0 04 Jun 2022
Recipe for a General, Powerful, Scalable Graph Transformer Ladislav Rampášek Mikhail Galkin Vijay Prakash Dwivedi A. Luu Guy Wolf Dominique Beaini 57 514 0 25 May 2022
On the Global Self-attention Mechanism for Graph Convolutional Networks Chen Wang Chengyuan Deng GNN 29 4 0 21 Oct 2020
Heterogeneous Graph Transformer Ziniu Hu Yuxiao Dong Kuansan Wang Yizhou Sun 185 1,170 0 03 Mar 2020
Benchmarking Graph Neural Networks Vijay Prakash Dwivedi Chaitanya K. Joshi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson 189 916 0 02 Mar 2020