Recipe for a General, Powerful, Scalable Graph Transformer

25 May 2022

Ladislav Rampášek

Mikhail Galkin

Vijay Prakash Dwivedi

A. Luu

Guy Wolf

Dominique Beaini

ArXiv PDF HTML

Papers citing "Recipe for a General, Powerful, Scalable Graph Transformer"

44 / 344 papers shown

Title
Single-Cell Multimodal Prediction via Transformers Wenzhuo Tang Haifang Wen Renming Liu Jiayuan Ding Wei Jin Yuying Xie Hui Liu Jiliang Tang AI4CE 24 11 0 01 Mar 2023
GNNDelete: A General Strategy for Unlearning in Graph Neural Networks Jiali Cheng George Dasoulas Huan He Chirag Agarwal Marinka Zitnik MU 37 36 0 26 Feb 2023
Equivariant Polynomials for Graph Neural Networks Omri Puny Derek Lim B. Kiani Haggai Maron Y. Lipman 30 31 0 22 Feb 2023
HINormer: Representation Learning On Heterogeneous Information Networks with Graph Transformer Qiheng Mao Zemin Liu Chenghao Liu Jianling Sun 42 56 0 22 Feb 2023
G-Signatures: Global Graph Propagation With Randomized Signatures Bernhard Schafl Lukas Gruber Johannes Brandstetter Sepp Hochreiter 22 2 0 17 Feb 2023
Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Hierarchical Structures Nhat-Khang Ngô Truong-Son Hy Risi Kondor ViT AI4CE 31 2 0 17 Feb 2023
A Survey on Spectral Graph Neural Networks Deyu Bo Xiao Wang Yang Liu Yuan Fang Yawen Li Chuan Shi 35 25 0 11 Feb 2023
Attending to Graph Transformers Luis Muller Mikhail Galkin Christopher Morris Ladislav Rampášek 52 86 0 08 Feb 2023
GPS++: Reviving the Art of Message Passing for Molecular Property Prediction Dominic Masters Josef Dean Kerstin Klaser Zhiyi Li Sam Maddrell-Mander ... D. Beker Andrew Fitzgibbon Shenyang Huang Ladislav Rampášek Dominique Beaini 38 8 0 06 Feb 2023
On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology Francesco Di Giovanni Lorenzo Giusti Federico Barbero Giulia Luise Pietro Lio Michael M. Bronstein 48 112 0 06 Feb 2023
Single Cells Are Spatial Tokens: Transformers for Spatial Transcriptomic Data Imputation Haifang Wen Wenzhuo Tang Wei Jin Jiayuan Ding Renming Liu Xinnan Dai Feng Shi Lulu Shang Jiliang Tang Yuying Xie 29 9 0 06 Feb 2023
Transformers Meet Directed Graphs Simon Geisler Yujia Li D. Mankowitz A. Cemgil Stephan Günnemann Cosmin Paduraru 27 35 0 31 Jan 2023
Graph Mixer Networks Ahmet Sarigün 20 0 0 29 Jan 2023
On the Connection Between MPNN and Graph Transformer Chen Cai Truong-Son Hy Rose Yu Yusu Wang 41 52 0 27 Jan 2023
State of the Art and Potentialities of Graph-level Learning Zhenyu Yang Ge Zhang Jia Wu Jian Yang Quan.Z Sheng ... Charu C. Aggarwal Hao Peng Wenbin Hu Edwin R. Hancock Pietro Lio GNN AI4CE 40 10 0 14 Jan 2023
A Generalization of ViT/MLP-Mixer to Graphs Xiaoxin He Bryan Hooi T. Laurent Adam Perold Yann LeCun Xavier Bresson 47 88 0 27 Dec 2022
SLGTformer: An Attention-Based Approach to Sign Language Recognition Neil Song Yu Xiang SLR 30 0 0 21 Dec 2022
Coordinating Cross-modal Distillation for Molecular Property Prediction Hao Zhang N. Zhang Ruixin Zhang Lei Shen Yingyi Zhang Meng Liu 28 1 0 30 Nov 2022
GPS++: An Optimised Hybrid MPNN/Transformer for Molecular Property Prediction Dominic Masters Josef Dean Kerstin Klaser Zhiyi Li Sam Maddrell-Mander Adam Sanders Hatem Helal D. Beker Ladislav Rampášek Dominique Beaini 29 23 0 18 Nov 2022
Explaining the Explainers in Graph Neural Networks: a Comparative Study Antonio Longa Steve Azzolin G. Santin G. Cencetti Pietro Lio Bruno Lepri Andrea Passerini 46 28 0 27 Oct 2022
Transformers over Directed Acyclic Graphs Yu Luo Veronika Thost Lei Shi GNN AI4CE 40 16 0 24 Oct 2022
Extending Graph Transformers with Quantum Computed Aggregation Slimane Thabet Romain Fouilland L. Henriet GNN 33 3 0 19 Oct 2022
FIMP: Foundation Model-Informed Message Passing for Graph Neural Networks S. Rizvi Nazreen Pallikkavaliyaveetil David Zhang Zhuoyang Lyu Nhi Nguyen ... Amin Karbasi Rex Ying Maria Brbić Rahul M. Dhodapkar David van Dijk GNN AI4CE 21 1 0 17 Oct 2022
LogGD:Detecting Anomalies from System Logs by Graph Neural Networks Yongzhen Xie Hongyu Zhang M. Babar AI4TS 12 20 0 16 Sep 2022
Tuple Packing: Efficient Batching of Small Graphs in Graph Neural Networks M. M. Krell Manuel Lopez Roldan Sreenidhi Anand Hatem Helal Andrew William Fitzgibbon 19 0 0 14 Sep 2022
Graph Neural Networks for Molecules Yuyang Wang Zijie Li A. Farimani GNN AI4CE 45 20 0 12 Sep 2022
Multimodal learning with graphs Yasha Ektefaie George Dasoulas Ayush Noori Maha Farhat Marinka Zitnik 51 83 0 07 Sep 2022
Complex-Value Spatio-temporal Graph Convolutional Neural Networks and its Applications to Electric Power Systems AI Tong Wu Anna Scaglione D. Arnold GNN 31 11 0 17 Aug 2022
GEM-2: Next Generation Molecular Property Prediction Network by Modeling Full-range Many-body Interactions Lihang Liu Donglong He Xiaomin Fang Shanzhuo Zhang Fan Wang Jingzhou He Hua Wu 27 3 0 11 Aug 2022
Long Range Graph Benchmark Vijay Prakash Dwivedi Ladislav Rampášek Mikhail Galkin Alipanah Parviz Guy Wolf A. Luu Dominique Beaini 26 195 0 16 Jun 2022
DiffWire: Inductive Graph Rewiring via the Lovász Bound Adrián Arnaiz-Rodríguez Ahmed Begga Francisco Escolano Nuria Oliver 32 62 0 15 Jun 2022
NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphs Jinsong Chen Kaiyuan Gao Gaichao Li Kun He 36 102 0 10 Jun 2022
Sparse Graph Learning from Spatiotemporal Time Series Andrea Cini Daniele Zambon Cesare Alippi CML AI4TS 43 18 0 26 May 2022
GRPE: Relative Positional Encoding for Graph Transformer Wonpyo Park Woonggi Chang Donggeon Lee Juntae Kim Seung-won Hwang 41 75 0 30 Jan 2022
Rewiring with Positional Encodings for Graph Neural Networks Rickard Brüel-Gabrielsson Mikhail Yurochkin Justin Solomon AI4CE 25 32 0 29 Jan 2022
Self-Supervised Graph Representation Learning for Neuronal Morphologies Marissa A. Weis Laura Hansel Timo Lüddecke Alexander S. Ecker MedIm 25 7 0 23 Dec 2021
The Klarna Product Page Dataset: Web Element Nomination with Graph Neural Networks and Large Language Models A. Hotti Riccardo Sven Risuleo Stefan Magureanu Aref Moradi J. Lagergren 27 4 0 03 Nov 2021
Graph Neural Networks with Learnable Structural and Positional Representations Vijay Prakash Dwivedi A. Luu T. Laurent Yoshua Bengio Xavier Bresson GNN 197 309 0 15 Oct 2021
CMT: Convolutional Neural Networks Meet Vision Transformers Jianyuan Guo Kai Han Han Wu Yehui Tang Chunjing Xu Yunhe Wang Chang Xu ViT 351 500 0 13 Jul 2021
An Impossibility Theorem for Node Embedding T. Roddenberry Yu Zhu Santiago Segarra 30 0 0 27 May 2021
Walking Out of the Weisfeiler Leman Hierarchy: Graph Learning Beyond Message Passing Jan Toenshoff Martin Ritzert Hinrikus Wolf Martin Grohe GNN 84 28 0 17 Feb 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 285 2,017 0 28 Jul 2020
A Survey on The Expressive Power of Graph Neural Networks Ryoma Sato 184 172 0 09 Mar 2020
Benchmarking Graph Neural Networks Vijay Prakash Dwivedi Chaitanya K. Joshi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson 189 917 0 02 Mar 2020