On the Theoretical Expressive Power and the Design Space of Higher-Order Graph Transformers

4 April 2024

Papers citing "On the Theoretical Expressive Power and the Design Space of Higher-Order Graph Transformers"

26 / 26 papers shown

Title
Strada-LLM: Graph LLM for traffic prediction Seyed Mohamad Moghadas Yangxintong Lyu Bruno Cornelis Alexandre Alahi Adrian Munteanu AI4TS 91 1 0 17 Feb 2025
Laplacian Canonization: A Minimalist Approach to Sign and Basis Invariant Spectral Embedding Jiangyan Ma Yifei Wang Yisen Wang 69 13 0 28 Oct 2023
Sumformer: Universal Approximation for Efficient Transformers Silas Alberti Niclas Dern L. Thesing Gitta Kutyniok 71 17 0 05 Jul 2023
From Relational Pooling to Subgraph GNNs: A Universal Framework for More Expressive Graph Neural Networks Cai Zhou Xiyuan Wang Muhan Zhang 53 14 0 08 May 2023
Pure Transformers are Powerful Graph Learners Jinwoo Kim Tien Dat Nguyen Seonwoo Min Sungjun Cho Moontae Lee Honglak Lee Seunghoon Hong 88 200 0 06 Jul 2022
Recipe for a General, Powerful, Scalable Graph Transformer Ladislav Rampášek Mikhail Galkin Vijay Prakash Dwivedi Anh Tuan Luu Guy Wolf Dominique Beaini 122 573 0 25 May 2022
Global Self-Attention as a Replacement for Graph Convolution Md Shamim Hussain Mohammed J Zaki D. Subramanian ViT 67 127 0 07 Aug 2021
Do Transformers Really Perform Bad for Graph Representation? Chengxuan Ying Tianle Cai Shengjie Luo Shuxin Zheng Guolin Ke Di He Yanming Shen Tie-Yan Liu GNN 95 441 0 09 Jun 2021
Rethinking Graph Transformers with Spectral Attention Devin Kreuzer Dominique Beaini William L. Hamilton Vincent Létourneau Prudencio Tossou 99 542 0 07 Jun 2021
Rethinking Attention with Performers K. Choromanski Valerii Likhosherstov David Dohan Xingyou Song Andreea Gane ... Afroz Mohiuddin Lukasz Kaiser David Belanger Lucy J. Colwell Adrian Weller 184 1,597 0 30 Sep 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 546 2,086 0 28 Jul 2020
The expressive power of kth-order invariant graph networks Floris Geerts 151 37 0 23 Jul 2020
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 201 1,771 0 29 Jun 2020
Improving Graph Neural Network Expressivity via Subgraph Isomorphism Counting Giorgos Bouritsas Fabrizio Frasca Stefanos Zafeiriou M. Bronstein 127 435 0 16 Jun 2020
Linformer: Self-Attention with Linear Complexity Sinong Wang Belinda Z. Li Madian Khabsa Han Fang Hao Ma 216 1,706 0 08 Jun 2020
Open Graph Benchmark: Datasets for Machine Learning on Graphs Weihua Hu Matthias Fey Marinka Zitnik Yuxiao Dong Hongyu Ren Bowen Liu Michele Catasta J. Leskovec 306 2,732 0 02 May 2020
Principal Neighbourhood Aggregation for Graph Nets Gabriele Corso Luca Cavalleri Dominique Beaini Pietro Lio Petar Velickovic GNN 114 668 0 12 Apr 2020
Longformer: The Long-Document Transformer Iz Beltagy Matthew E. Peters Arman Cohan RALM VLM 174 4,071 0 10 Apr 2020
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 312 597 0 12 Mar 2020
Benchmarking Graph Neural Networks Vijay Prakash Dwivedi Chaitanya K. Joshi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson 438 940 0 02 Mar 2020
Adaptively Sparse Transformers Gonçalo M. Correia Vlad Niculae André F. T. Martins 87 256 0 30 Aug 2019
Provably Powerful Graph Networks Haggai Maron Heli Ben-Hamu Hadar Serviansky Y. Lipman 120 579 0 27 May 2019
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 243 7,653 0 01 Oct 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 479 20,164 0 30 Oct 2017
Deep Sets Manzil Zaheer Satwik Kottur Siamak Ravanbakhsh Barnabás Póczós Ruslan Salakhutdinov Alex Smola 408 2,464 0 10 Mar 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 644 29,076 0 09 Sep 2016