Graph Inductive Biases in Transformers without Message Passing

27 May 2023

Liheng Ma

Chen Lin

Derek Lim

Adriana Romero Soriano

Ser-Nam Lim

Papers citing "Graph Inductive Biases in Transformers without Message Passing"

24 / 74 papers shown

Title
Message Detouring: A Simple Yet Effective Cycle Representation for Expressive Graph Learning Ziquan Wei Tingting Dan Guorong Wu 43 0 0 12 Feb 2024
Pard: Permutation-Invariant Autoregressive Diffusion for Graph Generation Lingxiao Zhao Xueying Ding Leman Akoglu DiffM 29 8 0 06 Feb 2024
Graph Transformers without Positional Encodings Ayush Garg 27 0 0 31 Jan 2024
A Survey on Structure-Preserving Graph Transformers Van Thuy Hoang O-Joun Lee 51 5 0 29 Jan 2024
Towards Principled Graph Transformers Luis Muller Daniel Kusuma Blai Bonet Christopher Morris 33 3 0 18 Jan 2024
Adaptive Message Passing: A General Framework to Mitigate Oversmoothing, Oversquashing, and Underreaching Federico Errica Henrik Christiansen Viktor Zaverkin Takashi Maruyama Mathias Niepert Francesco Alesiani 60 7 0 27 Dec 2023
Hypergraph Transformer for Semi-Supervised Classification Zexi Liu Bohan Tang Ziyuan Ye Xiaowen Dong Siheng Chen Yanfeng Wang 39 4 0 18 Dec 2023
Graph Metanetworks for Processing Diverse Neural Architectures Derek Lim Haggai Maron Marc T. Law Jonathan Lorraine James Lucas AI4CE 34 31 0 07 Dec 2023
Recurrent Distance Filtering for Graph Representation Learning Yuhui Ding Antonio Orvieto Bobby He Thomas Hofmann GNN 36 6 0 03 Dec 2023
Hybrid Focal and Full-Range Attention Based Graph Transformers Minhong Zhu Zhenhao Zhao Weiran Cai 32 0 0 08 Nov 2023
Facilitating Graph Neural Networks with Random Walk on Simplicial Complexes Cai Zhou Xiyuan Wang Muhan Zhang 38 15 0 30 Oct 2023
Graph AI in Medicine Ruth Johnson Michelle M. Li Ayush Noori Owen Queen Marinka Zitnik 29 3 0 20 Oct 2023
Jointly-Learned Exit and Inference for a Dynamic Neural Network : JEI-DNN Florence Regol Joud Chataoui Mark J. Coates 32 6 0 13 Oct 2023
GraphLLM: Boosting Graph Reasoning Ability of Large Language Model Ziwei Chai Tianjie Zhang Liang Wu Kaiqiao Han Xiaohai Hu Xuanwen Huang Yang Yang AI4MH LRM 19 58 0 09 Oct 2023
Cooperative Graph Neural Networks Ben Finkelshtein Xingyue Huang Michael M. Bronstein .Ismail .Ilkan Ceylan GNN 40 20 0 02 Oct 2023
Where Did the Gap Go? Reassessing the Long-Range Graph Benchmark Jan Tonshoff Martin Ritzert Eran Rosenbluth Martin Grohe 24 47 0 01 Sep 2023
Enhancing Graph Transformers with Hierarchical Distance Structural Encoding Yuan Luo Hongkang Li Lei Shi Xiao-Ming Wu 31 7 0 22 Aug 2023
Attending to Graph Transformers Luis Muller Mikhail Galkin Christopher Morris Ladislav Rampášek 52 86 0 08 Feb 2023
Empowering GNNs via Edge-Aware Weisfeiler-Leman Algorithm Meng Liu Haiyang Yu Shuiwang Ji 38 1 0 04 Jun 2022
Your Transformer May Not be as Powerful as You Expect Shengjie Luo Shanda Li Shuxin Zheng Tie-Yan Liu Liwei Wang Di He 70 51 0 26 May 2022
GRPE: Relative Positional Encoding for Graph Transformer Wonpyo Park Woonggi Chang Donggeon Lee Juntae Kim Seung-won Hwang 41 75 0 30 Jan 2022
Graph Neural Networks with Learnable Structural and Positional Representations Vijay Prakash Dwivedi A. Luu T. Laurent Yoshua Bengio Xavier Bresson GNN 197 309 0 15 Oct 2021
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges M. Bronstein Joan Bruna Taco S. Cohen Petar Velivcković GNN 176 1,111 0 27 Apr 2021
Benchmarking Graph Neural Networks Vijay Prakash Dwivedi Chaitanya K. Joshi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson 189 917 0 02 Mar 2020