Graph Inductive Biases in Transformers without Message Passing

27 May 2023

Liheng Ma

Chen Lin

Derek Lim

Adriana Romero Soriano

Ser-Nam Lim

Papers citing "Graph Inductive Biases in Transformers without Message Passing"

50 / 74 papers shown

Title
Learning Laplacian Positional Encodings for Heterophilous Graphs Michael Ito Jiong Zhu Dexiong Chen Danai Koutra Jenna Wiens 133 1 0 29 Apr 2025
Simplifying Graph Transformers Liheng Ma Soumyasundar Pal Yingxue Zhang Philip H. S. Torr Mark J. Coates 26 0 0 17 Apr 2025
Improving Equivariant Networks with Probabilistic Symmetry Breaking Hannah Lawrence Vasco Portilheiro Yan Zhang Sékou-Oumar Kaba 47 3 0 27 Mar 2025
A Survey of Graph Transformers: Architectures, Theories and Applications Chaohao Yuan Kangfei Zhao Ercan Engin Kuruoglu Liang Wang Tingyang Xu Wenbing Huang Deli Zhao Hong Cheng Yu Rong 57 4 0 23 Feb 2025
Graph Self-Supervised Learning with Learnable Structural and Positional Encodings Asiri Wijesinghe Hao Zhu Piotr Koniusz 48 0 0 22 Feb 2025
Simple Path Structural Encoding for Graph Transformers Louis Airale Antonio Longa Mattia Rigon Andrea Passerini Roberto Passerone 95 0 0 13 Feb 2025
Unlocking the Potential of Classic GNNs for Graph-level Tasks: Simple Architectures Meet Excellence Yuankai Luo Lei Shi Xiao-Ming Wu AI4CE 72 0 0 13 Feb 2025
Biologically Plausible Brain Graph Transformer Ciyuan Peng Yuelong Huang Qichao Dong Shuo Yu Feng Xia Chengqi Zhang Yaochu Jin 61 1 0 13 Feb 2025
Learning Efficient Positional Encodings with Graph Neural Networks Charilaos I. Kanatsoulis Evelyn Choi Stephanie Jegelka Jure Leskovec Alejandro Ribeiro 64 1 0 03 Feb 2025
GraphMinNet: Learning Dependencies in Graphs with Light Complexity Minimal Architecture Md. Atik Ahamed Andrew Cheng Q. Ye Q. Cheng GNN 53 0 0 01 Feb 2025
Graph Triple Attention Network: A Decoupled Perspective Xiaotang Wang Yun Zhu Haizhou Shi Yongchao Liu Chuntao Hong 67 2 0 03 Jan 2025
Edge Weight Prediction For Category-Agnostic Pose Estimation Or Hirschorn S. Avidan 76 0 0 25 Nov 2024
Best of Both Worlds: Advantages of Hybrid Graph Sequence Models Ali Behrouz Ali Parviz Mahdi Karami Clayton Sanford Bryan Perozzi Vahab Mirrokni 84 2 0 23 Nov 2024
Sparse Decomposition of Graph Neural Networks Yaochen Hu Mai Zeng Ge Zhang P. Rumiantsev Liheng Ma Yingxue Zhang Mark Coates 32 0 0 25 Oct 2024
Homomorphism Counts as Structural Encodings for Graph Learning Linus Bao Emily Jin Michael M. Bronstein .Ismail .Ilkan Ceylan Matthias Lanzinger 30 1 0 24 Oct 2024
Graph Transformers Dream of Electric Flow Xiang Cheng Lawrence Carin S. Sra 33 0 0 22 Oct 2024
Rethinking Graph Transformer Architecture Design for Node Classification Jiajun Zhou Xuanze Chen Chenxuan Xie Yu Shanqing Qi Xuan Xiaoniu Yang 28 0 0 15 Oct 2024
Unitary convolutions for learning on graphs and groups B. Kiani Lukas Fesser Melanie Weber GNN 40 1 0 07 Oct 2024
Range-aware Positional Encoding via High-order Pretraining: Theory and Practice Viet Anh Nguyen Nhat-Khang Ngô Truong Son-Hy AI4CE 27 0 0 27 Sep 2024
KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning Junnan Liu Qianren Mao Weifeng Jiang Jianxin Li 35 0 0 19 Sep 2024
Learning to Model Graph Structural Information on MLPs via Graph Structure Self-Contrasting Lirong Wu Haitao Lin Guojiang Zhao Cheng Tan Stan Z. Li 28 0 0 09 Sep 2024
SAMSA: Efficient Transformer for Many Data Modalities Minh Lenhat Viet Anh Nguyen Khoa Nguyen Duong Duc Hieu Dao Huu Hung Truong Son-Hy 49 0 0 10 Aug 2024
Relaxing Graph Transformers for Adversarial Attacks Philipp Foth Lukas Gosch Simon Geisler Leo Schwinn Stephan Günnemann AAML 50 1 0 16 Jul 2024
Graph Transformers: A Survey Ahsan Shehzad Feng Xia Shagufta Abid Ciyuan Peng Shuo Yu Dongyu Zhang Karin Verspoor AI4CE 34 9 0 13 Jul 2024
INSIGHT: Universal Neural Simulator for Analog Circuits Harnessing Autoregressive Transformers Souradip Poddar Youngmin Oh Yao Lai Hanqing Zhu Bosun Hwang David Z. Pan 27 2 0 10 Jul 2024
Differential Encoding for Improved Representation Learning over Graphs Haimin Zhang Jiahao Xia Min Xu 45 0 0 03 Jul 2024
Next Level Message-Passing with Hierarchical Support Graphs Carlos Vonessen Florian Grötschla Roger Wattenhofer 47 1 0 22 Jun 2024
Pathformer: Recursive Path Query Encoding for Complex Logical Query Answering Chongzhi Zhang Zhiping Peng Junhao Zheng Linghao Wang Ruifeng Shi Qianli Ma 41 1 0 21 Jun 2024
A Scalable and Effective Alternative to Graph Transformers Kaan Sancak Zhigang Hua Jin Fang Yan Xie Andrey Malevich Bo Long M. F. Balin Ümit V. Çatalyürek 48 1 0 17 Jun 2024
Cometh: A continuous-time discrete-state graph diffusion model Antoine Siraudin Fragkiskos D. Malliaros Christopher Morris 41 3 0 10 Jun 2024
What Can We Learn from State Space Models for Machine Learning on Graphs? Yinan Huang Siqi Miao Pan Li 44 7 0 09 Jun 2024
On the Expressive Power of Spectral Invariant Graph Neural Networks Bohang Zhang Lingxiao Zhao Haggai Maron 56 8 0 06 Jun 2024
Learning Long Range Dependencies on Graphs via Random Walks Dexiong Chen Till Hendrik Schulz Karsten Borgwardt 34 2 0 05 Jun 2024
GLADformer: A Mixed Perspective for Graph-level Anomaly Detection Fan Xu Nan Wang Hao Wu Xuezhi Wen Dalin Zhang Siyang Lu Binyong Li Wei Gong Hai Wan Xibin Zhao 41 1 0 02 Jun 2024
Graph External Attention Enhanced Transformer Jianqing Liang Min Chen Jiye Liang 38 1 0 31 May 2024
Joint Embeddings for Graph Instruction Tuning Vlad Argatu Aaron Haag Oliver Lohse 44 0 0 31 May 2024
Spatio-Spectral Graph Neural Networks Simon Geisler Arthur Kosmala Daniel Herbst Stephan Günnemann 50 8 0 29 May 2024
Probabilistic Graph Rewiring via Virtual Nodes Chendi Qian Andrei Manolache Christopher Morris Mathias Niepert AI4CE 38 3 0 27 May 2024
Understanding Virtual Nodes: Oversquashing and Node Heterogeneity Joshua Southern Francesco Di Giovanni Michael M. Bronstein J. Lutzeyer 57 1 0 22 May 2024
A General Graph Spectral Wavelet Convolution via Chebyshev Order Decomposition Nian Liu Xiaoxin He T. Laurent Francesco Di Giovanni Michael M. Bronstein Xavier Bresson 43 1 0 22 May 2024
Graph as Point Set Xiyuan Wang Pan Li Muhan Zhang GNN 3DPC PINN 44 4 0 05 May 2024
CKGConv: General Graph Convolution with Continuous Kernels Liheng Ma Soumyasundar Pal Yitian Zhang Jiaming Zhou Yingxue Zhang Mark J. Coates 37 3 0 21 Apr 2024
Improving Chinese Character Representation with Formation Tree Yang Hong Yinfei Li Xiaojun Qiao Rui Li Junsong Zhang VLM 32 1 0 19 Apr 2024
On the Theoretical Expressive Power and the Design Space of Higher-Order Graph Transformers Cai Zhou Rose Yu Yusu Wang 41 7 0 04 Apr 2024
VCR-Graphormer: A Mini-batch Graph Transformer via Virtual Connections Dongqi Fu Zhigang Hua Yan Xie Jin Fang Si Zhang Kaan Sancak Hao Wu Andrey Malevich Jingrui He Bo Long 42 19 0 24 Mar 2024
FlowerFormer: Empowering Neural Architecture Encoding using a Flow-aware Graph Transformer Dongyeong Hwang Hyunju Kim Sunwoo Kim Kijung Shin AI4CE 56 2 0 19 Mar 2024
Almost Surely Asymptotically Constant Graph Neural Networks Sam Adam-Day Michael Benedikt .Ismail .Ilkan Ceylan Ben Finkelshtein GNN 71 2 0 06 Mar 2024
Polynormer: Polynomial-Expressive Graph Transformer in Linear Time Chenhui Deng Zichao Yue Zhiru Zhang 93 23 0 02 Mar 2024
Comparing Graph Transformers via Positional Encodings Mitchell Black Zhengchao Wan Gal Mishne A. Nayyeri Yusu Wang 37 10 0 22 Feb 2024
Conditional Logical Message Passing Transformer for Complex Query Answering Chongzhi Zhang Zhiping Peng Junhao Zheng Qianli Ma 32 1 0 20 Feb 2024