Pure Transformers are Powerful Graph Learners

6 July 2022

Papers citing "Pure Transformers are Powerful Graph Learners"

50 / 134 papers shown

Title
Attention Mechanisms Perspective: Exploring LLM Processing of Graph-Structured Data Zhong Guan Likang Wu Hongke Zhao Ming He Jianpin Fan GNN 34 0 0 04 May 2025
Between Linear and Sinusoidal: Rethinking the Time Encoder in Dynamic Graph Learning Hsing-Huan Chung Shravan Chaudhari Xing Han Yoav Wald S. Saria Joydeep Ghosh AI4TS 36 0 0 10 Apr 2025
GraphRAFT: Retrieval Augmented Fine-Tuning for Knowledge Graphs on Graph Databases Alfred Clemedtson Borun Shi RALM 63 0 0 07 Apr 2025
Enhancing Job Salary Prediction with Disentangled Composition Effect Modeling: A Neural Prototyping Approach Yang Ji Ying Sun Hengshu Zhu 46 0 0 17 Mar 2025
Depth-Width tradeoffs in Algorithmic Reasoning of Graph Tasks with Transformers Gilad Yehudai Clayton Sanford Maya Bechler-Speicher Orr Fischer Ran Gilad-Bachrach Amir Globerson 55 0 0 03 Mar 2025
Auto-encoding Molecules: Graph-Matching Capabilities Matter Magnus Cunow Gerrit Großmann GNN 40 0 0 01 Mar 2025
A Survey of Graph Transformers: Architectures, Theories and Applications Chaohao Yuan Kangfei Zhao Ercan Engin Kuruoglu Liang Wang Tingyang Xu Wenbing Huang Deli Zhao Hong Cheng Yu Rong 55 4 0 23 Feb 2025
MOB-GCN: A Novel Multiscale Object-Based Graph Neural Network for Hyperspectral Image Classification Tuan-Anh Yang Truong-Son Hy Phuong D. Dao 41 0 0 22 Feb 2025
Position: Graph Learning Will Lose Relevance Due To Poor Benchmarks Maya Bechler-Speicher Ben Finkelshtein Fabrizio Frasca Luis Muller Jan Tonshoff ... Michael M. Bronstein Mathias Niepert Bryan Perozzi Mikhail Galkin Christopher Morris OOD 97 2 0 21 Feb 2025
Learning Efficient Positional Encodings with Graph Neural Networks Charilaos I. Kanatsoulis Evelyn Choi Stephanie Jegelka Jure Leskovec Alejandro Ribeiro 64 1 0 03 Feb 2025
TART: Token-based Architecture Transformer for Neural Network Performance Prediction Yannis Y. He 40 0 0 02 Jan 2025
GrokFormer: Graph Fourier Kolmogorov-Arnold Transformers Guoguo Ai Guansong Pang Hezhe Qiao Yuan Gao Hui Yan 67 0 0 26 Nov 2024
Best of Both Worlds: Advantages of Hybrid Graph Sequence Models Ali Behrouz Ali Parviz Mahdi Karami Clayton Sanford Bryan Perozzi Vahab Mirrokni 81 2 0 23 Nov 2024
TESGNN: Temporal Equivariant Scene Graph Neural Networks for Efficient and Robust Multi-View 3D Scene Understanding Quang P.M. Pham Khoi T.N. Nguyen Lan C. Ngo Dezhen Song Truong Do Truong Son-Hy 3DPC 34 2 0 15 Nov 2024
Graph Linearization Methods for Reasoning on Graphs with Large Language Models Christos Xypolopoulos Guokan Shang Xiao Fei Giannis Nikolentzos Hadi Abdine Iakovos Evdaimon Michail Chatzianastasis Giorgos Stamou Michalis Vazirgiannis 19 1 0 25 Oct 2024
Multi-view biomedical foundation models for molecule-target and property prediction Parthasarathy Suryanarayanan Yunguang Qiu Shreyans Sethi Diwakar Mahajan Hongyang Li ... Bum Chul Kwon Pablo Meyer Feixiong Cheng Jianying Hu Joseph A. Morrone AI4CE 33 0 0 25 Oct 2024
Graph Transformers Dream of Electric Flow Xiang Cheng Lawrence Carin S. Sra 33 0 0 22 Oct 2024
Towards Stable, Globally Expressive Graph Representations with Laplacian Eigenvectors Junru Zhou Cai Zhou Xiyuan Wang Pan Li Muhan Zhang 37 0 0 13 Oct 2024
Range-aware Positional Encoding via High-order Pretraining: Theory and Practice Viet Anh Nguyen Nhat-Khang Ngô Truong Son-Hy AI4CE 27 0 0 27 Sep 2024
Supra-Laplacian Encoding for Transformer on Dynamic Graphs Yannis Karmim Marc Lafon Raphael Fournier SÑiehotta Nicolas Thome 30 0 0 26 Sep 2024
Graph Reasoning with Large Language Models via Pseudo-code Prompting Konstantinos Skianis Giannis Nikolentzos Michalis Vazirgiannis LRM ReLM 35 4 0 26 Sep 2024
NeuroPath: A Neural Pathway Transformer for Joining the Dots of Human Connectomes Ziquan Wei Tingting Dan Jiaqi Ding Guorong Wu MedIm 40 0 0 26 Sep 2024
KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning Junnan Liu Qianren Mao Weifeng Jiang Jianxin Li 32 0 0 19 Sep 2024
Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detection Siyuan Yao Hao Sun Tian-Zhu Xiang Xiao Wang Xiaochun Cao 26 8 0 27 Aug 2024
Linear Attention is Enough in Spatial-Temporal Forecasting Xinyu Ning AI4TS 40 0 0 17 Aug 2024
wav2graph: A Framework for Supervised Learning Knowledge Graph from Speech Khai Le-Duc Quy-Anh Dang Tan-Hanh Pham Truong Son-Hy 32 0 0 08 Aug 2024
Graph Transformers: A Survey Ahsan Shehzad Feng Xia Shagufta Abid Ciyuan Peng Shuo Yu Dongyu Zhang Karin Verspoor AI4CE 34 9 0 13 Jul 2024
Foundations and Frontiers of Graph Learning Theory Yu Huang Min Zhou Menglin Yang Zhen Wang Muhan Zhang Jie Wang Hong Xie Hao Wang Defu Lian Enhong Chen AI4CE GNN 55 2 0 03 Jul 2024
Reasoning in Large Language Models: A Geometric Perspective Romain Cosentino Sarath Shekkizhar LRM 44 2 0 02 Jul 2024
SE(3)-Hyena Operator for Scalable Equivariant Learning Artem Moskalev Mangal Prakash Rui Liao Tommaso Mansi 46 2 0 01 Jul 2024
Revisiting Random Walks for Learning on Graphs Jinwoo Kim Olga Zaghen Ayhan Suleymanzade Youngmin Ryou Seunghoon Hong 59 0 0 01 Jul 2024
Leveraging Contrastive Learning for Enhanced Node Representations in Tokenized Graph Transformers Jinsong Chen Hanpeng Liu J. Hopcroft Kun He 41 1 0 27 Jun 2024
NTFormer: A Composite Node Tokenized Graph Transformer for Node Classification Jinsong Chen Siyu Jiang Kun He 44 1 0 27 Jun 2024
GeoMFormer: A General Architecture for Geometric Molecular Representation Learning Tianlang Chen Shengjie Luo Di He Shuxin Zheng Tie-Yan Liu Liwei Wang AI4CE 38 5 0 24 Jun 2024
What Can We Learn from State Space Models for Machine Learning on Graphs? Yinan Huang Siqi Miao Pan Li 44 7 0 09 Jun 2024
Graph Mining under Data scarcity Appan Rakaraddi Lam Siew-Kei Mahardhika Pratama Marcus Vinícius de Carvalho BDL 36 0 0 07 Jun 2024
On the Expressive Power of Spectral Invariant Graph Neural Networks Bohang Zhang Lingxiao Zhao Haggai Maron 50 8 0 06 Jun 2024
Understanding Transformer Reasoning Capabilities via Graph Algorithms Clayton Sanford Bahare Fatemi Ethan Hall Anton Tsitsulin Seyed Mehran Kazemi Jonathan J. Halcrow Bryan Perozzi Vahab Mirrokni 36 29 0 28 May 2024
Probabilistic Graph Rewiring via Virtual Nodes Chendi Qian Andrei Manolache Christopher Morris Mathias Niepert AI4CE 38 3 0 27 May 2024
HeteGraph-Mamba: Heterogeneous Graph Learning via Selective State Space Model Zhenyu Pan Yoonsung Jeong Xiaoda Liu Han Liu 42 1 0 22 May 2024
Distinguished In Uniform: Self Attention Vs. Virtual Nodes Eran Rosenbluth Jan Tonshoff Martin Ritzert Berke Kisin Martin Grohe 23 12 0 20 May 2024
Discrete-state Continuous-time Diffusion for Graph Generation Zhe Xu Ruizhong Qiu Yuzhong Chen Huiyuan Chen Xiran Fan Menghai Pan Zhichen Zeng Mahashweta Das Hanghang Tong 41 8 0 19 May 2024
CKGConv: General Graph Convolution with Continuous Kernels Liheng Ma Soumyasundar Pal Yitian Zhang Jiaming Zhou Yingxue Zhang Mark J. Coates 37 3 0 21 Apr 2024
GraphER: A Structure-aware Text-to-Graph Model for Entity and Relation Extraction Urchade Zaratiana Nadi Tomeh Niama El Khbir Pierre Holat Thierry Charnois 36 1 0 18 Apr 2024
CSA-Trans: Code Structure Aware Transformer for AST Saeyoon Oh Shin Yoo 38 1 0 07 Apr 2024
On the Theoretical Expressive Power and the Design Space of Higher-Order Graph Transformers Cai Zhou Rose Yu Yusu Wang 39 7 0 04 Apr 2024
DE-HNN: An effective neural model for Circuit Netlist representation Zhishang Luo Truong Son-Hy Puoya Tabaghi Donghyeon Koh Michael Defferrard Elahe Rezaei Ryan Carey William Rhett Davis Rajeev Jain Yusu Wang 16 5 0 30 Mar 2024
VCR-Graphormer: A Mini-batch Graph Transformer via Virtual Connections Dongqi Fu Zhigang Hua Yan Xie Jin Fang Si Zhang Kaan Sancak Hao Wu Andrey Malevich Jingrui He Bo Long 39 19 0 24 Mar 2024
Cell Graph Transformer for Nuclei Classification Wei Lou Guanbin Li Xiang Wan Haofeng Li ViT MedIm 55 4 0 20 Feb 2024
Graph Mamba: Towards Learning on Graphs with State Space Models Ali Behrouz Farnoosh Hashemi AI4CE 109 58 0 13 Feb 2024