GraphiT: Encoding Graph Structure in Transformers

10 June 2021

Grégoire Mialon

Papers citing "GraphiT: Encoding Graph Structure in Transformers"

50 / 118 papers shown

Title
HyPE-GT: where Graph Transformers meet Hyperbolic Positional Encodings Kushal Bose Swagatam Das 30 0 0 11 Dec 2023
Expressive Sign Equivariant Networks for Spectral Geometric Learning Derek Lim Joshua Robinson Stefanie Jegelka Haggai Maron 76 16 0 04 Dec 2023
Effective Structural Encodings via Local Curvature Profiles Lukas Fesser Melanie Weber 33 3 0 24 Nov 2023
Cycle Invariant Positional Encoding for Graph Representation Learning Zuoyu Yan Teng Ma Liangcai Gao Zhi Tang Chao Chen Yusu Wang 44 5 0 24 Nov 2023
Exposition on over-squashing problem on GNNs: Current Methods, Benchmarks and Challenges Dai Shi Andi Han Lequan Lin Yi Guo Junbin Gao 47 12 0 13 Nov 2023
Hybrid Focal and Full-Range Attention Based Graph Transformers Minhong Zhu Zhenhao Zhao Weiran Cai 34 0 0 08 Nov 2023
MATA: Combining Learnable Node Matching with A Algorithm for Approximate Graph Edit Distance Computation Junfeng Liu Min Zhou Shuai Ma Lujia Pan 34 9 0 04 Nov 2023
Facilitating Graph Neural Networks with Random Walk on Simplicial Complexes Cai Zhou Xiyuan Wang Muhan Zhang 41 15 0 30 Oct 2023
Laplacian Canonization: A Minimalist Approach to Sign and Basis Invariant Spectral Embedding Jiangyan Ma Yifei Wang Yisen Wang 36 12 0 28 Oct 2023
In-Context Learning for Few-Shot Molecular Property Prediction Christopher Fifty J. Leskovec Sebastian Thrun 36 5 0 13 Oct 2023
Tailoring Self-Attention for Graph via Rooted Subtrees Siyuan Huang Yunchong Song Jiayue Zhou Zhouhan Lin 32 8 0 08 Oct 2023
Locality-Aware Graph-Rewiring in GNNs Federico Barbero A. Velingker Amin Saberi Michael M. Bronstein Francesco Di Giovanni 40 27 0 02 Oct 2023
Joint-Relation Transformer for Multi-Person Motion Prediction Qingyao Xu Wei Mao Jingze Gong Chenxin Xu Siheng Chen Weidi Xie Ya Zhang Yanfeng Wang ViT 36 9 0 09 Aug 2023
Graph Positional and Structural Encoder Semih Cantürk Renming Liu Olivier Lapointe-Gagné Vincent Létourneau Guy Wolf Dominique Beaini Ladislav Rampášek 41 15 0 14 Jul 2023
SGFormer: Simplifying and Empowering Transformers for Large-Graph Representations Qitian Wu Wen-Long Zhao Chenxiao Yang Hengrui Zhang Fan Nie Haitian Jiang Yatao Bian Junchi Yan AI4CE 40 78 0 19 Jun 2023
Virtual Node Tuning for Few-shot Node Classification Zhen Tan Ruocheng Guo Kaize Ding Huan Liu 21 36 0 09 Jun 2023
How does over-squashing affect the power of GNNs? Francesco Di Giovanni T. Konstantin Rusch Michael M. Bronstein Andreea Deac Marc Lackenby Siddhartha Mishra Petar Velivcković 36 34 0 06 Jun 2023
Classification of Edge-dependent Labels of Nodes in Hypergraphs Minyoung Choe Sunwoo Kim Jaemin Yoo Kijung Shin GNN 30 10 0 05 Jun 2023
GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning Haiteng Zhao Shengchao Liu Chang Ma Hannan Xu Jie Fu Zhihong Deng Lingpeng Kong Qi Liu 31 60 0 28 May 2023
Graph Inductive Biases in Transformers without Message Passing Liheng Ma Chen Lin Derek Lim Adriana Romero Soriano P. Dokania Mark J. Coates Philip Torr Ser-Nam Lim AI4CE 40 85 0 27 May 2023
Union Subgraph Neural Networks Jiaxing Xu Aihu Zhang Qingtian Bian Vijay Prakash Dwivedi Yiping Ke GNN 27 6 0 25 May 2023
G-Adapter: Towards Structure-Aware Parameter-Efficient Transfer Learning for Graph Transformer Networks Anchun Gui Jinqiang Ye Han Xiao 27 19 0 17 May 2023
BrainNPT: Pre-training of Transformer networks for brain network classification Jinlong Hu Ya-Lin Huang Nan Wang Shoubin Dong ViT MedIm 29 6 0 02 May 2023
Self-Attention in Colors: Another Take on Encoding Graph Structure in Transformers Romain Menegaux Emmanuel Jehanno Margot Selosse Julien Mairal 29 6 0 21 Apr 2023
DG-Trans: Dual-level Graph Transformer for Spatiotemporal Incident Impact Prediction on Traffic Networks Yanshen Sun Kaiqun Fu Chang-Tien Lu AI4TS AI4CE 32 2 0 21 Mar 2023
An Efficient Subgraph GNN with Provable Substructure Counting Power Zuoyu Yan Junru Zhou Liangcai Gao Zhi Tang Muhan Zhang GNN 32 12 0 19 Mar 2023
Exphormer: Sparse Transformers for Graphs Hamed Shirzad A. Velingker B. Venkatachalam Danica J. Sutherland A. Sinop 11 99 0 10 Mar 2023
Ewald-based Long-Range Message Passing for Molecular Graphs Arthur Kosmala Johannes Gasteiger Nicholas Gao Stephan Günnemann 74 25 0 08 Mar 2023
Diffusing Graph Attention Daniel Glickman Eran Yahav GNN 47 3 0 01 Mar 2023
Are More Layers Beneficial to Graph Transformers? Haiteng Zhao Shuming Ma Dongdong Zhang Zhi-Hong Deng Furu Wei 27 12 0 01 Mar 2023
HINormer: Representation Learning On Heterogeneous Information Networks with Graph Transformer Qiheng Mao Zemin Liu Chenghao Liu Jianling Sun 42 56 0 22 Feb 2023
MulGT: Multi-task Graph-Transformer with Task-aware Knowledge Injection and Domain Knowledge-driven Pooling for Whole Slide Image Analysis Weiqin Zhao Shujun Wang Maximus C. F. Yeung Tianye Niu Lequan Yu 44 9 0 21 Feb 2023
Attending to Graph Transformers Luis Muller Mikhail Galkin Christopher Morris Ladislav Rampášek 52 86 0 08 Feb 2023
On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology Francesco Di Giovanni Lorenzo Giusti Federico Barbero Giulia Luise Pietro Lio Michael M. Bronstein 48 112 0 06 Feb 2023
Transformers Meet Directed Graphs Simon Geisler Yujia Li D. Mankowitz A. Cemgil Stephan Günnemann Cosmin Paduraru 27 35 0 31 Jan 2023
On the Connection Between MPNN and Graph Transformer Chen Cai Truong-Son Hy Rose Yu Yusu Wang 41 52 0 27 Jan 2023
Learning Compiler Pass Orders using Coreset and Normalized Value Prediction Youwei Liang Kevin R. Stone A. Shameli Chris Cummins Mostafa Elhoushi ... Benoit Steiner Xiaomeng Yang P. Xie Hugh Leather Yuandong Tian 17 10 0 09 Jan 2023
A Generalization of ViT/MLP-Mixer to Graphs Xiaoxin He Bryan Hooi T. Laurent Adam Perold Yann LeCun Xavier Bresson 47 88 0 27 Dec 2022
SLGTformer: An Attention-Based Approach to Sign Language Recognition Neil Song Yu Xiang SLR 30 0 0 21 Dec 2022
TopoImb: Toward Topology-level Imbalance in Learning from Graphs Tianxiang Zhao Dongsheng Luo Xiang Zhang Suhang Wang AI4CE 30 11 0 16 Dec 2022
Bridging Graph Position Encodings for Transformers with Weighted Graph-Walking Automata Patrick M. Soga David Chiang 27 0 0 13 Dec 2022
PatchGT: Transformer over Non-trainable Clusters for Learning Graph Representations Han Gao Xuhong Han Jiaoyang Huang Jian-Xun Wang Liping Liu ViT GNN 11 8 0 26 Nov 2022
Adaptive Multi-Neighborhood Attention based Transformer for Graph Representation Learning Gaichao Li Jinsong Chen Kun He 24 3 0 15 Nov 2022
Transformers over Directed Acyclic Graphs Yu Luo Veronika Thost Lei Shi GNN AI4CE 40 16 0 24 Oct 2022
Not All Neighbors Are Worth Attending to: Graph Selective Attention Networks for Semi-supervised Learning Tiantian He Haicang Zhou Yew-Soon Ong Gao Cong GNN 80 4 0 14 Oct 2022
Expander Graph Propagation Andreea Deac Marc Lackenby Petar Velivcković 96 52 0 06 Oct 2022
LogGD:Detecting Anomalies from System Logs by Graph Neural Networks Yongzhen Xie Hongyu Zhang M. Babar AI4TS 12 20 0 16 Sep 2022
Deformable Graph Transformer Jinyoung Park Seongjun Yun Hyeon-ju Park Jaewoo Kang Jisu Jeong KyungHyun Kim Jung-Woo Ha Hyunwoo J. Kim 90 7 0 29 Jun 2022
Long Range Graph Benchmark Vijay Prakash Dwivedi Ladislav Rampášek Mikhail Galkin Alipanah Parviz Guy Wolf A. Luu Dominique Beaini 26 195 0 16 Jun 2022
KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction Han Li Dan Zhao Jianyang Zeng 27 62 0 02 Jun 2022