What Improves the Generalization of Graph Transformers? A Theoretical
Dive into the Self-attention and Positional Encoding

What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding

4 June 2024

Sijia Liu

Pin-Yu Chen

Papers citing "What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding"

10 / 10 papers shown

Title
When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformers Hongkang Li Yihua Zhang Shuai Zhang M. Wang Sijia Liu Pin-Yu Chen MoMe 69 2 0 15 Apr 2025
A Survey of Graph Transformers: Architectures, Theories and Applications Chaohao Yuan Kangfei Zhao Ercan Engin Kuruoglu Liang Wang Tingyang Xu Wenbing Huang Deli Zhao Hong Cheng Yu Rong 55 4 0 23 Feb 2025
Multi-State-Action Tokenisation in Decision Transformers for Multi-Discrete Action Spaces Perusha Moodley Pramod S. Kaushik Dhillu Thambi Mark Trovinger Praveen Paruchuri Xia Hong Benjamin Rosman 50 0 0 01 Jul 2024
$How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance$ How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance Hongkang Li Shuai Zhang Yihua Zhang Meng Wang Sijia Liu Pin-Yu Chen 35 4 0 12 Mar 2024
On the Convergence and Sample Complexity Analysis of Deep Q-Networks with $ε$ -Greedy Exploration Shuai Zhang Hongkang Li Meng Wang Miao Liu Pin-Yu Chen Songtao Lu Sijia Liu K. Murugesan Subhajit Chaudhury 32 19 0 24 Oct 2023
How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding Yuchen Li Yuan-Fang Li Andrej Risteski 120 61 0 07 Mar 2023
Hierarchical Graph Transformer with Adaptive Node Sampling Zaixin Zhang Qi Liu Qingyong Hu Cheekong Lee 75 81 0 08 Oct 2022
Generalization Analysis of Message Passing Neural Networks on Large Random Graphs Sohir Maskey Ron Levie Yunseok Lee Gitta Kutyniok GNN 80 53 0 01 Feb 2022
Heterogeneous Graph Transformer Ziniu Hu Yuxiao Dong Kuansan Wang Yizhou Sun 185 1,169 0 03 Mar 2020
Geom-GCN: Geometric Graph Convolutional Networks Hongbin Pei Bingzhen Wei Kevin Chen-Chuan Chang Yu Lei Bo Yang GNN 169 1,078 0 13 Feb 2020