Do Transformers Really Perform Bad for Graph Representation?

9 June 2021

Tianle Cai

Papers citing "Do Transformers Really Perform Bad for Graph Representation?"

50 / 247 papers shown

Title
Fisher Information Embedding for Node and Graph Learning Dexiong Chen Paolo Pellizzoni Karsten M. Borgwardt GNN 26 2 0 12 May 2023
Towards Better Graph Representation Learning with Parameterized Decomposition & Filtering Mingqi Yang Wenjie Feng Yanming Shen Bryan Hooi 36 5 0 10 May 2023
Temporal and Heterogeneous Graph Neural Network for Financial Time Series Prediction Sheng Xiang Dawei Cheng Chencheng Shang Ying Zhang Yuqi Liang AIFin AI4TS 28 51 0 09 May 2023
Hierarchical Transformer for Scalable Graph Learning Wenhao Zhu Tianyu Wen Guojie Song Xiaojun Ma Liang Wang 42 14 0 04 May 2023
DG-Trans: Dual-level Graph Transformer for Spatiotemporal Incident Impact Prediction on Traffic Networks Yanshen Sun Kaiqun Fu Chang-Tien Lu AI4TS AI4CE 32 2 0 21 Mar 2023
Highly Accurate Quantum Chemical Property Prediction with Uni-Mol+ Shuqi Lu Zhifeng Gao Di He Linfeng Zhang Guolin Ke 40 26 0 16 Mar 2023
Molecular Property Prediction by Semantic-invariant Contrastive Learning Ziqiao Zhang Ailin Xie Jihong Guan Shuigeng Zhou 19 5 0 13 Mar 2023
Exphormer: Sparse Transformers for Graphs Hamed Shirzad A. Velingker B. Venkatachalam Danica J. Sutherland A. Sinop 11 99 0 10 Mar 2023
Ewald-based Long-Range Message Passing for Molecular Graphs Arthur Kosmala Johannes Gasteiger Nicholas Gao Stephan Günnemann 74 26 0 08 Mar 2023
Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models? Boris Knyazev Doha Hwang Simon Lacoste-Julien AI4CE 37 17 0 07 Mar 2023
Probing Graph Representations Mohammad Sadegh Akhondzadeh Vijay Lingam Aleksandar Bojchevski 42 10 0 07 Mar 2023
DR-Label: Improving GNN Models for Catalysis Systems by Label Deconstruction and Reconstruction Bo-Lan Wang Chen Liang Jiaze Wang Furui Liu Shaogang Hao Dong Li Jianye Hao Guangyong Chen Xiaolong Zou Pheng-Ann Heng 47 3 0 06 Mar 2023
Specformer: Spectral Graph Neural Networks Meet Transformers Deyu Bo Chuan Shi Lele Wang Renjie Liao 76 81 0 02 Mar 2023
Diffusing Graph Attention Daniel Glickman Eran Yahav GNN 47 3 0 01 Mar 2023
GNNDelete: A General Strategy for Unlearning in Graph Neural Networks Jiali Cheng George Dasoulas Huan He Chirag Agarwal Marinka Zitnik MU 42 36 0 26 Feb 2023
HINormer: Representation Learning On Heterogeneous Information Networks with Graph Transformer Qiheng Mao Zemin Liu Chenghao Liu Jianling Sun 45 56 0 22 Feb 2023
Search to Capture Long-range Dependency with Stacking GNNs for Graph Classification Lanning Wei Zhiqiang He Huan Zhao Quanming Yao 33 16 0 17 Feb 2023
Multiresolution Graph Transformers and Wavelet Positional Encoding for Learning Hierarchical Structures Nhat-Khang Ngô Truong-Son Hy Risi Kondor ViT AI4CE 31 2 0 17 Feb 2023
Activity Cliff Prediction: Dataset and Benchmark Ziqiao Zhang Bangyi Zhao Ailin Xie Yatao Bian Shuigeng Zhou 25 10 0 15 Feb 2023
Energy Transformer Benjamin Hoover Yuchen Liang Bao Pham Yikang Shen Hendrik Strobelt Duen Horng Chau Mohammed J Zaki Dmitry Krotov ViT 28 42 0 14 Feb 2023
GPS++: Reviving the Art of Message Passing for Molecular Property Prediction Dominic Masters Josef Dean Kerstin Klaser Zhiyi Li Sam Maddrell-Mander ... D. Beker Andrew Fitzgibbon Shenyang Huang Ladislav Rampášek Dominique Beaini 41 8 0 06 Feb 2023
On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology Francesco Di Giovanni Lorenzo Giusti Federico Barbero Giulia Luise Pietro Lio Michael M. Bronstein 48 113 0 06 Feb 2023
GRANDE: a neural model over directed multigraphs with application to anti-money laundering Ruofan Wu Boqun Ma Hong Jin Wenlong Zhao Weiqiang Wang Tianyi Zhang 27 2 0 04 Feb 2023
Molecular Geometry-aware Transformer for accurate 3D Atomic System modeling Zheng Yuan Yaoyun Zhang Chuanqi Tan Wei Wang Feiran Huang Songfang Huang AI4CE ViT 24 6 0 02 Feb 2023
Transformers Meet Directed Graphs Simon Geisler Yujia Li D. Mankowitz A. Cemgil Stephan Günnemann Cosmin Paduraru 27 35 0 31 Jan 2023
Layout-aware Webpage Quality Assessment Anfeng Cheng Yiding Liu Weibin Li Qian Dong Shuaiqiang Wang Zhengjie Huang Shikun Feng Zhicong Cheng Dawei Yin 3DV 35 4 0 28 Jan 2023
GDBN: a Graph Neural Network Approach to Dynamic Bayesian Network Yang Sun Yifan Xie BDL CML 34 1 0 28 Jan 2023
On the Connection Between MPNN and Graph Transformer Chen Cai Truong-Son Hy Rose Yu Yusu Wang 41 52 0 27 Jan 2023
Qualitative Analysis of a Graph Transformer Approach to Addressing Hate Speech: Adapting to Dynamically Changing Content Liam Hebert Hong Chen R. Cohen Lukasz Golab 13 4 0 25 Jan 2023
DIFFormer: Scalable (Graph) Transformers Induced by Energy Constrained Diffusion Qitian Wu Chenxiao Yang Wen-Long Zhao Yixuan He David Wipf Junchi Yan DiffM 32 83 0 23 Jan 2023
Predicting Hateful Discussions on Reddit using Graph Transformer Networks and Communal Context Liam Hebert Lukasz Golab R. Cohen 11 8 0 10 Jan 2023
Conditional Diffusion Based on Discrete Graph Structures for Molecular Graph Generation Han Huang Leilei Sun Bowen Du Weifeng Lv 45 40 0 01 Jan 2023
SLGTformer: An Attention-Based Approach to Sign Language Recognition Neil Song Yu Xiang SLR 30 0 0 21 Dec 2022
Bridging Graph Position Encodings for Transformers with Weighted Graph-Walking Automata Patrick M. Soga David Chiang 32 0 0 13 Dec 2022
Random Copolymer inverse design system orienting on Accurate discovering of Antimicrobial peptide-mimetic copolymers Tianyu Wu Yang Tang 16 0 0 30 Nov 2022
Capturing long-range interaction with reciprocal space neural network Hongyu Yu Liangliang Hong Shiyou Chen X. Gong Hongjun Xiang 34 11 0 30 Nov 2022
You Can Have Better Graph Neural Networks by Not Training Weights at All: Finding Untrained GNNs Tickets Tianjin Huang Tianlong Chen Meng Fang Vlado Menkovski Jiaxu Zhao ... Yulong Pei Decebal Constantin Mocanu Zhangyang Wang Mykola Pechenizkiy Shiwei Liu GNN 47 14 0 28 Nov 2022
Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism Xupeng Miao Yujie Wang Youhe Jiang Chunan Shi Xiaonan Nie Hailin Zhang Bin Cui GNN MoE 45 60 0 25 Nov 2022
Learning Regularized Positional Encoding for Molecular Prediction Xiang Gao Weihao Gao Wen Xiao Zhirui Wang Chong Wang Liang Xiang AI4CE 27 1 0 23 Nov 2022
Supervised Pretraining for Molecular Force Fields and Properties Prediction Xiang Gao Weihao Gao Wen Xiao Zhirui Wang Chong Wang Liang Xiang AI4CE 36 8 0 23 Nov 2022
Learnable Spectral Wavelets on Dynamic Graphs to Capture Global Interactions Anson Bastos Abhishek Nadgeri Kuldeep Singh Toyotaro Suzumura Manish Singh 41 7 0 22 Nov 2022
Heterogenous Ensemble of Models for Molecular Property Prediction Sajad Darabi Shayan Fazeli Jiwei Liu Alexandre Milesi Pawel Morkisz Jean-François Puget Gilberto Titericz 16 0 0 20 Nov 2022
Rethinking Batch Sample Relationships for Data Representation: A Batch-Graph Transformer based Approach Xixi Wang Bowei Jiang Tianlin Li Bin Luo ViT 33 5 0 19 Nov 2022
Leveraging commonsense for object localisation in partial scenes Francesco Giuliari Geri Skenderi Marco Cristani Alessio Del Bue Yiming Wang 38 2 0 01 Nov 2022
Self-supervised Graph-based Point-of-interest Recommendation Yong Li Tong Chen P. Zhang Zi Huang Hongzhi Yin 28 4 0 22 Oct 2022
Extending Graph Transformers with Quantum Computed Aggregation Slimane Thabet Romain Fouilland L. Henriet GNN 33 3 0 19 Oct 2022
Substructure-Atom Cross Attention for Molecular Representation Learning Jiye G. Kim Seungbeom Lee Dongwoo Kim Sungsoo Ahn Jaesik Park 19 4 0 15 Oct 2022
Planning Assembly Sequence with Graph Transformer Lin Ma Jian Gong Hao Xu Hao Chen Hao Zhao Wenbin Huang Guyue Zhou 34 18 0 11 Oct 2022
Hierarchical Graph Transformer with Adaptive Node Sampling Zaixin Zhang Qi Liu Qingyong Hu Cheekong Lee 78 82 0 08 Oct 2022
Improving Molecular Pretraining with Complementary Featurizations Yanqiao Zhu Dingshuo Chen Yuanqi Du Yingze Wang Qiang Liu Shu Wu AI4CE 44 7 0 29 Sep 2022