Do Transformers Really Perform Bad for Graph Representation?

9 June 2021

Tianle Cai

Papers citing "Do Transformers Really Perform Bad for Graph Representation?"

50 / 247 papers shown

Title
A Critical Perceptual Pre-trained Model for Complex Trajectory Recovery Dedong Li Ziyue Li Zhishuai Li Lei Bai Qingyuan Gong Lijun Sun Wolf Ketter Rui Zhao 40 5 0 05 Nov 2023
Diversified Node Sampling based Hierarchical Transformer Pooling for Graph Representation Learning Gaichao Li Jinsong Chen J. Hopcroft Kun He 24 0 0 31 Oct 2023
Facilitating Graph Neural Networks with Random Walk on Simplicial Complexes Cai Zhou Xiyuan Wang Muhan Zhang 44 15 0 30 Oct 2023
Transformers as Graph-to-Graph Models James Henderson Alireza Mohammadshahi Andrei Catalin Coman Lesly Miculicich GNN 35 6 0 27 Oct 2023
SQLformer: Deep Auto-Regressive Query Graph Generation for Text-to-SQL Translation A. Bazaga Pietro Lio G. Micklem 26 2 0 27 Oct 2023
Sliceformer: Make Multi-head Attention as Simple as Sorting in Discriminative Tasks Shen Yuan Hongteng Xu 32 0 0 26 Oct 2023
M2C: Towards Automatic Multimodal Manga Complement Hongcheng Guo Boyang Wang Jiaqi Bai Jiaheng Liu Jian Yang Zhoujun Li 33 10 0 26 Oct 2023
RDBench: ML Benchmark for Relational Databases Zizhao Zhang Yi Yang Lutong Zou He Wen Tao Feng Jiaxuan You 25 2 0 25 Oct 2023
Graph Agent: Explicit Reasoning Agent for Graphs Qinyong Wang Zhenxiang Gao Rong Xu AI4CE 23 5 0 25 Oct 2023
Can strong structural encoding reduce the importance of Message Passing? Floor Eijkelboom Erik J. Bekkers Michael M. Bronstein Francesco Di Giovanni University of Amsterdam 27 2 0 22 Oct 2023
Query2Triple: Unified Query Encoding for Answering Diverse Complex Queries over Knowledge Graphs Yao Xu Shizhu He Cunguang Wang Li Cai Kang Liu Jun Zhao 32 4 0 17 Oct 2023
Equivariant Matrix Function Neural Networks Ilyes Batatia Lars L. Schaaf Huajie Chen Gábor Csányi Christoph Ortner Felix A. Faber 40 5 0 16 Oct 2023
Topology-guided Hypergraph Transformer Network: Unveiling Structural Insights for Improved Representation Khaled Mohammed Saifuddin M. E. Aktas Esra Akbas 30 1 0 14 Oct 2023
Atom-Motif Contrastive Transformer for Molecular Property Prediction Wentao Yu Shuo Chen Chen Gong Gang Niu Masashi Sugiyama ViT 45 2 0 11 Oct 2023
Are GATs Out of Balance? Nimrah Mustafa Aleksandar Bojchevski R. Burkholz 48 4 0 11 Oct 2023
Supercharging Graph Transformers with Advective Diffusion Qitian Wu Chenxiao Yang Kaipeng Zeng Fan Nie AI4CE 53 5 0 10 Oct 2023
DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies Shuaiwen Leon Song Bonnie Kruft Minjia Zhang Conglong Li Shiyang Chen ... Arash Vahdat Chaowei Xiao Thomas Gibbs Anima Anandkumar R. Stevens 48 13 0 06 Oct 2023
GNNX-BENCH: Unravelling the Utility of Perturbation-based GNN Explainers through In-depth Benchmarking Mert Kosan S. Verma Burouj Armgaan Khushbu Pahwa Ambuj K. Singh Sourav Medya Sayan Ranu 32 13 0 03 Oct 2023
Transformers are efficient hierarchical chemical graph learners Zihan Pengmei Zimu Li Chih-chan Tien Risi Kondor Aaron R Dinner GNN 23 1 0 02 Oct 2023
GraphText: Graph Reasoning in Text Space Jianan Zhao Le Zhuo Yikang Shen Meng Qu Kai Liu Michael M. Bronstein Zhaocheng Zhu Jian Tang 109 72 0 02 Oct 2023
MHG-GNN: Combination of Molecular Hypergraph Grammar with Graph Neural Network Akihiro Kishimoto Hiroshi Kajino Masataka Hirose Junta Fuchiwaki Indra Priyadarsini Lisa Hamada Hajime Shinohara D. Nakano Seiji Takeda AI4CE 39 4 0 28 Sep 2023
Node-Aligned Graph-to-Graph (NAG2G): Elevating Template-Free Deep Learning Approaches in Single-Step Retrosynthesis Lin Yao Wentao Guo Zhen Wang Shang Xiang Wentan Liu Guolin Ke 57 12 0 27 Sep 2023
Deep-learning-powered data analysis in plankton ecology Harshith Bachimanchi Matthew I. M. Pinder Chloé Robert Pierre De Wit Jonathan Havenhand Alexandra Kinnby Daniel Midtvedt Erik Selander Giovanni Volpe 29 2 0 15 Sep 2023
Circle Feature Graphormer: Can Circle Features Stimulate Graph Transformer? Jingsong Lv Hongyang Chen Yao Qi Lei Yu 13 0 0 11 Sep 2023
Curve Your Attention: Mixed-Curvature Transformers for Graph Representation Learning Sungjun Cho Seunghyuk Cho Sungwoo Park Hankook Lee Ho Hin Lee Moontae Lee 34 6 0 08 Sep 2023
Rethinking the Power of Graph Canonization in Graph Representation Learning with Stability Zehao Dong Muhan Zhang Philip R. O. Payne Michael Province C. Cruchaga Tianyu Zhao Fuhai Li Yixin Chen 43 1 0 01 Sep 2023
CktGNN: Circuit Graph Neural Network for Electronic Design Automation Zehao Dong Weidong Cao Muhan Zhang Dacheng Tao Yixin Chen Xuan Zhang GNN 34 30 0 31 Aug 2023
On Data Imbalance in Molecular Property Prediction with Pre-training Limin Wang Masatoshi Hanai Toyotaro Suzumura Shun Takashige Kenjiro Taura AI4CE 43 0 0 17 Aug 2023
VN-Solver: Vision-based Neural Solver for Combinatorial Optimization over Graphs Mina Samizadeh G. Tong 21 0 0 06 Aug 2023
Improving Automatic Parallel Training via Balanced Memory Workload Optimization Yujie Wang Youhe Jiang Xupeng Miao Fangcheng Fu Shenhan Zhu Xiaonan Nie Yaofeng Tu Bin Cui 48 9 0 05 Jul 2023
CardiGraphormer: Unveiling the Power of Self-Supervised Learning in Revolutionizing Drug Discovery Abhijit Gupta 23 0 0 03 Jul 2023
Why Deep Models Often cannot Beat Non-deep Counterparts on Molecular Property Prediction? Jun Xia Lecheng Zhang Xiao Zhu Stan Z. Li 28 3 0 30 Jun 2023
Temporal Data Meets LLM -- Explainable Financial Time Series Forecasting Xinli Yu Zheng Chen Yuan Ling Shujing Dong Zongying Liu Yanbin Lu AIFin AI4TS 125 69 0 19 Jun 2023
SGFormer: Simplifying and Empowering Transformers for Large-Graph Representations Qitian Wu Wen-Long Zhao Chenxiao Yang Hengrui Zhang Fan Nie Haitian Jiang Yatao Bian Junchi Yan AI4CE 43 78 0 19 Jun 2023
OpenGSL: A Comprehensive Benchmark for Graph Structure Learning Zhiyao Zhou Sheng Zhou Bochao Mao Xu Zhou Jiawei Chen Qiaoyu Tan Daochen Zha Yan Feng Chun-Yen Chen C. Wang 34 21 0 17 Jun 2023
Automated 3D Pre-Training for Molecular Property Prediction Xu Wang Huan Zhao Weiwei Tu Quanming Yao AI4CE 33 35 0 13 Jun 2023
Efficient Approximations of Complete Interatomic Potentials for Crystal Property Prediction Yu-Ching Lin Keqiang Yan Youzhi Luo Yi Liu Xiaoning Qian Shuiwang Ji 71 34 0 12 Jun 2023
Path Neural Networks: Expressive and Accurate Graph Neural Networks Gaspard Michel Giannis Nikolentzos J. Lutzeyer Michalis Vazirgiannis GNN 26 26 0 09 Jun 2023
Towards Predicting Equilibrium Distributions for Molecular Systems with Deep Learning Shuxin Zheng Jiyan He Chang-Shu Liu Yu Shi Ziheng Lu ... Peiran Jin Chi Chen Frank Noé Haiguang Liu Tie-Yan Liu AI4CE 34 41 0 08 Jun 2023
$Enabling tabular deep learning when $d \gg n$ with an auxiliary knowledge graph$ Enabling tabular deep learning when $d \gg n$ with an auxiliary knowledge graph Camilo Ruiz Hongyu Ren Kexin Huang J. Leskovec 33 2 0 07 Jun 2023
GRAFENNE: Learning on Graphs with Heterogeneous and Dynamic Feature Sets Shubham Gupta S. Manchanda Sayan Ranu Srikanta J. Bedathur 24 7 0 06 Jun 2023
Learning Probabilistic Symmetrization for Architecture Agnostic Equivariance Jinwoo Kim Tien Dat Nguyen Ayhan Suleymanzade Hyeokjun An Seunghoon Hong 50 23 0 05 Jun 2023
The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles Md Shamim Hussain Mohammed J Zaki D. Subramanian 39 3 0 02 Jun 2023
InGram: Inductive Knowledge Graph Embedding via Relation Graphs Jaejun Lee Chanyoung Chung Joyce Jiyoung Whang GNN 27 39 0 31 May 2023
Predicting protein stability changes under multiple amino acid substitutions using equivariant graph neural networks Sebastien Boyer Sam Money-Kyrle Oliver E. Bent 11 3 0 30 May 2023
GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning Haiteng Zhao Shengchao Liu Chang Ma Hannan Xu Jie Fu Zhihong Deng Lingpeng Kong Qi Liu 31 61 0 28 May 2023
Let There Be Order: Rethinking Ordering in Autoregressive Graph Generation Jie Bu Kazi Sajeed Mehrab Anuj Karpatne 29 3 0 24 May 2023
On Structural Expressive Power of Graph Transformers Wenhao Zhu Tianyu Wen Guojie Song Liangji Wang Bo Zheng 27 15 0 23 May 2023
Learning Joint 2D & 3D Diffusion Models for Complete Molecule Generation Han Huang Leilei Sun Bowen Du Weifeng Lv DiffM 37 16 0 21 May 2023
Learning Large Graph Property Prediction via Graph Segment Training Kaidi Cao P. Phothilimthana Sami Abu-El-Haija Dustin Zelle Yanqi Zhou Charith Mendis J. Leskovec Bryan Perozzi 23 9 0 21 May 2023