Do Transformers Really Perform Bad for Graph Representation?

9 June 2021

Tianle Cai

Papers citing "Do Transformers Really Perform Bad for Graph Representation?"

50 / 247 papers shown

Title
From Local to Global: Spectral-Inspired Graph Neural Networks Ningyuan Huang Soledad Villar Carey E. Priebe Da Zheng Cheng-Fu Huang Lin F. Yang Vladimir Braverman 25 14 0 24 Sep 2022
ERNIE-mmLayout: Multi-grained MultiModal Transformer for Document Understanding Wenjin Wang Zhengjie Huang Bin Luo Qianglong Chen Qiming Peng ... Weichong Yin Shi Feng Yu Sun Dianhai Yu Yin Zhang ViT 35 11 0 18 Sep 2022
LogGD:Detecting Anomalies from System Logs by Graph Neural Networks Yongzhen Xie Hongyu Zhang M. Babar AI4TS 15 20 0 16 Sep 2022
Graph Neural Networks for Molecules Yuyang Wang Zijie Li A. Farimani GNN AI4CE 52 20 0 12 Sep 2022
Multimodal learning with graphs Yasha Ektefaie George Dasoulas Ayush Noori Maha Farhat Marinka Zitnik 51 83 0 07 Sep 2022
Can Pre-trained Models Really Learn Better Molecular Representations for AI-aided Drug Discovery? Ziqiao Zhang Yatao Bian Ailin Xie Peng Han Long-Kai Huang Shuigeng Zhou 32 5 0 21 Aug 2022
SoMoFormer: Social-Aware Motion Transformer for Multi-Person Motion Prediction Xiaogang Peng Yaodi Shen Haoran Wang Binling Nie Yigang Wang Zizhao Wu ViT 25 6 0 19 Aug 2022
MM-GNN: Mix-Moment Graph Neural Network towards Modeling Neighborhood Feature Distribution Wendong Bi Lun Du Qiang Fu Yanlin Wang Shi Han Dongmei Zhang GNN 14 18 0 15 Aug 2022
Energy-Motivated Equivariant Pretraining for 3D Molecular Graphs Rui Jiao Jiaqi Han Wenbing Huang Yu Rong Yang Liu AI4CE 35 45 0 18 Jul 2022
Does GNN Pretraining Help Molecular Representation? Ruoxi Sun Hanjun Dai Adams Wei Yu SSL AI4CE GNN 6 71 0 13 Jul 2022
Logistics, Graphs, and Transformers: Towards improving Travel Time Estimation Natalia Semenova Vadim Porvatov Vladislav Tishin Artyom Sosedka Vladislav Zamkovoy AI4TS 13 2 0 12 Jul 2022
Video Graph Transformer for Video Question Answering Junbin Xiao Pan Zhou Tat-Seng Chua Shuicheng Yan ViT 159 75 0 12 Jul 2022
Radiomics-Guided Global-Local Transformer for Weakly Supervised Pathology Localization in Chest X-Rays Yan Han G. Holste Ying Ding Ahmed H. Tewfik Yifan Peng Zhangyang Wang LM&MA ViT 39 15 0 10 Jul 2022
Adaptive Graph Spatial-Temporal Transformer Network for Traffic Flow Forecasting Aosong Feng Leandros Tassiulas AI4TS 22 59 0 09 Jul 2022
Pre-training Transformers for Molecular Property Prediction Using Reaction Prediction J. Broberg Maria Bånkestad Erik Ylipää AI4CE 21 5 0 06 Jul 2022
Pure Transformers are Powerful Graph Learners Jinwoo Kim Tien Dat Nguyen Seonwoo Min Sungjun Cho Moontae Lee Honglak Lee Seunghoon Hong 43 191 0 06 Jul 2022
Text Enriched Sparse Hyperbolic Graph Convolutional Networks Nurendra Choudhary Nikhil S. Rao Karthik Subbian Chandan K. Reddy 28 0 0 06 Jul 2022
Spherical Channels for Modeling Atomic Interactions C. L. Zitnick Abhishek Das Adeesh Kolluru Janice Lan Muhammed Shuaibi Anuroop Sriram Zachary W. Ulissi Brandon M. Wood 81 58 0 29 Jun 2022
Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphs Yi-Lun Liao Tess E. Smidt 87 216 0 23 Jun 2022
Affinity-Aware Graph Networks A. Velingker A. Sinop Ira Ktena Petar Velickovic Sreenivas Gollapudi GNN 52 16 0 23 Jun 2022
The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalysts Richard Tran Janice Lan Muhammed Shuaibi Brandon M. Wood Siddharth Goyal ... Jehad Abed Oleksandr Voznyy Edward H. Sargent Zachary W. Ulissi C. L. Zitnick 36 174 0 17 Jun 2022
tBDFS: Temporal Graph Neural Network Leveraging DFS Uriel Singer Haggai Roitman Ido Guy Kira Radinsky AI4CE 29 0 0 12 Jun 2022
A Bird's-Eye Tutorial of Graph Attention Architectures Kaustubh D. Dhole Carl Yang 34 1 0 06 Jun 2022
Shortest Path Networks for Graph Property Prediction Ralph Abboud Radoslav Dimitrov .Ismail .Ilkan Ceylan GNN 27 46 0 02 Jun 2022
KPGT: Knowledge-Guided Pre-training of Graph Transformer for Molecular Property Prediction Han Li Dan Zhao Jianyang Zeng 27 62 0 02 Jun 2022
Pre-training via Denoising for Molecular Property Prediction Sheheryar Zaidi Michael Schaarschmidt James Martens Hyunjik Kim Yee Whye Teh Alvaro Sanchez-Gonzalez Peter W. Battaglia Razvan Pascanu Jonathan Godwin DiffM AI4CE 30 121 0 31 May 2022
Predicting Corporate Risk by Jointly Modeling Company Networks and Dialogues in Earnings Conference Calls Yu Sang Yang Bao 16 2 0 25 May 2022
Recipe for a General, Powerful, Scalable Graph Transformer Ladislav Rampášek Mikhail Galkin Vijay Prakash Dwivedi A. Luu Guy Wolf Dominique Beaini 78 522 0 25 May 2022
Compressing Deep Graph Neural Networks via Adversarial Knowledge Distillation Huarui He Jie Wang Zhanqiu Zhang Feng Wu 25 40 0 24 May 2022
Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers Luis Espinosa-Anke A. Shvets Alireza Mohammadshahi James Henderson Leo Wanner 25 4 0 23 May 2022
Tyger: Task-Type-Generic Active Learning for Molecular Property Prediction Kuangqi Zhou Kaixin Wang Jiashi Feng Jian Tang Tingyang Xu Xinchao Wang 29 1 0 23 May 2022
Relphormer: Relational Graph Transformer for Knowledge Graph Representations Zhen Bi Shuyang Cheng Jing Chen Xiaozhuan Liang Feiyu Xiong Ningyu Zhang 37 37 0 22 May 2022
FairNorm: Fair and Fast Graph Neural Network Training Öykü Deniz Köse Yanning Shen AI4CE 21 4 0 20 May 2022
NDGGNET-A Node Independent Gate based Graph Neural Networks Ye Tang Xuesong Yang Xinrui Liu Xiwei Zhao Zhangang Lin Changping Peng GNN 27 0 0 11 May 2022
Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoning Fangzhi Xu Jun Liu Qika Lin Yudai Pan Lingling Zhang 29 24 0 02 May 2022
G2GT: Retrosynthesis Prediction with Graph to Graph Attention Neural Network and Self-Training Zaiyun Lin Shiqiu Yin Lei Shi Wenbiao Zhou Yingsheng J. Zhang 31 8 0 19 Apr 2022
NC-DRE: Leveraging Non-entity Clue Information for Document-level Relation Extraction Li Zhang Yidong Cheng 13 2 0 01 Apr 2022
MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Design Yuanqi Du Tianfan Fu Jimeng Sun Shengchao Liu AI4CE 43 86 0 28 Mar 2022
Unsupervised Pre-Training on Patient Population Graphs for Patient-Level Predictions Chantal Pellegrini Anees Kazi Nassir Navab 24 2 0 23 Mar 2022
PACE: A Parallelizable Computation Encoder for Directed Acyclic Graphs Zehao Dong Muhan Zhang Fuhai Li Yixin Chen CML GNN 33 17 0 19 Mar 2022
Meta-Weight Graph Neural Network: Push the Limits Beyond Global Homophily Xiaojun Ma Qinkai Chen Yuanyi Ren Guojie Song Liang Wang 25 22 0 19 Mar 2022
Towards Training Billion Parameter Graph Neural Networks for Atomic Simulations Anuroop Sriram Abhishek Das Brandon M. Wood Siddharth Goyal C. L. Zitnick AI4CE 33 27 0 18 Mar 2022
Neural Message Passing for Objective-Based Uncertainty Quantification and Optimal Experimental Design Qihua Chen Xuejin Chen Hyun-Myung Woo Byung-Jun Yoon 23 2 0 14 Mar 2022
Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice Peihao Wang Wenqing Zheng Tianlong Chen Zhangyang Wang ViT 33 127 0 09 Mar 2022
Benchmarking Graphormer on Large-Scale Molecular Modeling Datasets Yu Shi Shuxin Zheng Guolin Ke Yifei Shen Jiacheng You Jiyan He Shengjie Luo Chang-Shu Liu Di He Tie-Yan Liu AI4CE 45 65 0 09 Mar 2022
TableFormer: Robust Transformer Modeling for Table-Text Encoding Jingfeng Yang Aditya Gupta Shyam Upadhyay Luheng He Rahul Goel Shachi Paul LMTD 30 113 0 01 Mar 2022
Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networks Hongya Wang Haoteng Yin Muhan Zhang Pan Li 40 108 0 01 Mar 2022
An Empirical Study of Graphormer on Large-Scale Molecular Modeling Datasets Yu Shi Shuxin Zheng Guolin Ke Yifei Shen Jiacheng You Jiyan He Shengjie Luo Chang-Shu Liu Di He Tie-Yan Liu AI4CE 24 0 0 28 Feb 2022
Structured Multi-task Learning for Molecular Property Prediction Shengchao Liu Meng Qu Zuobai Zhang Huiyu Cai Jian Tang 20 24 0 22 Feb 2022
Message passing all the way up Petar Velickovic 118 64 0 22 Feb 2022