TorchGT: A Holistic System for Large-scale Graph Transformer Training

19 July 2024

Papers citing "TorchGT: A Holistic System for Large-scale Graph Transformer Training"

20 / 20 papers shown

Title
Recipe for a General, Powerful, Scalable Graph Transformer Ladislav Rampášek Mikhail Galkin Vijay Prakash Dwivedi Anh Tuan Luu Guy Wolf Dominique Beaini 106 556 0 25 May 2022
Neighbour Interaction based Click-Through Rate Prediction via Graph-masked Transformer Erxue Min Yu Rong Tingyang Xu Yatao Bian P. Zhao Junzhou Huang Da Luo Kangyi Lin Sophia Ananiadou 57 33 0 25 Jan 2022
Understanding over-squashing and bottlenecks on graphs via curvature Jake Topping Francesco Di Giovanni B. Chamberlain Xiaowen Dong M. Bronstein 99 440 0 29 Nov 2021
Rethinking Graph Transformers with Spectral Attention Devin Kreuzer Dominique Beaini William L. Hamilton Vincent Létourneau Prudencio Tossou 72 525 0 07 Jun 2021
SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning Hanrui Wang Zhekai Zhang Song Han 97 384 0 17 Dec 2020
The Open Catalyst 2020 (OC20) Dataset and Community Challenges L. Chanussot Abhishek Das Siddharth Goyal Thibaut Lavril Muhammed Shuaibi ... Brandon M. Wood Junwoong Yoon Devi Parikh C. L. Zitnick Zachary W. Ulissi 239 513 0 20 Oct 2020
Computing Graph Neural Networks: A Survey from Algorithms to Accelerators S. Abadal Akshay Jain Robert Guirado Jorge López-Alonso Eduard Alarcón GNN 84 225 0 30 Sep 2020
Rethinking Attention with Performers K. Choromanski Valerii Likhosherstov David Dohan Xingyou Song Andreea Gane ... Afroz Mohiuddin Lukasz Kaiser David Belanger Lucy J. Colwell Adrian Weller 158 1,548 0 30 Sep 2020
Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classification Yunsheng Shi Zhengjie Huang Shikun Feng Hui Zhong Wenjin Wang Yu Sun AI4CE 65 770 0 08 Sep 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 493 2,051 0 28 Jul 2020
On the Bottleneck of Graph Neural Networks and its Practical Implications Uri Alon Eran Yahav GNN 79 680 0 09 Jun 2020
Linformer: Self-Attention with Linear Complexity Sinong Wang Belinda Z. Li Madian Khabsa Han Fang Hao Ma 179 1,678 0 08 Jun 2020
Open Graph Benchmark: Datasets for Machine Learning on Graphs Weihua Hu Matthias Fey Marinka Zitnik Yuxiao Dong Hongyu Ren Bowen Liu Michele Catasta J. Leskovec 252 2,701 0 02 May 2020
Benchmarking Graph Neural Networks Vijay Prakash Dwivedi Chaitanya K. Joshi Anh Tuan Luu T. Laurent Yoshua Bengio Xavier Bresson 323 931 0 02 Mar 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 310 42,038 0 03 Dec 2019
Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View Deli Chen Yankai Lin Wei Li Peng Li Jie Zhou Xu Sun 75 1,096 0 07 Sep 2019
Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networks Christopher Morris Martin Ritzert Matthias Fey William L. Hamilton J. E. Lenssen Gaurav Rattan Martin Grohe GNN 147 1,625 0 04 Oct 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 193 7,554 0 01 Oct 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 384 19,991 0 30 Oct 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 536 28,901 0 09 Sep 2016