Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networks

17 November 2019

Quanquan Gu

Papers citing "Layer-Dependent Importance Sampling for Training Deep and Large Graph Convolutional Networks"

50 / 167 papers shown

Title
TpuGraphs: A Performance Prediction Dataset on Large Tensor Computational Graphs P. Phothilimthana Sami Abu-El-Haija Kaidi Cao Bahare Fatemi Mike Burrows Charith Mendis Bryan Perozzi GNN AI4TS 33 17 0 25 Aug 2023
GNNPipe: Scaling Deep GNN Training with Pipelined Model Parallelism Jingji Chen Zhuoming Chen Xuehai Qian GNN AI4CE 38 3 0 19 Aug 2023
The Snowflake Hypothesis: Training Deep GNN with One Node One Receptive field Kun Wang Guohao Li Shilong Wang Guibin Zhang Kaidi Wang Yang You Xiaojiang Peng Keli Zhang Yang Wang 42 8 0 19 Aug 2023
Communication-Free Distributed GNN Training with Vertex Cut Kaidi Cao Rui Deng Shirley Wu E-Wen Huang Karthik Subbian J. Leskovec GNN 24 3 0 06 Aug 2023
VQGraph: Rethinking Graph Representation Space for Bridging GNNs and MLPs Ling Yang Ye Tian Minkai Xu Zhongyi Liu Shenda Hong Wei Qu Wentao Zhang Bin Cui Muhan Zhang J. Leskovec 42 13 0 04 Aug 2023
SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learning Keyu Duan Qian Liu Tat-Seng Chua Shuicheng Yan Wei Tsang Ooi Qizhe Xie Junxian He 35 57 0 03 Aug 2023
Accelerating Sampling and Aggregation Operations in GNN Frameworks with GPU Initiated Direct Storage Accesses Jeongmin Brian Park Vikram Sharma Mailthody Zaid Qureshi Wen-mei W. Hwu GNN 39 12 0 28 Jun 2023
PolicyClusterGCN: Identifying Efficient Clusters for Training Graph Convolutional Networks Saket Gurukar S. Venkatakrishnan B. Ravindran Srinivas Parthasarathy GNN 20 0 0 25 Jun 2023
A Survey on Graph Neural Network Acceleration: Algorithms, Systems, and Customized Hardware Shichang Zhang Atefeh Sohrabizadeh Cheng Wan Zijie Huang Ziniu Hu Yewen Wang Yingyan Lin Lin Jason Cong Yizhou Sun GNN AI4CE 42 23 0 24 Jun 2023
BatchGNN: Efficient CPU-Based Distributed GNN Training on Very Large Graphs Loc Hoang Rita Brugarolas Brufau Ke Ding Bo Wu GNN 35 2 0 23 Jun 2023
Graph Ladling: Shockingly Simple Parallel GNN Training without Intermediate Communication A. Jaiswal Shiwei Liu Tianlong Chen Ying Ding Zhangyang Wang GNN 44 5 0 18 Jun 2023
GC-Flow: A Graph-Based Flow Network for Effective Clustering Tianchun Wang F. Mirzazadeh Xinming Zhang Jing Chen BDL 50 7 0 26 May 2023
The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey Jana Vatter R. Mayer Hans-Arno Jacobsen GNN AI4TS AI4CE 48 23 0 23 May 2023
Tokenized Graph Transformer with Neighborhood Augmentation for Node Classification in Large Graphs Jinsong Chen Chang-Shu Liu Kai-Xin Gao Gaichao Li Kun He 29 4 0 22 May 2023
Learning Large Graph Property Prediction via Graph Segment Training Kaidi Cao P. Phothilimthana Sami Abu-El-Haija Dustin Zelle Yanqi Zhou Charith Mendis J. Leskovec Bryan Perozzi 23 9 0 21 May 2023
Communication-Efficient Graph Neural Networks with Probabilistic Neighborhood Expansion Analysis and Caching Tim Kaler A. Iliopoulos P. Murzynowski Tao B. Schardl C. E. Leiserson Jie Chen GNN 24 15 0 04 May 2023
GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learner Zhenyu Hou Yufei He Yukuo Cen Xiao Liu Yuxiao Dong Evgeny Kharlamov Jie Tang SSL 37 105 0 10 Apr 2023
Provably Convergent Subgraph-wise Sampling for Fast GNN Training Jie Wang Zhihao Shi Xize Liang Shuiwang Ji Bin Li Feng Wu 25 0 0 17 Mar 2023
Boosting Distributed Full-graph GNN Training with Asynchronous One-bit Communication Mengdie Zhang Qi Hu Peng Sun Yonggang Wen Tianwei Zhang GNN 40 5 0 02 Mar 2023
Asymmetric Learning for Graph Neural Network based Link Prediction Kai-Lang Yao Wusuo Li 37 1 0 01 Mar 2023
Graph-based Knowledge Distillation: A survey and experimental evaluation Jing Liu Tongya Zheng Guanzheng Zhang Qinfen Hao 35 8 0 27 Feb 2023
Joint Edge-Model Sparse Learning is Provably Efficient for Graph Neural Networks Shuai Zhang Ming Wang Pin-Yu Chen Sijia Liu Songtao Lu Miaoyuan Liu MLT 29 16 0 06 Feb 2023
LazyGNN: Large-Scale Graph Neural Networks via Lazy Propagation Rui Xue Haoyu Han MohamadAli Torkamani Jian Pei Xiaorui Liu GNN 33 21 0 03 Feb 2023
Simplifying Subgraph Representation Learning for Scalable Link Prediction Paul Louis Shweta Ann Jacob Amirali Salehi-Abari 18 8 0 29 Jan 2023
Graph Neural Networks can Recover the Hidden Features Solely from the Graph Structure Ryoma Sato 37 5 0 26 Jan 2023
GIPA: A General Information Propagation Algorithm for Graph Learning Houyi Li Zhihong Chen Zhao Li Qinkai Zheng Peng Zhang Shuigeng Zhou 49 0 0 19 Jan 2023
FreshGNN: Reducing Memory Access via Stable Historical Embeddings for Graph Neural Network Training Kezhao Huang Haitian Jiang Minjie Wang Guangxuan Xiao David Wipf Xiang Song Quan Gan Zengfeng Huang Jidong Zhai Zheng-Wei Zhang GNN 33 2 0 18 Jan 2023
Hierarchical Estimation for Effective and Efficient Sampling Graph Neural Network Heng Chang Bingbing Xu Qi Cao Yige Yuan Huawei Shen 21 0 0 16 Nov 2022
Self-Supervised Graph Structure Refinement for Graph Neural Networks Jianan Zhao Qianlong Wen Mingxuan Ju Chuxu Zhang Yanfang Ye 45 20 0 12 Nov 2022
A Comprehensive Survey on Distributed Training of Graph Neural Networks Haiyang Lin Yurui Lai Xiaochun Ye Xiaochun Ye Shirui Pan Wenguang Chen Yuan Xie GNN 38 25 0 10 Nov 2022
Characterizing the Efficiency of Graph Neural Network Frameworks with a Magnifying Glass Xin Huang Jongryool Kim Brad Rees Chul-Ho Lee GNN 29 4 0 06 Nov 2022
Efficient Graph Neural Network Inference at Large Scale Xin-pu Gao Wentao Zhang Yingxia Shao Quoc Viet Hung Nguyen Bin Cui Hongzhi Yin AI4CE GNN 62 9 0 01 Nov 2022
Distributed Graph Neural Network Training: A Survey Yingxia Shao Hongzheng Li Xizhi Gu Hongbo Yin Yawen Li Xupeng Miao Wentao Zhang Bin Cui Lei Chen GNN AI4CE 23 56 0 01 Nov 2022
Layer-Neighbor Sampling -- Defusing Neighborhood Explosion in GNNs M. F. Balin Ümit V. Çatalyürek 27 15 0 24 Oct 2022
Binary Graph Convolutional Network with Capacity Exploration Junfu Wang Yuanfang Guo Liang Yang Yun-an Wang GNN 30 5 0 24 Oct 2022
RSC: Accelerating Graph Neural Networks Training via Randomized Sparse Computations Zirui Liu Sheng-Wei Chen Kaixiong Zhou Daochen Zha Xiao Huang Xia Hu 32 15 0 19 Oct 2022
EGG-GAE: scalable graph neural networks for tabular data imputation Lev Telyatnikov Simone Scardapane GNN 31 13 0 19 Oct 2022
SA-MLP: Distilling Graph Knowledge from GNNs into Structure-Aware MLP Jie Chen Shouzhen Chen Mingyuan Bai Junbin Gao Junping Zhang Jian Pu 42 10 0 18 Oct 2022
Old can be Gold: Better Gradient Flow can Make Vanilla-GCNs Great Again Ajay Jaiswal Peihao Wang Tianlong Chen Justin F. Rousseau Ying Ding Zhangyang Wang 37 10 0 14 Oct 2022
A Comprehensive Study on Large-Scale Graph Training: Benchmarking and Rethinking Keyu Duan Zirui Liu Peihao Wang Wenqing Zheng Kaixiong Zhou Tianlong Chen Xia Hu Zhangyang Wang GNN 43 57 0 14 Oct 2022
Hierarchical Graph Transformer with Adaptive Node Sampling Zaixin Zhang Qi Liu Qingyong Hu Cheekong Lee 81 82 0 08 Oct 2022
DiP-GNN: Discriminative Pre-Training of Graph Neural Networks Simiao Zuo Haoming Jiang Qingyu Yin Xianfeng Tang Bing Yin Tuo Zhao 37 0 0 15 Sep 2022
Analyzing the Effect of Sampling in GNNs on Individual Fairness Rebecca Salganik Fernando Diaz G. Farnadi 24 1 0 08 Sep 2022
Rethinking Efficiency and Redundancy in Training Large-scale Graphs Xin Liu Xunbin Xiong Yurui Lai Runzhen Xue Shirui Pan Xiaochun Ye Xiaochun Ye 21 1 0 02 Sep 2022
Graph Generative Model for Benchmarking Graph Neural Networks Minji Yoon Yue Wu John Palowitch Bryan Perozzi Ruslan Salakhutdinov 31 7 0 10 Jul 2022
Generalization Guarantee of Training Graph Convolutional Networks with Graph Topology Sampling Hongkang Li Ming Wang Sijia Liu Pin-Yu Chen Jinjun Xiong GNN 16 27 0 07 Jul 2022
Sampling Enclosing Subgraphs for Link Prediction Paul Louis Shweta Ann Jacob Amirali Salehi-Abari GNN 27 14 0 23 Jun 2022
GraphFM: Improving Large-Scale GNN Training via Feature Momentum Haiyang Yu Limei Wang Bokun Wang Meng Liu Tianbao Yang Shuiwang Ji GNN AI4CE 37 39 0 14 Jun 2022
NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphs Jinsong Chen Kaiyuan Gao Gaichao Li Kun He 39 103 0 10 Jun 2022
Alternately Optimized Graph Neural Networks Haoyu Han Xiaorui Liu Haitao Mao Torkamani Ali Feng Shi Victor E. Lee Jiliang Tang GNN 44 8 0 08 Jun 2022