HongTu: Scalable Full-Graph GNN Training on Multiple GPUs (via communication-optimized CPU data offloading)

25 November 2023

Papers citing "HongTu: Scalable Full-Graph GNN Training on Multiple GPUs (via communication-optimized CPU data offloading)"

5 / 5 papers shown

Title
Reducing Memory Contention and I/O Congestion for Disk-based GNN Training Qisheng Jiang Lei Jia Chundong Wang GNN 26 1 0 20 Jun 2024
Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch Saurabh Bajaj Hui Guan Marco Serafini GNN 33 1 0 01 Jun 2024
GSplit: Scaling Graph Neural Network Training on Large Graphs via Split-Parallelism Sandeep Polisetty Juelin Liu Kobi Falus Yi Ren Fung Seung-Hwan Lim Hui Guan Marco Serafini GNN 28 10 0 24 Mar 2023
ZeRO-Offload: Democratizing Billion-Scale Model Training Jie Ren Samyam Rajbhandari Reza Yazdani Aminabadi Olatunji Ruwase Shuangyang Yang Minjia Zhang Dong Li Yuxiong He MoE 177 414 0 18 Jan 2021
Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks Minjie Wang Da Zheng Zihao Ye Quan Gan Mufei Li ... J. Zhao Haotong Zhang Alex Smola Jinyang Li Zheng-Wei Zhang AI4CE GNN 197 746 0 03 Sep 2019