Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis

19 May 2022

Papers citing "Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis"

50 / 135 papers shown

Title
A Review of Graph-Powered Data Quality Applications for IoT Monitoring Sensor Networks Pau Ferrer-Cid Jose M. Barcelo-Ordinas J. García-Vidal 162 4 0 28 Oct 2024
Demystifying Chains, Trees, and Graphs of Thoughts Maciej Besta Florim Memedi Zhenyu Zhang Robert Gerstenberger Guangyuan Piao ... Aleš Kubíček H. Niewiadomski Aidan O'Mahony Onur Mutlu Torsten Hoefler AI4CE LRM 212 27 0 25 Jan 2024
BNS-GCN: Efficient Full-Graph Training of Graph Convolutional Networks with Partition-Parallelism and Random Boundary Node Sampling Cheng Wan Youjie Li Ang Li Namjae Kim Yingyan Lin GNN 79 76 0 21 Mar 2022
PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication Cheng Wan Youjie Li Cameron R. Wolfe Anastasios Kyrillidis Namjae Kim Yingyan Lin GNN 58 70 0 20 Mar 2022
I-GCN: A Graph Convolutional Network Accelerator with Runtime Locality Enhancement through Islandization Tong Geng Chunshu Wu Yongan Zhang Cheng Tan Chenhao Xie Haoran You Martin C. Herbordt Yingyan Lin Ang Li GNN 41 108 0 07 Mar 2022
PaSca: a Graph Neural Architecture Search System under the Scalable Paradigm Wentao Zhang Yu Shen Zheyu Lin Yang Li Xiaosen Li Wenbin Ouyang Yangyu Tao Zhi-Xin Yang Tengjiao Wang GNN 72 60 0 01 Mar 2022
Asynchronous Distributed-Memory Triangle Counting and LCC with RMA Caching András Strausz Flavio Vella Salvatore Di Girolamo Maciej Besta Torsten Hoefler 54 12 0 28 Feb 2022
Decoupling the Depth and Scope of Graph Neural Networks Hanqing Zeng Muhan Zhang Yinglong Xia Ajitesh Srivastava Andrey Malevich Rajgopal Kannan Viktor Prasanna Long Jin Ren Chen GNN 78 145 0 19 Jan 2022
GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design Sung Une Lee Boming Xia Yongan Zhang Ang Li Yingyan Lin GNN 94 48 0 22 Dec 2021
BGL: GPU-Efficient GNN Training by Optimizing Graph Data I/O and Preprocessing Tianfeng Liu Yangrui Chen Dan Li Chuan Wu Yibo Zhu Jun He Size Zheng Hongzheng Chen Hongzhi Chen Chuanxiong Guo GNN 47 77 0 16 Dec 2021
Sequential Aggregation and Rematerialization: Distributed Full-batch Training of Graph Neural Networks on Large Graphs Hesham Mostafa GNN 69 24 0 11 Nov 2021
Optimizing Sparse Matrix Multiplications for Graph Neural Networks Shenghao Qiu You Liang Zheng Wang GNN 41 18 0 30 Oct 2021
Understanding GNN Computational Graph: A Coordinated Computation, IO, and Memory Perspective Hengrui Zhang Zhongming Yu Guohao Dai Guyue Huang Yufei Ding Yuan Xie Yu Wang GNN 46 46 0 18 Oct 2021
MG-GCN: Scalable Multi-GPU GCN Training Framework M. F. Balin Kaan Sancak Ümit V. Çatalyürek GNN 55 7 0 17 Oct 2021
Efficient Scaling of Dynamic Graph Neural Networks Venkatesan T. Chakaravarthy Shivmaran S. Pandian S. Raje Yogish Sabharwal Toyotaro Suzumura Shashanka Ubaru GNN 59 23 0 16 Sep 2021
Towards Efficient Point Cloud Graph Neural Networks Through Architectural Simplification Shyam A. Tailor R. D. Jong Tiago Azevedo Matthew Mattina Partha P. Maji 3DPC GNN 37 12 0 13 Aug 2021
Bridging the Gap between Spatial and Spectral Domains: A Unified Framework for Graph Neural Networks Zhiqian Chen Fanglan Chen Lei Zhang Taoran Ji Kaiqun Fu Liang Zhao Feng Chen Lingfei Wu Charu C. Aggarwal Chang-Tien Lu 77 19 0 21 Jul 2021
Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines Shigang Li Torsten Hoefler GNN AI4CE LRM 111 134 0 14 Jul 2021
Training Graph Neural Networks with 1000 Layers Guohao Li Matthias Muller Guohao Li V. Koltun GNN AI4CE 81 239 0 14 Jun 2021
Learning Combinatorial Node Labeling Algorithms Lukas Gianinazzi M. Fries Nikoli Dryden Tal Ben-Nun Maciej Besta Torsten Hoefler GNN OffRL 28 15 0 07 Jun 2021
SpreadGNN: Serverless Multi-task Federated Learning for Graph Neural Networks Chaoyang He Emir Ceyani Keshav Balasubramanian M. Annavaram Salman Avestimehr FedML 59 52 0 04 Jun 2021
GemNet: Universal Directional Graph Neural Networks for Molecules Johannes Klicpera Florian Becker Stephan Günnemann AI4CE 78 456 0 02 Jun 2021
Motif Prediction with Graph Neural Networks Maciej Besta Raphael Grob Cesare Miglioli Nico Bernold Grzegorz Kwa'sniewski ... Raghavendra Kanakagiri Saleh Ashkboos Lukas Gianinazzi Nikoli Dryden Torsten Hoefler 66 38 0 26 May 2021
Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threads John Thorpe Yifan Qiao Jon Eyolfson Shen Teng Guanzhou Hu ... Jinliang Wei Keval Vora Ravi Netravali Miryung Kim G. Xu GNN 44 143 0 24 May 2021
GNNIE: GNN Inference Engine with Load-balancing and Graph-Specific Caching Sudipta Mondal Susmita Dey Manasi K. Kunal S. Ramprasath S. Sapatnekar GNN 22 15 0 21 May 2021
Benchmarking a New Paradigm: An Experimental Analysis of a Real Processing-in-Memory Architecture Juan Gómez Luna I. E. Hajj Ivan Fernandez Christina Giannoula Geraldo F. Oliveira O. Mutlu 40 84 0 09 May 2021
DAMOV: A New Methodology and Benchmark Suite for Evaluating Data Movement Bottlenecks Geraldo F. Oliveira Juan Gómez Luna Lois Orosa Saugata Ghose Nandita Vijaykumar Ivan Fernandez Mohammad Sadrosadati O. Mutlu 64 83 0 08 May 2021
Scalable Graph Neural Network Training: The Case for Sampling Marco Serafini Hui Guan GNN 56 26 0 05 May 2021
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges M. Bronstein Joan Bruna Taco S. Cohen Petar Velivcković GNN 331 1,147 0 27 Apr 2021
GMLP: Building Scalable and Flexible Graph Neural Networks with Feature-Message Passing Wentao Zhang Yu Shen Zheyu Lin Yang Li Xiaosen Li Wenbin Ouyang Yangyu Tao Zhi-Xin Yang Tengjiao Wang 42 9 0 20 Apr 2021
SISA: Set-Centric Instruction Set Architecture for Graph Mining on Processing-in-Memory Systems Maciej Besta Raghavendra Kanakagiri Grzegorz Kwa'sniewski Rachata Ausavarungnirun Jakub Beránek ... Salvatore Di Girolamo Marek Konieczny Nils Blach O. Mutlu Torsten Hoefler 31 85 0 15 Apr 2021
DistGNN: Scalable Distributed Training for Large-Scale Graph Neural Networks Vasimuddin Sanchit Misra Guixiang Ma Ramanarayan Mohanty E. Georganas A. Heinecke Dhiraj D. Kalamkar Nesreen Ahmed Sasikanth Avancha GNN 58 122 0 14 Apr 2021
BlockGNN: Towards Efficient GNN Acceleration Using Block-Circulant Weight Matrices Zhe Zhou Bizhao Shi Zhe Zhang Yijin Guan Guangyu Sun Guojie Luo GNN 59 32 0 13 Apr 2021
Optimizing Memory Efficiency of Graph Neural Networks on Edge Computing Platforms Ao Zhou Jianlei Yang Yeqi Gao Tong Qiao Yingjie Qi Xiaoyi Wang Yunli Chen Pengcheng Dai Weisheng Zhao Chunming Hu GNN 38 10 0 07 Apr 2021
Graph Classification by Mixture of Diverse Experts Fenyu Hu Liping Wang Shu Wu Liang Wang Tieniu Tan 95 10 0 29 Mar 2021
Sampling methods for efficient training of graph convolutional networks: A survey Xin Liu Yurui Lai Lei Deng Guoqi Li Xiaochun Ye Xiaochun Ye GNN 67 102 0 10 Mar 2021
GraphMineSuite: Enabling High-Performance and Programmable Graph Mining Algorithms with Set Algebra Maciej Besta Zur Vonarburg-Shmaria Yannick Schaffner Leonardo Schwarz Grzegorz Kwa'sniewski ... Philipp Lindenberger Pavel Kalvoda Marek Konieczny O. Mutlu Torsten Hoefler 52 27 0 05 Mar 2021
Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture S. Min Kun Wu Sitao Huang Mert Hidayetouglu Jinjun Xiong Eiman Ebrahimi Deming Chen Wen-mei W. Hwu GNN 45 68 0 04 Mar 2021
Graph Neural Network for Traffic Forecasting: A Survey Weiwei Jiang Jiayun Luo GNN AI4TS AI4CE 192 866 0 27 Jan 2021
A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sources Xiao Wang Deyu Bo C. Shi Shaohua Fan Yanfang Ye Philip S. Yu AI4TS 74 305 0 30 Nov 2020
FusedMM: A Unified SDDMM-SpMM Kernel for Graph Embedding and Graph Neural Networks Md. Khaledur Rahman Majedul Haque Sujon A. Azad FedML GNN 40 50 0 07 Nov 2020
Graph Neural Networks in Recommender Systems: A Survey Shiwen Wu Fei Sun Wentao Zhang Xu Xie Tengjiao Wang GNN 123 1,218 0 04 Nov 2020
To Push or To Pull: On Reducing Communication and Synchronization in Graph Computations Maciej Besta Michal Podstawski Linus Groner Edgar Solomonik Torsten Hoefler 46 137 0 30 Oct 2020
Substream-Centric Maximum Matchings on FPGA Maciej Besta Marc Fischer Tal Ben-Nun Dimitri Stanojevic Johannes de Fine Licht Torsten Hoefler 64 28 0 28 Oct 2020
Slim NoC: A Low-Diameter On-Chip Network Topology for High Energy Efficiency and Scalability Maciej Besta S. M. Hassan S. Yalamanchili Rachata Ausavarungnirun O. Mutlu Torsten Hoefler GNN 99 50 0 21 Oct 2020
SlimSell: A Vectorizable Graph Representation for Breadth-First Search Maciej Besta Florian Marending Edgar Solomonik Torsten Hoefler 85 64 0 19 Oct 2020
High-Performance Distributed RMA Locks P. Schmid Maciej Besta Torsten Hoefler 59 31 0 19 Oct 2020
Evaluating the Cost of Atomic Operations on Modern Architectures Hermann Schweizer Maciej Besta Torsten Hoefler 53 91 0 19 Oct 2020
Accelerating Irregular Computations with Hardware Transactional Memory and Active Messages Maciej Besta Torsten Hoefler GNN 51 45 0 18 Oct 2020
Fault Tolerance for Remote Memory Access Programming Models Maciej Besta Torsten Hoefler 44 39 0 18 Oct 2020