Flare: Flexible In-Network Allreduce

Flare: Flexible In-Network Allreduce

29 June 2021

Daniele De Sensi

Salvatore Di Girolamo

Torsten Hoefler

Papers citing "Flare: Flexible In-Network Allreduce"

10 / 10 papers shown

Title
FPsPIN: An FPGA-based Open-Hardware Research Platform for Processing in the Network Timo Schneider Pengcheng Xu Torsten Hoefler 22 0 0 25 May 2024
Near-Optimal Wafer-Scale Reduce Piotr Luczynski Lukas Gianinazzi Patrick Iff Leighton Wilson Daniele De Sensi Torsten Hoefler 30 2 0 24 Apr 2024
Swing: Short-cutting Rings for Higher Bandwidth Allreduce Daniele De Sensi Tommaso Bonato D. Saam Torsten Hoefler 25 6 0 17 Jan 2024
Canary: Congestion-Aware In-Network Allreduce Using Dynamic Trees Daniele De Sensi Edgar Costa Molero Salvatore Di Girolamo Laurent Vanbever Torsten Hoefler 17 3 0 28 Sep 2023
A Survey of Potential MPI Complex Collectives: Large-Scale Mining and Analysis of HPC Applications Pouya Haghi Ryan J. Marshall P. Chen Anthony Skjellum Martin C. Herbordt 16 2 0 31 May 2023
SparDL: Distributed Deep Learning Training with Efficient Sparse Communication Minjun Zhao Yichen Yin Yuren Mao Qing Liu Lu Chen Yunjun Gao 18 1 0 03 Apr 2023
ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale William Won Taekyung Heo Saeed Rashidi Srinivas Sridharan S. Srinivasan T. Krishna 36 43 0 24 Mar 2023
HammingMesh: A Network Topology for Large-Scale Deep Learning Torsten Hoefler Tommaso Bonato Daniele De Sensi Salvatore Di Girolamo Shigang Li Marco Heddes Jon Belk Deepak Goel Miguel Castro Steve Scott 3DH GNN AI4CE 26 20 0 03 Sep 2022
Themis: A Network Bandwidth-Aware Collective Scheduling Policy for Distributed Training of DL Models Saeed Rashidi William Won S. Srinivasan Srinivas Sridharan T. Krishna GNN 17 29 0 09 Oct 2021
Sparsity in Deep Learning: Pruning and growth for efficient inference and training in neural networks Torsten Hoefler Dan Alistarh Tal Ben-Nun Nikoli Dryden Alexandra Peste MQ 141 684 0 31 Jan 2021