Scaling Distributed Training with Adaptive Summation

4 June 2020

Papers citing "Scaling Distributed Training with Adaptive Summation"

2 / 2 papers shown

Title
Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression Jaeyong Song Jinkyu Yim Jaewon Jung Hongsun Jang H. Kim Youngsok Kim Jinho Lee GNN 74 28 0 24 Jan 2023
Distributed Training of Embeddings using Graph Analytics G. Gill Roshan Dathathri Saeed Maleki Madan Musuvathi Todd Mytkowicz Olli Saarikivi The University of Texas at Austin GNN 39 1 0 08 Sep 2019