Step-Ahead Error Feedback for Distributed Training with Compressed Gradient

13 August 2020

Papers citing "Step-Ahead Error Feedback for Distributed Training with Compressed Gradient"

4 / 4 papers shown

Title
Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression Jaeyong Song Jinkyu Yim Jaewon Jung Hongsun Jang H. Kim Youngsok Kim Jinho Lee GNN 24 25 0 24 Jan 2023
PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems Yuanxing Zhang Langshi Chen Siran Yang Man Yuan Hui-juan Yi ... Yong Li Dingyang Zhang Wei Lin Lin Qu Bo Zheng 32 32 0 11 Apr 2022
Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentation An Xu Wenqi Li Pengfei Guo Dong Yang H. Roth Ali Hatamizadeh Can Zhao Daguang Xu Heng-Chiao Huang Ziyue Xu FedML 36 51 0 18 Mar 2022
Detached Error Feedback for Distributed SGD with Random Sparsification An Xu Heng-Chiao Huang 39 9 0 11 Apr 2020