Staleness-aware Async-SGD for Distributed Deep Learning

Staleness-aware Async-SGD for Distributed Deep Learning

18 November 2015

Wei Zhang

Papers citing "Staleness-aware Async-SGD for Distributed Deep Learning"

5 / 5 papers shown

Title
ZenFlow: Enabling Stall-Free Offloading Training via Asynchronous Updates Tingfeng Lan Yusen Wu Bin Ma Zhaoyuan Su Rui Yang Tekin Bicer Dong Li Yue Cheng 43 0 0 18 May 2025
No Need to Talk: Asynchronous Mixture of Language Models Anastasiia Filippova Angelos Katharopoulos David Grangier Ronan Collobert MoE 49 0 0 04 Oct 2024
Ordered Momentum for Asynchronous SGD Chang-Wei Shi Yi-Rui Yang Wu-Jun Li ODL 98 0 0 27 Jul 2024
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework Siyuan Yu Wei Chen H. V. Poor 54 0 0 17 Jun 2024
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review Sajjad Emdadi Mahdimahalleh AI4CE 43 0 0 01 Aug 2023