ErasureHead: Distributed Gradient Descent without Delays Using Approximate Gradient Coding

28 January 2019

Papers citing "ErasureHead: Distributed Gradient Descent without Delays Using Approximate Gradient Coding"

19 / 19 papers shown

Title
ATOMO: Communication-efficient Learning via Atomic Sparsification Hongyi Wang Scott Sievert Zachary B. Charles Shengchao Liu S. Wright Dimitris Papailiopoulos 85 354 0 11 Jun 2018
Gradient Coding via the Stochastic Block Model Zachary B. Charles Dimitris Papailiopoulos 44 16 0 25 May 2018
DRACO: Byzantine-resilient Distributed Training via Redundant Gradients Lingjiao Chen Hongyi Wang Zachary B. Charles Dimitris Papailiopoulos 50 248 0 27 Mar 2018
Communication-Computation Efficient Gradient Coding Min Ye Emmanuel Abbe 62 158 0 09 Feb 2018
Straggler Mitigation in Distributed Matrix Multiplication: Fundamental Limits and Optimal Coding Qian-long Yu M. Maddah-ali A. Avestimehr 84 40 0 23 Jan 2018
Hierarchical Coding for Distributed Computing Hyegyeong Park Kangwook Lee Jy-yong Sohn Changho Suh Jaekyun Moon 50 75 0 15 Jan 2018
Approximate Gradient Coding via Sparse Random Graphs Zachary B. Charles Dimitris Papailiopoulos J. Ellenberg 61 78 0 17 Nov 2017
Near-Optimal Straggler Mitigation for Distributed Gradient Methods Songze Li Seyed Mohammadreza Mousavi Kalan A. Avestimehr Mahdi Soltanolkotabi 66 98 0 27 Oct 2017
Gradient Coding from Cyclic MDS Codes and Expander Graphs Netanel Raviv Itzhak Tamo Rashish Tandon A. Dimakis 47 183 0 12 Jul 2017
Improving Distributed Gradient Descent Using Reed-Solomon Codes Wael Halbawi Navid Azizan Fariborz Salehi B. Hassibi AI4CE FedML 52 158 0 16 Jun 2017
Polynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplication Qian-long Yu M. Maddah-ali A. Avestimehr 121 464 0 30 May 2017
QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding Dan Alistarh Demjan Grubic Jerry Li Ryota Tomioka Milan Vojnović MQ 84 422 0 07 Oct 2016
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark Schmidt 280 1,221 0 16 Aug 2016
Revisiting Distributed Synchronous SGD Jianmin Chen Xinghao Pan R. Monga Samy Bengio Rafal Jozefowicz 89 801 0 04 Apr 2016
Speeding Up Distributed Machine Learning Using Codes Kangwook Lee Maximilian Lam Ramtin Pedarsani Dimitris Papailiopoulos Kannan Ramchandran 215 860 0 08 Dec 2015
Coded MapReduce Songze Li M. Maddah-ali A. Avestimehr 48 163 0 05 Dec 2015
Perturbed Iterate Analysis for Asynchronous Stochastic Optimization Horia Mania Xinghao Pan Dimitris Papailiopoulos Benjamin Recht Kannan Ramchandran Michael I. Jordan 104 233 0 24 Jul 2015
When Do Redundant Requests Reduce Latency ? Nihar B. Shah Kangwook Lee Kannan Ramchandran 70 186 0 07 Nov 2013
HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent Feng Niu Benjamin Recht Christopher Ré Stephen J. Wright 209 2,273 0 28 Jun 2011