LAGC: Lazily Aggregated Gradient Coding for Straggler-Tolerant and Communication-Efficient Distributed Learning

22 May 2019

Osvaldo Simeone

Papers citing "LAGC: Lazily Aggregated Gradient Coding for Straggler-Tolerant and Communication-Efficient Distributed Learning"

24 / 24 papers shown

Title
Gradient Coding Based on Block Designs for Mitigating Adversarial Stragglers S. Kadhe O. O. Koyluoglu Kannan Ramchandran 39 28 0 30 Apr 2019
Gradient Coding with Clustering and Multi-message Communication Emre Ozfatura Deniz Gunduz S. Ulukus 47 39 0 05 Mar 2019
ErasureHead: Distributed Gradient Descent without Delays Using Approximate Gradient Coding Hongyi Wang Zachary B. Charles Dimitris Papailiopoulos 36 55 0 28 Jan 2019
Efficient Distributed Hessian Free Algorithm for Large-scale Empirical Risk Minimization via Accumulating Sample Strategy Majid Jahani Xi He Chenxin Ma Aryan Mokhtari Dheevatsa Mudigere Alejandro Ribeiro Martin Takáč 76 19 0 26 Oct 2018
LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning Tianyi Chen G. Giannakis Tao Sun W. Yin 53 298 0 25 May 2018
Robust Gradient Descent via Moment Encoding with LDPC Codes R. Maity A. S. Rawat A. Mazumdar 49 41 0 22 May 2018
Rateless Codes for Near-Perfect Load Balancing in Distributed Matrix-Vector Multiplication Ankur Mallick Malhar Chaudhari Utsav Sheth Ganesh Palanikumar Gauri Joshi 69 142 0 27 Apr 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 57 197 0 03 Mar 2018
signSGD: Compressed Optimisation for Non-Convex Problems Jeremy Bernstein Yu Wang Kamyar Azizzadenesheli Anima Anandkumar FedML ODL 96 1,043 0 13 Feb 2018
Communication-Computation Efficient Gradient Coding Min Ye Emmanuel Abbe 57 158 0 09 Feb 2018
Approximate Gradient Coding via Sparse Random Graphs Zachary B. Charles Dimitris Papailiopoulos J. Ellenberg 54 77 0 17 Nov 2017
Gradient Sparsification for Communication-Efficient Distributed Optimization Jianqiao Wangni Jialei Wang Ji Liu Tong Zhang 87 525 0 26 Oct 2017
Gradient Coding from Cyclic MDS Codes and Expander Graphs Netanel Raviv Itzhak Tamo Rashish Tandon A. Dimakis 39 182 0 12 Jul 2017
Improving Distributed Gradient Descent Using Reed-Solomon Codes Wael Halbawi Navid Azizan Fariborz Salehi B. Hassibi AI4CE FedML 48 157 0 16 Jun 2017
Polynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplication Qian-long Yu M. Maddah-ali A. Avestimehr 110 463 0 30 May 2017
Distributed Mean Estimation with Limited Communication A. Suresh Felix X. Yu Sanjiv Kumar H. B. McMahan FedML 104 364 0 02 Nov 2016
Optimization Methods for Large-Scale Machine Learning Léon Bottou Frank E. Curtis J. Nocedal 243 3,208 0 15 Jun 2016
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems Martín Abadi Ashish Agarwal P. Barham E. Brevdo Zhiwen Chen ... Pete Warden Martin Wattenberg Martin Wicke Yuan Yu Xiaoqiang Zheng 269 11,152 0 14 Mar 2016
Distributed Optimization with Arbitrary Local Solvers Chenxin Ma Jakub Konecný Martin Jaggi Virginia Smith Michael I. Jordan Peter Richtárik Martin Takáč 91 198 0 13 Dec 2015
Speeding Up Distributed Machine Learning Using Codes Kangwook Lee Maximilian Lam Ramtin Pedarsani Dimitris Papailiopoulos Kannan Ramchandran 195 858 0 08 Dec 2015
Optimizing Neural Networks with Kronecker-factored Approximate Curvature James Martens Roger C. Grosse ODL 101 1,013 0 19 Mar 2015
Communication-Efficient Distributed Dual Coordinate Ascent Martin Jaggi Virginia Smith Martin Takáč Jonathan Terhorst S. Krishnan Thomas Hofmann Michael I. Jordan 86 353 0 04 Sep 2014
Communication Efficient Distributed Optimization using an Approximate Newton-type Method Ohad Shamir Nathan Srebro Tong Zhang 92 556 0 30 Dec 2013
HOGWILD!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent Feng Niu Benjamin Recht Christopher Ré Stephen J. Wright 195 2,273 0 28 Jun 2011