Improving Distributed Gradient Descent Using Reed-Solomon Codes

16 June 2017

Papers citing "Improving Distributed Gradient Descent Using Reed-Solomon Codes"

31 / 31 papers shown

Title
Erasure Coded Neural Network Inference via Fisher Averaging Divyansh Jhunjhunwala Neharika Jali Gauri Joshi Shiqiang Wang MoMe FedML 31 1 0 02 Sep 2024
Securely Aggregated Coded Matrix Inversion Neophytos Charalambides Mert Pilanci Alfred Hero FedML 21 3 0 09 Jan 2023
Sequential Gradient Coding For Straggler Mitigation M. Krishnan Mohammadreza Ebrahimi Ashish Khisti 21 0 0 24 Nov 2022
Impact of Redundancy on Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 39 2 0 16 Nov 2022
Secure Linear MDS Coded Matrix Inversion Neophytos Charalambides Mert Pilanci Alfred Hero 27 5 0 13 Jul 2022
Adaptive Gap Entangled Polynomial Coding for Multi-Party Computation at the Edge Elahe Vedadi Yasaman Keshtkarjahromi H. Seferoglu 29 1 0 13 Mar 2022
Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent Pedro Soto Ilia Ilmer Haibin Guan Jun Li 38 3 0 31 Jan 2022
Orthonormal Sketches for Secure Coded Regression Neophytos Charalambides Hessam Mahdavifar Mert Pilanci Alfred Hero 30 8 0 21 Jan 2022
A Practical Algorithm Design and Evaluation for Heterogeneous Elastic Computing with Stragglers Nicholas Woolsey Joerg Kliewer Rong-Rong Chen Mingyue Ji 24 7 0 18 Jul 2021
Asynchronous Distributed Optimization with Redundancy in Cost Functions Shuo Liu Nirupam Gupta Nitin H. Vaidya 31 3 0 07 Jun 2021
Soft BIBD and Product Gradient Codes Animesh Sakorikar Lele Wang 29 5 0 11 May 2021
Coded Gradient Aggregation: A Tradeoff Between Communication Costs at Edge Nodes and at Helper Nodes B. Sasidharan Anoop Thomas 28 9 0 06 May 2021
Gradient Coding with Dynamic Clustering for Straggler-Tolerant Distributed Learning Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 35 15 0 01 Mar 2021
On Gradient Coding with Partial Recovery Sahasrajit Sarmasarkar V. Lalitha Nikhil Karamchandani 26 8 0 19 Feb 2021
Gradient Coding with Dynamic Clustering for Straggler Mitigation Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 29 7 0 03 Nov 2020
Diversity/Parallelism Trade-off in Distributed Systems with Redundancy Pei Peng E. Soljanin P. Whiting 22 14 0 05 Oct 2020
Coded Distributed Computing with Partial Recovery Emre Ozfatura S. Ulukus Deniz Gunduz 38 28 0 04 Jul 2020
Communication-Efficient Gradient Coding for Straggler Mitigation in Distributed Learning S. Kadhe O. O. Koyluoglu Kannan Ramchandran 32 11 0 14 May 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 31 327 0 22 Feb 2020
Secure Coded Cooperative Computation at the Heterogeneous Edge against Byzantine Attacks Yasaman Keshtkarjahromi Rawad Bitar Venkateswara Dasari S. E. Rouayheb H. Seferoglu 22 11 0 15 Aug 2019
LAGC: Lazily Aggregated Gradient Coding for Straggler-Tolerant and Communication-Efficient Distributed Learning Jingjing Zhang Osvaldo Simeone 18 31 0 22 May 2019
Gradient Coding with Clustering and Multi-message Communication Emre Ozfatura Deniz Gunduz S. Ulukus 26 38 0 05 Mar 2019
On the Effect of Task-to-Worker Assignment in Distributed Computing Systems with Stragglers Amir Behrouzi-Far E. Soljanin 29 14 0 08 Aug 2018
Lagrange Coded Computing: Optimal Design for Resiliency, Security and Privacy Qian-long Yu Songze Li Netanel Raviv Seyed Mohammadreza Mousavi Kalan Jinhyun So A. Avestimehr 47 382 0 04 Jun 2018
Polynomially Coded Regression: Optimal Straggler Mitigation via Data Encoding Songze Li Seyed Mohammadreza Mousavi Kalan Qian-long Yu Mahdi Soltanolkotabi A. Avestimehr 31 48 0 24 May 2018
Robust Gradient Descent via Moment Encoding with LDPC Codes R. Maity A. S. Rawat A. Mazumdar 27 41 0 22 May 2018
Rateless Codes for Near-Perfect Load Balancing in Distributed Matrix-Vector Multiplication Ankur Mallick Malhar Chaudhari Utsav Sheth Ganesh Palanikumar Gauri Joshi 19 141 0 27 Apr 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 31 194 0 03 Mar 2018
Hierarchical Coding for Distributed Computing Hyegyeong Park Kangwook Lee Jy-yong Sohn Changho Suh Jaekyun Moon 26 74 0 15 Jan 2018
Near Optimal Coded Data Shuffling for Distributed Learning Mohamed Adel Attia Ravi Tandon FedML 34 30 0 05 Jan 2018
Straggler Mitigation by Delayed Relaunch of Tasks M. Aktaş Pei Peng E. Soljanin 27 39 0 01 Oct 2017