Straggler Mitigation in Distributed Optimization Through Data Encoding

14 November 2017

C. Karakuş

Yifan Sun

Suhas Diggavi

W. Yin

ArXiv PDF HTML

Papers citing "Straggler Mitigation in Distributed Optimization Through Data Encoding"

25 / 25 papers shown

Title
A Dynamic Weighting Strategy to Mitigate Worker Node Failure in Distributed Deep Learning Yuesheng Xu Arielle Carr 32 0 0 14 Sep 2024
Approximate, Adapt, Anonymize (3A): a Framework for Privacy Preserving Training Data Release for Machine Learning Tamas Madl Weijie Xu Olivia Choudhury Matthew Howard 37 5 0 04 Jul 2023
Randomized Kaczmarz in Adversarial Distributed Setting Longxiu Huang Xia Li Deanna Needell 23 2 0 24 Feb 2023
Straggler-Resilient Differentially-Private Decentralized Learning Yauhen Yakimenka Chung-Wei Weng Hsuan-Yin Lin E. Rosnes J. Kliewer 36 6 0 06 Dec 2022
Impact of Redundancy on Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 39 2 0 16 Nov 2022
Byzantine Fault Tolerance in Distributed Machine Learning : a Survey Djamila Bouhata Hamouma Moumen Moumen Hamouma Ahcène Bounceur AI4CE 31 7 0 05 May 2022
CodedPaddedFL and CodedSecAgg: Straggler Mitigation and Secure Aggregation in Federated Learning Reent Schlegel Siddhartha Kumar E. Rosnes Alexandre Graell i Amat FedML 27 43 0 16 Dec 2021
DSAG: A mixed synchronous-asynchronous iterative method for straggler-resilient learning A. Severinson E. Rosnes S. E. Rouayheb Alexandre Graell i Amat 22 2 0 27 Nov 2021
Coding for Straggler Mitigation in Federated Learning Siddhartha Kumar Reent Schlegel E. Rosnes Alexandre Graell i Amat FedML 26 11 0 30 Sep 2021
A Practical Algorithm Design and Evaluation for Heterogeneous Elastic Computing with Stragglers Nicholas Woolsey Joerg Kliewer Rong-Rong Chen Mingyue Ji 17 7 0 18 Jul 2021
Asynchronous Distributed Optimization with Redundancy in Cost Functions Shuo Liu Nirupam Gupta Nitin H. Vaidya 31 3 0 07 Jun 2021
Towards Demystifying Serverless Machine Learning Training Jiawei Jiang Shaoduo Gan Yue Liu Fanlin Wang Gustavo Alonso Ana Klimovic Ankit Singla Wentao Wu Ce Zhang 19 122 0 17 May 2021
Straggler-Resilient Distributed Machine Learning with Dynamic Backup Workers Guojun Xiong Gang Yan Rahul Singh Jian Li 33 12 0 11 Feb 2021
Coded Computing for Low-Latency Federated Learning over Wireless Edge Networks Saurav Prakash S. Dhakal M. Akdeniz Yair Yona S. Talwar Salman Avestimehr N. Himayat FedML 35 92 0 12 Nov 2020
Throughput-Optimal Topology Design for Cross-Silo Federated Learning Othmane Marfoq Chuan Xu Giovanni Neglia Richard Vidal FedML 67 85 0 23 Oct 2020
Decentralized gradient methods: does topology matter? Giovanni Neglia Chuan Xu Don Towsley G. Calbi 24 50 0 28 Feb 2020
Timely-Throughput Optimal Coded Computing over Cloud Networks Chien-Sheng Yang Ramtin Pedarsani A. Avestimehr 16 34 0 11 Apr 2019
Fault Tolerance in Iterative-Convergent Machine Learning Aurick Qiao Bryon Aragam Bingjing Zhang Eric Xing 26 41 0 17 Oct 2018
PolyShard: Coded Sharding Achieves Linearly Scaling Efficiency and Security Simultaneously Songze Li Mingchao Yu Chien-Sheng Yang A. Avestimehr Sreeram Kannan Pramod Viswanath 26 110 0 27 Sep 2018
Lagrange Coded Computing: Optimal Design for Resiliency, Security and Privacy Qian-long Yu Songze Li Netanel Raviv Seyed Mohammadreza Mousavi Kalan Jinhyun So A. Avestimehr 41 382 0 04 Jun 2018
Polynomially Coded Regression: Optimal Straggler Mitigation via Data Encoding Songze Li Seyed Mohammadreza Mousavi Kalan Qian-long Yu Mahdi Soltanolkotabi A. Avestimehr 26 48 0 24 May 2018
Robust Gradient Descent via Moment Encoding with LDPC Codes R. Maity A. S. Rawat A. Mazumdar 13 41 0 22 May 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 31 194 0 03 Mar 2018
Coded Computing for Distributed Graph Analytics Saurav Prakash Amirhossein Reisizadeh Ramtin Pedarsani A. Avestimehr 15 50 0 17 Jan 2018
Coded Computation over Heterogeneous Clusters Amirhossein Reisizadeh Saurav Prakash Ramtin Pedarsani A. Avestimehr 27 225 0 21 Jan 2017