Communication-Computation Efficient Gradient Coding

9 February 2018

Papers citing "Communication-Computation Efficient Gradient Coding"

29 / 29 papers shown

Title
Sequential Gradient Coding For Straggler Mitigation M. Krishnan Mohammadreza Ebrahimi Ashish Khisti 21 0 0 24 Nov 2022
Efficient Convex Optimization Requires Superlinear Memory A. Marsden Vatsal Sharan Aaron Sidford Gregory Valiant 29 14 0 29 Mar 2022
Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent Pedro Soto Ilia Ilmer Haibin Guan Jun Li 38 3 0 31 Jan 2022
Orthonormal Sketches for Secure Coded Regression Neophytos Charalambides Hessam Mahdavifar Mert Pilanci Alfred Hero 28 8 0 21 Jan 2022
Adaptive Worker Grouping For Communication-Efficient and Straggler-Tolerant Distributed SGD Feng Zhu Jingjing Zhang Osvaldo Simeone Xin Eric Wang 26 0 0 12 Jan 2022
DSAG: A mixed synchronous-asynchronous iterative method for straggler-resilient learning A. Severinson E. Rosnes S. E. Rouayheb Alexandre Graell i Amat 22 2 0 27 Nov 2021
Solon: Communication-efficient Byzantine-resilient Distributed Training via Redundant Gradients Lingjiao Chen Leshang Chen Hongyi Wang S. Davidson Yan Sun FedML 37 1 0 04 Oct 2021
Optimization-based Block Coordinate Gradient Coding Qi Wang Ying Cui Chenglin Li Junni Zou H. Xiong 19 2 0 18 Sep 2021
A New Design Framework for Heterogeneous Uncoded Storage Elastic Computing Mingyue Ji Xiang Zhang Kai Wan 24 5 0 20 Jul 2021
A Practical Algorithm Design and Evaluation for Heterogeneous Elastic Computing with Stragglers Nicholas Woolsey Joerg Kliewer Rong-Rong Chen Mingyue Ji 19 7 0 18 Jul 2021
Coded Gradient Aggregation: A Tradeoff Between Communication Costs at Edge Nodes and at Helper Nodes B. Sasidharan Anoop Thomas 28 9 0 06 May 2021
Gradient Coding with Dynamic Clustering for Straggler-Tolerant Distributed Learning Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 35 15 0 01 Mar 2021
On Gradient Coding with Partial Recovery Sahasrajit Sarmasarkar V. Lalitha Nikhil Karamchandani 26 8 0 19 Feb 2021
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed Hanlin Tang Shaoduo Gan A. A. Awan Samyam Rajbhandari Conglong Li Xiangru Lian Ji Liu Ce Zhang Yuxiong He AI4CE 45 84 0 04 Feb 2021
Coded Computing for Low-Latency Federated Learning over Wireless Edge Networks Saurav Prakash S. Dhakal M. Akdeniz Yair Yona S. Talwar Salman Avestimehr N. Himayat FedML 35 92 0 12 Nov 2020
Gradient Coding with Dynamic Clustering for Straggler Mitigation Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 29 7 0 03 Nov 2020
Diversity/Parallelism Trade-off in Distributed Systems with Redundancy Pei Peng E. Soljanin P. Whiting 22 14 0 05 Oct 2020
Berrut Approximated Coded Computing: Straggler Resistance Beyond Polynomial Computing Tayyebeh Jahani-Nezhad M. Maddah-ali 29 29 0 17 Sep 2020
Coded Distributed Computing with Partial Recovery Emre Ozfatura S. Ulukus Deniz Gunduz 38 28 0 04 Jul 2020
Communication-Efficient Gradient Coding for Straggler Mitigation in Distributed Learning S. Kadhe O. O. Koyluoglu Kannan Ramchandran 32 11 0 14 May 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 29 327 0 22 Feb 2020
LAGC: Lazily Aggregated Gradient Coding for Straggler-Tolerant and Communication-Efficient Distributed Learning Jingjing Zhang Osvaldo Simeone 18 31 0 22 May 2019
Gradient Coding with Clustering and Multi-message Communication Emre Ozfatura Deniz Gunduz S. Ulukus 26 38 0 05 Mar 2019
On Maintaining Linear Convergence of Distributed Learning and Optimization under Limited Communication Sindri Magnússon H. S. Ghadikolaei Na Li 27 81 0 26 Feb 2019
Lagrange Coded Computing: Optimal Design for Resiliency, Security and Privacy Qian-long Yu Songze Li Netanel Raviv Seyed Mohammadreza Mousavi Kalan Jinhyun So A. Avestimehr 47 382 0 04 Jun 2018
Scaling Neural Machine Translation Myle Ott Sergey Edunov David Grangier Michael Auli AIMat 71 610 0 01 Jun 2018
Polynomially Coded Regression: Optimal Straggler Mitigation via Data Encoding Songze Li Seyed Mohammadreza Mousavi Kalan Qian-long Yu Mahdi Soltanolkotabi A. Avestimehr 26 48 0 24 May 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 31 194 0 03 Mar 2018
Coded Computing for Distributed Graph Analytics Saurav Prakash Amirhossein Reisizadeh Ramtin Pedarsani A. Avestimehr 18 50 0 17 Jan 2018