Speeding Up Distributed Machine Learning Using Codes

8 December 2015

Kangwook Lee

Maximilian Lam

Ramtin Pedarsani

Dimitris Papailiopoulos

Kannan Ramchandran

ArXiv PDF HTML

Papers citing "Speeding Up Distributed Machine Learning Using Codes"

50 / 266 papers shown

Title
Adaptive Distributed Stochastic Gradient Descent for Minimizing Delay in the Presence of Stragglers Serge Kas Hanna Rawad Bitar Parimal Parag Venkateswara Dasari S. E. Rouayheb 22 16 0 25 Feb 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 29 327 0 22 Feb 2020
Coded Federated Learning S. Dhakal Saurav Prakash Yair Yona S. Talwar N. Himayat FedML 18 68 0 21 Feb 2020
Reliable Distributed Clustering with Redundant Data Assignment V. Gandikota A. Mazumdar A. S. Rawat 11 2 0 20 Feb 2020
GCSA Codes with Noise Alignment for Secure Coded Multi-Party Batch Matrix Multiplication Zhen Chen Zhuqing Jia Zhiying Wang S. Jafar 12 43 0 18 Feb 2020
Distributed Averaging Methods for Randomized Second Order Optimization Burak Bartan Mert Pilanci 9 6 0 16 Feb 2020
A locality-based approach for coded computation Michael Rudow K. V. Rashmi V. Guruswami 7 7 0 06 Feb 2020
Capacity-achieving Polar-based LDGM Codes with Crowdsourcing Applications James Chin-Jen Pang Hessam Mahdavifar S. Pradhan 14 0 0 31 Jan 2020
Coded Computing for Secure Boolean Computations Chien-Sheng Yang A. Avestimehr 11 3 0 23 Jan 2020
Serverless Straggler Mitigation using Local Error-Correcting Codes Vipul Gupta Dominic Carrano Yaoqing Yang Vaishaal Shankar T. Courtade Kannan Ramchandran 6 9 0 21 Jan 2020
Bivariate Polynomial Coding for Efficient Distributed Matrix Multiplication Burak Hasircioglu J. Gómez-Vilardebó Deniz Gunduz 13 16 0 20 Jan 2020
Entangled Polynomial Codes for Secure, Private, and Batch Distributed Matrix Multiplication: Breaking the "Cubic" Barrier Qian-long Yu A. Avestimehr 8 75 0 15 Jan 2020
Heterogeneous Computation Assignments in Coded Elastic Computing Nicholas Woolsey Rong-Rong Chen Mingyue Ji 9 8 0 12 Jan 2020
On Batch-Processing Based Coded Computing for Heterogeneous Distributed Computing Systems Baoqian Wang Junfei Xie K. Lu Yan Wan Shengli Fu 7 30 0 29 Dec 2019
Edge Computing in the Dark: Leveraging Contextual-Combinatorial Bandit and Coded Computing Chien-Sheng Yang Ramtin Pedarsani A. Avestimehr 11 14 0 19 Dec 2019
Hierarchical Coded Matrix Multiplication Shahrzad Kiani Nuwan S. Ferdinand S. Draper 14 36 0 14 Dec 2019
Optimal Server Selection for Straggler Mitigation Ajay Badita Parimal Parag Vaneet Aggarwal 9 17 0 14 Nov 2019
Device Scheduling with Fast Convergence for Wireless Federated Learning Misha Sra C. Schmandt Z. Niu FedML 27 190 0 03 Nov 2019
Train Where the Data is: A Case for Bandwidth Efficient Coded Training Zhifeng Lin Krishnagiri Narra Mingchao Yu A. Avestimehr M. Annavaram 6 3 0 22 Oct 2019
Election Coding for Distributed Learning: Protecting SignSGD against Byzantine Attacks Jy-yong Sohn Dong-Jun Han Beongjun Choi Jaekyun Moon FedML 19 36 0 14 Oct 2019
Boomerang: Redundancy Improves Latency and Throughput in Payment-Channel Networks Vivek Bagaria Joachim Neu David Tse MoE 17 16 0 04 Oct 2019
FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization Amirhossein Reisizadeh Aryan Mokhtari Hamed Hassani Ali Jadbabaie Ramtin Pedarsani FedML 174 764 0 28 Sep 2019
Federated Learning: Challenges, Methods, and Future Directions Tian Li Anit Kumar Sahu Ameet Talwalkar Virginia Smith FedML 72 4,421 0 21 Aug 2019
Secure Coded Cooperative Computation at the Heterogeneous Edge against Byzantine Attacks Yasaman Keshtkarjahromi Rawad Bitar Venkateswara Dasari S. E. Rouayheb H. Seferoglu 6 11 0 15 Aug 2019
Redundancy Scheduling in Systems with Bi-Modal Job Service Time Distribution Amir Behrouzi-Far E. Soljanin 18 8 0 07 Aug 2019
Motivating Workers in Federated Learning: A Stackelberg Game Perspective Y. Sarikaya Ozgur Ercetin FedML 17 178 0 06 Aug 2019
Robust and Communication-Efficient Collaborative Learning Amirhossein Reisizadeh Hossein Taheri Aryan Mokhtari Hamed Hassani Ramtin Pedarsani 33 89 0 24 Jul 2019
ASYNC: A Cloud Engine with Asynchrony and History for Distributed Machine Learning Saeed Soori Bugra Can Mert Gurbuzbalaban M. Dehnavi GNN OffRL 13 4 0 19 Jul 2019
Distributed Black-Box Optimization via Error Correcting Codes Burak Bartan Mert Pilanci 14 2 0 13 Jul 2019
Data Encoding for Byzantine-Resilient Distributed Optimization Deepesh Data Linqi Song Suhas Diggavi FedML 13 33 0 05 Jul 2019
Coded State Machine -- Scaling State Machine Execution under Byzantine Faults Songze Li Saeid Sahraei Mingchao Yu A. Avestimehr Sreeram Kannan Pramod Viswanath 14 6 0 26 Jun 2019
Straggler Mitigation at Scale M. Aktaş E. Soljanin 6 36 0 25 Jun 2019
Coded Distributed Computing: Performance Limits and Code Designs Mohammad Vahid Jamali M. Soleymani Hessam Mahdavifar 16 16 0 24 Jun 2019
Optimizing Redundancy Levels in Master-Worker Compute Clusters for Straggler Mitigation M. Aktaş E. Soljanin 10 3 0 12 Jun 2019
Collage Inference: Achieving low tail latency during distributed image classification using coded redundancy models Krishnagiri Narra Zhifeng Lin Ganesh Ananthanarayanan A. Avestimehr M. Annavaram VLM 11 0 0 05 Jun 2019
Collaborative Decoding of Polynomial Codes for Distributed Computation Adarsh M. Subramaniam A. Heidarzadeh Krishna R. Narayanan 11 14 0 31 May 2019
LAGC: Lazily Aggregated Gradient Coding for Straggler-Tolerant and Communication-Efficient Distributed Learning Jingjing Zhang Osvaldo Simeone 18 31 0 22 May 2019
Coded Distributed Tracking A. Severinson E. Rosnes Alexandre Graell i Amat 12 1 0 14 May 2019
Parity Models: A General Framework for Coding-Based Resilience in ML Inference J. Kosaian K. V. Rashmi Shivaram Venkataraman 6 14 0 02 May 2019
Gradient Coding Based on Block Designs for Mitigating Adversarial Stragglers S. Kadhe O. O. Koyluoglu Kannan Ramchandran 11 28 0 30 Apr 2019
Harmonic Coding: An Optimal Linear Code for Privacy-Preserving Gradient-Type Computation Qian-long Yu A. Avestimehr 14 14 0 30 Apr 2019
Collage Inference: Using Coded Redundancy for Low Variance Distributed Image Classification Krishnagiri Narra Zhifeng Lin Ganesh Ananthanarayanan A. Avestimehr M. Annavaram VLM 28 6 0 27 Apr 2019
Array BP-XOR Codes for Hierarchically Distributed Matrix Multiplication Suayb S. Arslan 99 1 0 25 Apr 2019
Optimal Load Allocation for Coded Distributed Computation in Heterogeneous Clusters Daejin Kim Hyegyeong Park J. Choi 10 31 0 20 Apr 2019
Slack Squeeze Coded Computing for Adaptive Straggler Mitigation Krishnagiri Narra Zhifeng Lin Mehrdad Kiamari A. Avestimehr M. Annavaram 60 5 0 15 Apr 2019
Timely-Throughput Optimal Coded Computing over Cloud Networks Chien-Sheng Yang Ramtin Pedarsani A. Avestimehr 16 34 0 11 Apr 2019
OverSketched Newton: Fast Convex Optimization for Serverless Systems Vipul Gupta S. Kadhe T. Courtade Michael W. Mahoney Kannan Ramchandran 19 33 0 21 Mar 2019
Gradient Coding with Clustering and Multi-message Communication Emre Ozfatura Deniz Gunduz S. Ulukus 26 38 0 05 Mar 2019
CodeNet: Training Large Scale Neural Networks in Presence of Soft-Errors Sanghamitra Dutta Ziqian Bai Tze Meng Low P. Grover 16 16 0 04 Mar 2019
CodedReduce: A Fast and Robust Framework for Gradient Aggregation in Distributed Learning Amirhossein Reisizadeh Saurav Prakash Ramtin Pedarsani A. Avestimehr 28 23 0 06 Feb 2019