v1v2v3 (latest)

Speeding Up Distributed Machine Learning Using Codes

8 December 2015

Kangwook Lee

Maximilian Lam

Ramtin Pedarsani

Dimitris Papailiopoulos

Kannan Ramchandran

ArXiv (abs)PDF HTML

Papers citing "Speeding Up Distributed Machine Learning Using Codes"

50 / 268 papers shown

Title
Coded Secure Multi-Party Computation for Massive Matrices with Adversarial Nodes Seyed Reza Hoseini Najarkolaei M. Maddah-ali M. R. Aref 64 10 0 10 Apr 2020
Straggler-aware Distributed Learning: Communication Computation Latency Trade-off Emre Ozfatura S. Ulukus Deniz Gunduz 56 42 0 10 Apr 2020
Adaptive Distributed Stochastic Gradient Descent for Minimizing Delay in the Presence of Stragglers Serge Kas Hanna Rawad Bitar Parimal Parag Venkateswara Dasari S. E. Rouayheb 69 16 0 25 Feb 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 101 335 0 22 Feb 2020
Coded Federated Learning S. Dhakal Saurav Prakash Yair Yona S. Talwar N. Himayat FedML 87 68 0 21 Feb 2020
Reliable Distributed Clustering with Redundant Data Assignment V. Gandikota A. Mazumdar A. S. Rawat 30 2 0 20 Feb 2020
GCSA Codes with Noise Alignment for Secure Coded Multi-Party Batch Matrix Multiplication Zhen Chen Zhuqing Jia Zhiying Wang S. Jafar 119 45 0 18 Feb 2020
Distributed Averaging Methods for Randomized Second Order Optimization Burak Bartan Mert Pilanci 24 6 0 16 Feb 2020
A locality-based approach for coded computation Michael Rudow K. V. Rashmi V. Guruswami 67 7 0 06 Feb 2020
Capacity-achieving Polar-based LDGM Codes with Crowdsourcing Applications James Chin-Jen Pang Hessam Mahdavifar S. Pradhan 35 0 0 31 Jan 2020
Coded Computing for Secure Boolean Computations Chien-Sheng Yang A. Avestimehr 54 3 0 23 Jan 2020
Serverless Straggler Mitigation using Local Error-Correcting Codes Vipul Gupta Dominic Carrano Yaoqing Yang Vaishaal Shankar T. Courtade Kannan Ramchandran 56 9 0 21 Jan 2020
Bivariate Polynomial Coding for Efficient Distributed Matrix Multiplication Burak Hasircioglu J. Gómez-Vilardebó Deniz Gunduz 56 16 0 20 Jan 2020
Entangled Polynomial Codes for Secure, Private, and Batch Distributed Matrix Multiplication: Breaking the "Cubic" Barrier Qian-long Yu A. Avestimehr 83 78 0 15 Jan 2020
Heterogeneous Computation Assignments in Coded Elastic Computing Nicholas Woolsey Rong-Rong Chen Mingyue Ji 37 8 0 12 Jan 2020
On Batch-Processing Based Coded Computing for Heterogeneous Distributed Computing Systems Baoqian Wang Junfei Xie K. Lu Yan Wan Shengli Fu 58 30 0 29 Dec 2019
Edge Computing in the Dark: Leveraging Contextual-Combinatorial Bandit and Coded Computing Chien-Sheng Yang Ramtin Pedarsani A. Avestimehr 52 14 0 19 Dec 2019
Hierarchical Coded Matrix Multiplication Shahrzad Kiani Nuwan S. Ferdinand S. Draper 104 36 0 14 Dec 2019
Optimal Server Selection for Straggler Mitigation Ajay Badita Parimal Parag Vaneet Aggarwal 42 17 0 14 Nov 2019
Device Scheduling with Fast Convergence for Wireless Federated Learning Misha Sra C. Schmandt Z. Niu FedML 87 199 0 03 Nov 2019
Train Where the Data is: A Case for Bandwidth Efficient Coded Training Zhifeng Lin Krishnagiri Narra Mingchao Yu A. Avestimehr M. Annavaram 23 3 0 22 Oct 2019
Election Coding for Distributed Learning: Protecting SignSGD against Byzantine Attacks Jy-yong Sohn Dong-Jun Han Beongjun Choi Jaekyun Moon FedML 98 37 0 14 Oct 2019
Boomerang: Redundancy Improves Latency and Throughput in Payment-Channel Networks Vivek Bagaria Joachim Neu David Tse MoE 42 16 0 04 Oct 2019
FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization Amirhossein Reisizadeh Aryan Mokhtari Hamed Hassani Ali Jadbabaie Ramtin Pedarsani FedML 281 777 0 28 Sep 2019
Federated Learning: Challenges, Methods, and Future Directions Tian Li Anit Kumar Sahu Ameet Talwalkar Virginia Smith FedML 199 4,584 0 21 Aug 2019
Secure Coded Cooperative Computation at the Heterogeneous Edge against Byzantine Attacks Yasaman Keshtkarjahromi Rawad Bitar Venkateswara Dasari S. E. Rouayheb H. Seferoglu 59 11 0 15 Aug 2019
Redundancy Scheduling in Systems with Bi-Modal Job Service Time Distribution Amir Behrouzi-Far E. Soljanin 47 8 0 07 Aug 2019
Motivating Workers in Federated Learning: A Stackelberg Game Perspective Y. Sarikaya Ozgur Ercetin FedML 77 187 0 06 Aug 2019
Robust and Communication-Efficient Collaborative Learning Amirhossein Reisizadeh Hossein Taheri Aryan Mokhtari Hamed Hassani Ramtin Pedarsani 110 93 0 24 Jul 2019
ASYNC: A Cloud Engine with Asynchrony and History for Distributed Machine Learning Saeed Soori Bugra Can Mert Gurbuzbalaban M. Dehnavi GNN OffRL 46 4 0 19 Jul 2019
Distributed Black-Box Optimization via Error Correcting Codes Burak Bartan Mert Pilanci 136 2 0 13 Jul 2019
Data Encoding for Byzantine-Resilient Distributed Optimization Deepesh Data Linqi Song Suhas Diggavi FedML 70 34 0 05 Jul 2019
Coded State Machine -- Scaling State Machine Execution under Byzantine Faults Songze Li Saeid Sahraei Mingchao Yu A. Avestimehr Sreeram Kannan Pramod Viswanath 58 6 0 26 Jun 2019
Straggler Mitigation at Scale M. Aktaş E. Soljanin 53 39 0 25 Jun 2019
Coded Distributed Computing: Performance Limits and Code Designs Mohammad Vahid Jamali M. Soleymani Hessam Mahdavifar 118 16 0 24 Jun 2019
Optimizing Redundancy Levels in Master-Worker Compute Clusters for Straggler Mitigation M. Aktaş E. Soljanin 49 3 0 12 Jun 2019
Collage Inference: Achieving low tail latency during distributed image classification using coded redundancy models Krishnagiri Narra Zhifeng Lin Ganesh Ananthanarayanan A. Avestimehr M. Annavaram VLM 23 0 0 05 Jun 2019
Collaborative Decoding of Polynomial Codes for Distributed Computation Adarsh M. Subramaniam A. Heidarzadeh Krishna R. Narayanan 48 14 0 31 May 2019
LAGC: Lazily Aggregated Gradient Coding for Straggler-Tolerant and Communication-Efficient Distributed Learning Jingjing Zhang Osvaldo Simeone 72 32 0 22 May 2019
Coded Distributed Tracking A. Severinson E. Rosnes Alexandre Graell i Amat 21 1 0 14 May 2019
Parity Models: A General Framework for Coding-Based Resilience in ML Inference J. Kosaian K. V. Rashmi Shivaram Venkataraman 111 14 0 02 May 2019
Gradient Coding Based on Block Designs for Mitigating Adversarial Stragglers S. Kadhe O. O. Koyluoglu Kannan Ramchandran 61 28 0 30 Apr 2019
Harmonic Coding: An Optimal Linear Code for Privacy-Preserving Gradient-Type Computation Qian-long Yu A. Avestimehr 59 15 0 30 Apr 2019
Collage Inference: Using Coded Redundancy for Low Variance Distributed Image Classification Krishnagiri Narra Zhifeng Lin Ganesh Ananthanarayanan A. Avestimehr M. Annavaram VLM 122 6 0 27 Apr 2019
Array BP-XOR Codes for Hierarchically Distributed Matrix Multiplication Suayb S. Arslan 131 1 0 25 Apr 2019
Optimal Load Allocation for Coded Distributed Computation in Heterogeneous Clusters Daejin Kim Hyegyeong Park J. Choi 118 32 0 20 Apr 2019
Slack Squeeze Coded Computing for Adaptive Straggler Mitigation Krishnagiri Narra Zhifeng Lin Mehrdad Kiamari A. Avestimehr M. Annavaram 76 5 0 15 Apr 2019
Timely-Throughput Optimal Coded Computing over Cloud Networks Chien-Sheng Yang Ramtin Pedarsani A. Avestimehr 56 34 0 11 Apr 2019
OverSketched Newton: Fast Convex Optimization for Serverless Systems Vipul Gupta S. Kadhe T. Courtade Michael W. Mahoney Kannan Ramchandran 85 33 0 21 Mar 2019
Gradient Coding with Clustering and Multi-message Communication Emre Ozfatura Deniz Gunduz S. Ulukus 60 39 0 05 Mar 2019