Speeding Up Distributed Machine Learning Using Codes

8 December 2015

Kangwook Lee

Maximilian Lam

Ramtin Pedarsani

Dimitris Papailiopoulos

Kannan Ramchandran

ArXiv PDF HTML

Papers citing "Speeding Up Distributed Machine Learning Using Codes"

50 / 266 papers shown

Title
CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework Yu Zhang Moming Duan Duo Liu Li Li Ao Ren Xianzhang Chen Yujuan Tan Chengliang Wang FedML 13 36 0 16 Apr 2021
Multi-Agent Reinforcement Learning Based Coded Computation for Mobile Ad Hoc Computing Baoqian Wang Junfei Xie K. Lu Yan Wan Shengli Fu 9 5 0 15 Apr 2021
Creating Robust Deep Neural Networks With Coded Distributed Computing for IoT Systems Ramyad Hadidi Jiashen Cao Hyesoon Kim 18 0 0 09 Apr 2021
ECRM: Efficient Fault Tolerance for Recommendation Model Training via Erasure Coding Kaige Liu J. Kosaian K. V. Rashmi 32 4 0 05 Apr 2021
Joint Coding and Scheduling Optimization for Distributed Learning over Wireless Edge Networks Nguyen Van Huynh D. Hoang Diep N. Nguyen E. Dutkiewicz 12 21 0 07 Mar 2021
Adaptive Coding for Matrix Multiplication at Edge Networks Elahe Vedadi H. Seferoglu 6 5 0 07 Mar 2021
Straggler Mitigation through Unequal Error Protection for Distributed Approximate Matrix Multiplication Busra Tegin Eduin E. Hernandez Stefano Rini T. Duman 9 1 0 04 Mar 2021
Coded Computing via Binary Linear Codes: Designs and Performance Limits M. Soleymani Mohammad Vahid Jamali Hessam Mahdavifar 29 9 0 02 Mar 2021
Gradient Coding with Dynamic Clustering for Straggler-Tolerant Distributed Learning Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 35 15 0 01 Mar 2021
On Gradient Coding with Partial Recovery Sahasrajit Sarmasarkar V. Lalitha Nikhil Karamchandani 26 8 0 19 Feb 2021
Speeding Up Private Distributed Matrix Multiplication via Bivariate Polynomial Codes Burak Hasircioglu J. Gómez-Vilardebó Deniz Gunduz 9 11 0 16 Feb 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 55 157 0 14 Feb 2021
The Discrepancy Attack on Polyshard-ed Blockchains Nastaran Abadi Khooshemehr M. Maddah-ali 11 7 0 04 Feb 2021
Provably Secure Federated Learning against Malicious Clients Xiaoyu Cao Jinyuan Jia Neil Zhenqiang Gong FedML 21 134 0 03 Feb 2021
Optimal Coding Scheme and Resource Allocation for Distributed Computation with Limited Resources S. Cao Lihui Yi Haoning Chen Youlong Wu 23 0 0 02 Feb 2021
List-Decodable Coded Computing: Breaking the Adversarial Toleration Barrier M. Soleymani Ramy E. Ali Hessam Mahdavifar A. Avestimehr 29 22 0 27 Jan 2021
Coding for Distributed Multi-Agent Reinforcement Learning Baoqian Wang Junfei Xie Nikolay Atanasov 28 4 0 07 Jan 2021
Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneity Amirhossein Reisizadeh Isidoros Tziotis Hamed Hassani Aryan Mokhtari Ramtin Pedarsani FedML 172 99 0 28 Dec 2020
Synergy via Redundancy: Adaptive Replication Strategies and Fundamental Limits Gauri Joshi Dhruva Kaushal 14 3 0 25 Dec 2020
Anytime Minibatch with Delayed Gradients H. Al-Lawati S. Draper 25 0 0 15 Dec 2020
Coded sparse matrix computation schemes that leverage partial stragglers A. Das A. Ramamoorthy 41 41 0 11 Dec 2020
Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications Shuyan Hu Xiaojing Chen Wei Ni Ekram Hossain Xin Wang AI4CE 50 111 0 02 Dec 2020
Coded Computing for Low-Latency Federated Learning over Wireless Edge Networks Saurav Prakash S. Dhakal M. Akdeniz Yair Yona S. Talwar Salman Avestimehr N. Himayat FedML 35 92 0 12 Nov 2020
Straggler Mitigation through Unequal Error Protection for Distributed Matrix Multiplication Busra Tegin Eduin E. Hernandez Stefano Rini T. Duman 11 3 0 05 Nov 2020
Gradient Coding with Dynamic Clustering for Straggler Mitigation Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 26 7 0 03 Nov 2020
Load balancing policies without feedback using timed replicas Rooji Jinan Ajay Badita Tejas Bodas Parimal Parag 11 1 0 26 Oct 2020
Diversity/Parallelism Trade-off in Distributed Systems with Redundancy Pei Peng E. Soljanin P. Whiting 22 13 0 05 Oct 2020
Coded Stochastic ADMM for Decentralized Consensus Optimization with Edge Computing Hao Chen Yu Ye Ming Xiao Mikael Skoglund H. Vincent Poor 16 14 0 02 Oct 2020
Communicate to Learn at the Edge Deniz Gunduz David Burth Kurka Mikolaj Jankowski M. Amiri Emre Ozfatura Sreejith Sreekumar 15 64 0 28 Sep 2020
Asynchronous Distributed Optimization with Stochastic Delays Margalit Glasgow Mary Wootters 17 3 0 22 Sep 2020
Berrut Approximated Coded Computing: Straggler Resistance Beyond Polynomial Computing Tayyebeh Jahani-Nezhad M. Maddah-ali 27 29 0 17 Sep 2020
Wireless for Machine Learning Henrik Hellström J. M. B. D. Silva Mohammad Mohammadi Amiri Mingzhe Chen Viktoria Fodor H. Vincent Poor Carlo Fischione 16 18 0 31 Aug 2020
GraphFederator: Federated Visual Analysis for Multi-party Graphs Dongming Han Wei Chen Rusheng Pan Yijing Liu Jiehui Zhou ... Tianye Zhang Changjie Fan Jianrong Tao Xiaolong Luke Zhang H. Feng FedML 16 1 0 27 Aug 2020
A Survey of Coded Distributed Computing Jer Shyuan Ng Wei Yang Bryan Lim Nguyen Cong Luong Zehui Xiong Alia Asheralieva Dusit Niyato Cyril Leung Chunyan Miao 4 24 0 20 Aug 2020
Analog Lagrange Coded Computing M. Soleymani Hessam Mahdavifar A. Avestimehr 27 48 0 19 Aug 2020
Coded Elastic Computing on Machines with Heterogeneous Storage and Computation Speed Nicholas Woolsey Rong-Rong Chen Mingyue Ji 6 13 0 12 Aug 2020
A New Combinatorial Coded Design for Heterogeneous Distributed Computing Nicholas Woolsey Rong-Rong Chen Mingyue Ji 20 18 0 21 Jul 2020
Privacy-Preserving Distributed Learning in the Analog Domain M. Soleymani Hessam Mahdavifar A. Avestimehr 24 17 0 17 Jul 2020
Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning Wenqi Shi Sheng Zhou Z. Niu Miao Jiang Lu Geng 28 292 0 14 Jul 2020
Secure Distributed Matrix Computation with Discrete Fourier Transform N. Mital Cong Ling Deniz Gunduz 16 37 0 08 Jul 2020
Coded Computing for Federated Learning at the Edge Saurav Prakash S. Dhakal M. Akdeniz A. Avestimehr N. Himayat FedML 18 11 0 07 Jul 2020
Coded Distributed Computing with Partial Recovery Emre Ozfatura S. Ulukus Deniz Gunduz 38 28 0 04 Jul 2020
FLeet: Online Federated Learning via Staleness Awareness and Performance Prediction Georgios Damaskinos R. Guerraoui Anne-Marie Kermarrec Vlad Nitu Rhicheek Patra Francois Taiani 15 54 0 12 Jun 2020
Anytime MiniBatch: Exploiting Stragglers in Online Distributed Optimization Nuwan S. Ferdinand H. Al-Lawati S. Draper M. Nokleby 19 42 0 10 Jun 2020
Age-Based Coded Computation for Bias Reduction in Distributed Learning Emre Ozfatura Baturalp Buyukates Deniz Gunduz S. Ulukus FedML 22 25 0 02 Jun 2020
Communication-Efficient Gradient Coding for Straggler Mitigation in Distributed Learning S. Kadhe O. O. Koyluoglu Kannan Ramchandran 32 11 0 14 May 2020
Dynamic backup workers for parallel machine learning Chuan Xu Giovanni Neglia Nicola Sebastianelli 15 11 0 30 Apr 2020
Rateless Codes for Private Distributed Matrix-Matrix Multiplication Rawad Bitar M. Xhemrishi Antonia Wachter-Zeh 17 6 0 27 Apr 2020
Coded Secure Multi-Party Computation for Massive Matrices with Adversarial Nodes Seyed Reza Hoseini Najarkolaei M. Maddah-ali M. R. Aref 9 8 0 10 Apr 2020
Straggler-aware Distributed Learning: Communication Computation Latency Trade-off Emre Ozfatura S. Ulukus Deniz Gunduz 20 42 0 10 Apr 2020