v1v2v3 (latest)

Speeding Up Distributed Machine Learning Using Codes

8 December 2015

Kangwook Lee

Maximilian Lam

Ramtin Pedarsani

Dimitris Papailiopoulos

Kannan Ramchandran

ArXiv (abs)PDF HTML

Papers citing "Speeding Up Distributed Machine Learning Using Codes"

50 / 268 papers shown

Title
Asynchronous Distributed Optimization with Redundancy in Cost Functions Shuo Liu Nirupam Gupta Nitin H. Vaidya 76 3 0 07 Jun 2021
Soft BIBD and Product Gradient Codes Animesh Sakorikar Lele Wang 66 5 0 11 May 2021
CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework Yu Zhang Moming Duan Duo Liu Li Li Ao Ren Xianzhang Chen Yujuan Tan Chengliang Wang FedML 60 38 0 16 Apr 2021
Multi-Agent Reinforcement Learning Based Coded Computation for Mobile Ad Hoc Computing Baoqian Wang Junfei Xie K. Lu Yan Wan Shengli Fu 26 5 0 15 Apr 2021
Creating Robust Deep Neural Networks With Coded Distributed Computing for IoT Systems Ramyad Hadidi Jiashen Cao Hyesoon Kim 33 0 0 09 Apr 2021
ECRM: Efficient Fault Tolerance for Recommendation Model Training via Erasure Coding Kaige Liu J. Kosaian K. V. Rashmi 66 4 0 05 Apr 2021
Joint Coding and Scheduling Optimization for Distributed Learning over Wireless Edge Networks Nguyen Van Huynh D. Hoang Diep N. Nguyen E. Dutkiewicz 33 21 0 07 Mar 2021
Adaptive Coding for Matrix Multiplication at Edge Networks Elahe Vedadi H. Seferoglu 115 6 0 07 Mar 2021
Straggler Mitigation through Unequal Error Protection for Distributed Approximate Matrix Multiplication Busra Tegin Eduin E. Hernandez Stefano Rini T. Duman 21 1 0 04 Mar 2021
Coded Computing via Binary Linear Codes: Designs and Performance Limits M. Soleymani Mohammad Vahid Jamali Hessam Mahdavifar 107 9 0 02 Mar 2021
Gradient Coding with Dynamic Clustering for Straggler-Tolerant Distributed Learning Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 72 16 0 01 Mar 2021
On Gradient Coding with Partial Recovery Sahasrajit Sarmasarkar V. Lalitha Nikhil Karamchandani 85 8 0 19 Feb 2021
Speeding Up Private Distributed Matrix Multiplication via Bivariate Polynomial Codes Burak Hasircioglu J. Gómez-Vilardebó Deniz Gunduz 119 11 0 16 Feb 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 114 160 0 14 Feb 2021
The Discrepancy Attack on Polyshard-ed Blockchains Nastaran Abadi Khooshemehr M. Maddah-ali 163 7 0 04 Feb 2021
Provably Secure Federated Learning against Malicious Clients Xiaoyu Cao Jinyuan Jia Neil Zhenqiang Gong FedML 101 138 0 03 Feb 2021
Optimal Coding Scheme and Resource Allocation for Distributed Computation with Limited Resources S. Cao Lihui Yi Haoning Chen Youlong Wu 128 0 0 02 Feb 2021
List-Decodable Coded Computing: Breaking the Adversarial Toleration Barrier M. Soleymani Ramy E. Ali Hessam Mahdavifar A. Avestimehr 74 24 0 27 Jan 2021
Coding for Distributed Multi-Agent Reinforcement Learning Baoqian Wang Junfei Xie Nikolay Atanasov 78 4 0 07 Jan 2021
Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneity Amirhossein Reisizadeh Isidoros Tziotis Hamed Hassani Aryan Mokhtari Ramtin Pedarsani FedML 236 102 0 28 Dec 2020
Synergy via Redundancy: Adaptive Replication Strategies and Fundamental Limits Gauri Joshi Dhruva Kaushal 117 3 0 25 Dec 2020
Anytime Minibatch with Delayed Gradients H. Al-Lawati S. Draper 66 0 0 15 Dec 2020
Coded sparse matrix computation schemes that leverage partial stragglers A. Das A. Ramamoorthy 126 42 0 11 Dec 2020
Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications Shuyan Hu Xiaojing Chen Wei Ni Ekram Hossain Xin Wang AI4CE 110 115 0 02 Dec 2020
Coded Computing for Low-Latency Federated Learning over Wireless Edge Networks Saurav Prakash S. Dhakal M. Akdeniz Yair Yona S. Talwar Salman Avestimehr N. Himayat FedML 134 93 0 12 Nov 2020
Straggler Mitigation through Unequal Error Protection for Distributed Matrix Multiplication Busra Tegin Eduin E. Hernandez Stefano Rini T. Duman 25 3 0 05 Nov 2020
Gradient Coding with Dynamic Clustering for Straggler Mitigation Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 59 7 0 03 Nov 2020
Load balancing policies without feedback using timed replicas Rooji Jinan Ajay Badita Tejas Bodas Parimal Parag 35 1 0 26 Oct 2020
Diversity/Parallelism Trade-off in Distributed Systems with Redundancy Pei Peng E. Soljanin P. Whiting 79 14 0 05 Oct 2020
Coded Stochastic ADMM for Decentralized Consensus Optimization with Edge Computing Hao Chen Yu Ye Ming Xiao Mikael Skoglund H. Vincent Poor 55 15 0 02 Oct 2020
Communicate to Learn at the Edge Deniz Gunduz David Burth Kurka Mikolaj Jankowski M. Amiri Emre Ozfatura Sreejith Sreekumar 73 64 0 28 Sep 2020
Asynchronous Distributed Optimization with Stochastic Delays Margalit Glasgow Mary Wootters 93 3 0 22 Sep 2020
Berrut Approximated Coded Computing: Straggler Resistance Beyond Polynomial Computing Tayyebeh Jahani-Nezhad M. Maddah-ali 87 30 0 17 Sep 2020
Wireless for Machine Learning Henrik Hellström J. M. B. D. Silva Mohammad Mohammadi Amiri Mingzhe Chen Viktoria Fodor H. Vincent Poor Carlo Fischione 85 18 0 31 Aug 2020
GraphFederator: Federated Visual Analysis for Multi-party Graphs Dongming Han Wei Chen Rusheng Pan Yijing Liu Jiehui Zhou ... Tianye Zhang Changjie Fan Jianrong Tao Xiaolong Luke Zhang Hao Feng FedML 54 1 0 27 Aug 2020
A Survey of Coded Distributed Computing Jer Shyuan Ng Wei Yang Bryan Lim Nguyen Cong Luong Zehui Xiong Alia Asheralieva Dusit Niyato Cyril Leung Chunyan Miao 58 25 0 20 Aug 2020
Analog Lagrange Coded Computing M. Soleymani Hessam Mahdavifar A. Avestimehr 110 50 0 19 Aug 2020
Coded Elastic Computing on Machines with Heterogeneous Storage and Computation Speed Nicholas Woolsey Rong-Rong Chen Mingyue Ji 62 14 0 12 Aug 2020
A New Combinatorial Coded Design for Heterogeneous Distributed Computing Nicholas Woolsey Rong-Rong Chen Mingyue Ji 130 19 0 21 Jul 2020
Privacy-Preserving Distributed Learning in the Analog Domain M. Soleymani Hessam Mahdavifar A. Avestimehr 75 18 0 17 Jul 2020
Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning Wenqi Shi Sheng Zhou Z. Niu Miao Jiang Lu Geng 72 297 0 14 Jul 2020
Secure Distributed Matrix Computation with Discrete Fourier Transform N. Mital Cong Ling Deniz Gunduz 71 37 0 08 Jul 2020
Coded Computing for Federated Learning at the Edge Saurav Prakash S. Dhakal M. Akdeniz A. Avestimehr N. Himayat FedML 69 11 0 07 Jul 2020
Coded Distributed Computing with Partial Recovery Emre Ozfatura S. Ulukus Deniz Gunduz 71 29 0 04 Jul 2020
FLeet: Online Federated Learning via Staleness Awareness and Performance Prediction Georgios Damaskinos R. Guerraoui Anne-Marie Kermarrec Vlad Nitu Rhicheek Patra Francois Taiani 99 55 0 12 Jun 2020
Anytime MiniBatch: Exploiting Stragglers in Online Distributed Optimization Nuwan S. Ferdinand H. Al-Lawati S. Draper M. Nokleby 70 43 0 10 Jun 2020
Age-Based Coded Computation for Bias Reduction in Distributed Learning Emre Ozfatura Baturalp Buyukates Deniz Gunduz S. Ulukus FedML 143 25 0 02 Jun 2020
Communication-Efficient Gradient Coding for Straggler Mitigation in Distributed Learning S. Kadhe O. O. Koyluoglu Kannan Ramchandran 58 11 0 14 May 2020
Dynamic backup workers for parallel machine learning Chuan Xu Giovanni Neglia Nicola Sebastianelli 72 11 0 30 Apr 2020
Rateless Codes for Private Distributed Matrix-Matrix Multiplication Rawad Bitar M. Xhemrishi Antonia Wachter-Zeh 58 6 0 27 Apr 2020