Speeding Up Distributed Machine Learning Using Codes

8 December 2015

Kangwook Lee

Maximilian Lam

Ramtin Pedarsani

Dimitris Papailiopoulos

Kannan Ramchandran

ArXiv PDF HTML

Papers citing "Speeding Up Distributed Machine Learning Using Codes"

50 / 266 papers shown

Title
Efficient Federated Split Learning for Large Language Models over Communication Networks Kai Zhao Zhaohui Yang 40 0 0 20 Apr 2025
Flexible Coded Distributed Convolution Computing for Enhanced Fault Tolerance and Numerical Stability in Distributed CNNs Shuo Tan Rui Liu XianLei Long Kai Wan Linqi Song Yong Li 45 0 0 03 Nov 2024
Sparsity-Preserving Encodings for Straggler-Optimal Distributed Matrix Computations at the Edge A. Das Aditya Ramamoorthy David J. Love Christopher G. Brinton 34 0 0 09 Aug 2024
Algebraic Geometry Codes for Distributed Matrix Multiplication Using Local Expansions Jiang Li Songsong Li Chaoping Xing 29 1 0 03 Aug 2024
Parallel Split Learning with Global Sampling Mohammad Kohankhaki Ahmad Ayad Mahdi Barhoush A. Schmeink 38 1 0 22 Jul 2024
Design and Optimization of Hierarchical Gradient Coding for Distributed Learning at Edge Devices Weiheng Tang Jingyi Li Lin Chen Xu Chen 53 1 0 16 Jun 2024
Training Through Failure: Effects of Data Consistency in Parallel Machine Learning Training Ray Cao Sherry Luo Steve Gan Sujeeth Jinesh 23 0 0 08 Jun 2024
Approximated Coded Computing: Towards Fast, Private and Secure Distributed Machine Learning Houming Qiu Kun Zhu Nguyen Cong Luong Dusit Niyato FedML 25 0 0 07 Jun 2024
FedAST: Federated Asynchronous Simultaneous Training Baris Askin Pranay Sharma Carlee Joe-Wong Gauri Joshi 49 2 0 01 Jun 2024
Algebraic Geometric Rook Codes for Coded Distributed Computing Gretchen L. Matthews Pedro Soto AI4CE 37 1 0 16 May 2024
Linear Operator Approximate Message Passing (OpAMP) Riccardo Rossetti B. Nazer Galen Reeves 29 2 0 13 May 2024
Privacy-aware Berrut Approximated Coded Computing for Federated Learning Xavier Martínez Luana Rebeca P. Díaz Redondo M. Fernández-Veiga FedML 31 2 0 02 May 2024
Approximate Gradient Coding for Privacy-Flexible Federated Learning with Non-IID Data Okko Makkonen Sampo Niemelä Camilla Hollanti Serge Kas Hanna 35 0 0 04 Apr 2024
A Survey on Resource Management in Joint Communication and Computing-Embedded SAGIN Qian Chen Zheng Guo Weixiao Meng Shuai Han Cheng Li Tony Q. S. Quek 49 20 0 26 Mar 2024
Distributed Learning based on 1-Bit Gradient Coding in the Presence of Stragglers Chengxi Li Mikael Skoglund 54 3 0 19 Mar 2024
Wireless Distributed Matrix-Vector Multiplication using Over-the-Air Computation and Analog Coding Jinho Choi 26 0 0 17 Feb 2024
FLASH: Federated Learning Across Simultaneous Heterogeneities Xiangyu Chang Sk. Miraj Ahmed S. Krishnamurthy Başak Güler A. Swami Samet Oymak A. Roy-Chowdhury FedML 32 2 0 13 Feb 2024
Successive Refinement in Large-Scale Computation: Advancing Model Inference Applications H. Esfahanizadeh Alejandro Cohen S. Shamai Muriel Médard 34 1 0 11 Feb 2024
NeRCC: Nested-Regression Coded Computing for Resilient Distributed Prediction Serving Systems Parsa Moradi M. Maddah-ali 16 0 0 06 Feb 2024
Coded Computing for Fault-Tolerant Parallel QR Decomposition Quang Minh Nguyen Iain Xie Weissburg Haewon Jeong 15 2 0 20 Nov 2023
Accelerating Split Federated Learning over Wireless Communication Networks Ce Xu Jinxuan Li Yuan Liu Yushi Ling Miaowen Wen FedML 31 23 0 24 Oct 2023
A High-throughput and Secure Coded Blockchain for IoT Amirhossein Taherpour Xiaodong Wang 19 1 0 13 Oct 2023
DxPU: Large Scale Disaggregated GPU Pools in the Datacenter Bowen He Xiao Zheng Yuan Chen Weinan Li Yajin Zhou ... Xiaowei Lu Linquan Jiang Qiang Liu Dennis Cai Xiantao Zhang 21 6 0 07 Oct 2023
Workload Distribution with Rateless Encoding: A Low-Latency Computation Offloading Method within Edge Networks Zhongfu Guo Xinsheng Ji Wei You Yu Zhao Bai Yi Lingwei Wang OffRL 16 1 0 04 Oct 2023
Privacy-Preserving Polynomial Computing Over Distributed Data Zhiquan Tan Dingli Yuan Zhongyi Huang FedML 23 1 0 17 Sep 2023
Randomized Polar Codes for Anytime Distributed Machine Learning Burak Bartan Mert Pilanci 21 4 0 01 Sep 2023
Analog Multi-Party Computing: Locally Differential Private Protocols for Collaborative Computations Hsuan-Po Liu M. Soleymani Hessam Mahdavifar 26 1 0 24 Aug 2023
Sparsity and Privacy in Secret Sharing: A Fundamental Trade-Off Rawad Bitar Maximilian Egger Antonia Wachter-Zeh M. Xhemrishi 37 4 0 11 Aug 2023
Preserving Sparsity and Privacy in Straggler-Resilient Distributed Matrix Computations A. Das A. Ramamoorthy David J. Love Christopher G. Brinton 27 1 0 08 Aug 2023
Iterative Sketching for Secure Coded Regression Neophytos Charalambides Hessam Mahdavifar Mert Pilanci Alfred Hero 30 2 0 08 Aug 2023
Gradient Coding with Iterative Block Leverage Score Sampling Neophytos Charalambides Mert Pilanci Alfred Hero 24 2 0 06 Aug 2023
Population Expansion for Training Language Models with Private Federated Learning Tatsuki Koga Congzheng Song Martin Pelikan Mona Chitnis FedML 24 1 0 14 Jul 2023
Sparse and Private Distributed Matrix Multiplication with Straggler Tolerance Maximilian Egger M. Xhemrishi Antonia Wachter-Zeh Rawad Bitar 30 3 0 27 Jun 2023
Confidential Computing in Edge-Cloud Hierarchy Y. Alaverdyan S. Poghosyan V. Poghosyan 19 1 0 19 Jun 2023
Efficient Coded Multi-Party Computation at Edge Networks Elahe Vedadi Yasaman Keshtkarjahromi H. Seferoglu 27 4 0 11 May 2023
Fast and Straggler-Tolerant Distributed SGD with Reduced Computation Load Maximilian Egger Serge Kas Hanna Rawad Bitar FedML 27 0 0 17 Apr 2023
A Survey on Vertical Federated Learning: From a Layered Perspective Liu Yang Di Chai Junxue Zhang Yilun Jin Leye Wang Hao Liu Han Tian Qian Xu Kai Chen FedML 38 28 0 04 Apr 2023
Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networks Zhengyi Lin Guangyu Zhu Yiqin Deng Xianhao Chen Yue Gao Kaibin Huang Yuguang Fang 29 45 0 26 Mar 2023
Redundancy Management for Fast Service (Rates) in Edge Computing Systems Pei Peng E. Soljanin 25 1 0 01 Mar 2023
Coded Matrix Computations for D2D-enabled Linearized Federated Learning A. Das A. Ramamoorthy David J. Love Christopher G. Brinton FedML 56 4 0 23 Feb 2023
ByzSecAgg: A Byzantine-Resistant Secure Aggregation Scheme for Federated Learning Based on Coded Computing and Vector Commitment Tayyebeh Jahani-Nezhad M. Maddah-ali Giuseppe Caire FedML 32 2 0 20 Feb 2023
Securely Aggregated Coded Matrix Inversion Neophytos Charalambides Mert Pilanci Alfred Hero FedML 21 3 0 09 Jan 2023
Nested Gradient Codes for Straggler Mitigation in Distributed Machine Learning Luis Maßny Christoph Hofmeister Maximilian Egger Rawad Bitar Antonia Wachter-Zeh 16 0 0 16 Dec 2022
MOB-FL: Mobility-Aware Federated Learning for Intelligent Connected Vehicles Bowen Xie Yuxuan Sun Sheng Zhou Z. Niu Yang Xu Jingran Chen Deniz Gündüz 17 11 0 07 Dec 2022
Straggler-Resilient Differentially-Private Decentralized Learning Yauhen Yakimenka Chung-Wei Weng Hsuan-Yin Lin E. Rosnes J. Kliewer 29 6 0 06 Dec 2022
Sequential Gradient Coding For Straggler Mitigation M. Krishnan Mohammadreza Ebrahimi Ashish Khisti 21 0 0 24 Nov 2022
Multi-Job Intelligent Scheduling with Cross-Device Federated Learning Ji Liu Juncheng Jia Beichen Ma Chen Zhou Jingbo Zhou Yang Zhou H. Dai Dejing Dou FedML 38 24 0 24 Nov 2022
Impact of Redundancy on Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 34 2 0 16 Nov 2022
Stochastic Coded Federated Learning: Theoretical Analysis and Incentive Mechanism Design Yuchang Sun Jiawei Shao Yuyi Mao Songze Li Jun Zhang FedML 21 8 0 08 Nov 2022
Accelerating Parallel Stochastic Gradient Descent via Non-blocking Mini-batches Haoze He Parijat Dube 6 3 0 02 Nov 2022