v1v2v3 (latest)

Speeding Up Distributed Machine Learning Using Codes

8 December 2015

Kangwook Lee

Maximilian Lam

Ramtin Pedarsani

Dimitris Papailiopoulos

Kannan Ramchandran

ArXiv (abs)PDF HTML

Papers citing "Speeding Up Distributed Machine Learning Using Codes"

50 / 268 papers shown

Title
HASFL: Heterogeneity-aware Split Federated Learning over Edge Computing Systems Zheng Lin Zhe Chen Xianhao Chen Wei Ni Yue Gao FedML 37 0 0 10 Jun 2025
Adaptive Deadline and Batch Layered Synchronized Federated Learning Asaf Goren Natalie Lang Nir Shlezinger Alejandro Cohen FedML 19 0 0 29 May 2025
Efficient Split Federated Learning for Large Language Models over Communication Networks Kai Zhao Zhaohui Yang Ye Hu Mingzhe Chen Chen Zhu Zhaoyang Zhang 81 0 0 20 Apr 2025
Flexible Coded Distributed Convolution Computing for Enhanced Fault Tolerance and Numerical Stability in Distributed CNNs Shuo Tan Rui Liu XianLei Long Kai Wan Linqi Song Yong Li 158 0 0 03 Nov 2024
Sparsity-Preserving Encodings for Straggler-Optimal Distributed Matrix Computations at the Edge A. Das Aditya Ramamoorthy David J. Love Christopher G. Brinton 66 0 0 09 Aug 2024
Algebraic Geometry Codes for Distributed Matrix Multiplication Using Local Expansions Jiang Li Songsong Li Chaoping Xing 76 1 0 03 Aug 2024
Parallel Split Learning with Global Sampling Mohammad Kohankhaki Ahmad Ayad Mahdi Barhoush A. Schmeink 109 1 0 22 Jul 2024
Design and Optimization of Hierarchical Gradient Coding for Distributed Learning at Edge Devices Weiheng Tang Jingyi Li Lin Chen Xu Chen 88 1 0 16 Jun 2024
Training Through Failure: Effects of Data Consistency in Parallel Machine Learning Training Ray Cao Sherry Luo Steve Gan Sujeeth Jinesh 61 0 0 08 Jun 2024
Approximated Coded Computing: Towards Fast, Private and Secure Distributed Machine Learning Houming Qiu Kun Zhu Nguyen Cong Luong Dusit Niyato FedML 73 0 0 07 Jun 2024
FedAST: Federated Asynchronous Simultaneous Training Baris Askin Pranay Sharma Carlee Joe-Wong Gauri Joshi 94 2 0 01 Jun 2024
Algebraic Geometric Rook Codes for Coded Distributed Computing Gretchen L. Matthews Pedro Soto AI4CE 80 1 0 16 May 2024
Linear Operator Approximate Message Passing (OpAMP) Riccardo Rossetti B. Nazer Galen Reeves 70 2 0 13 May 2024
Privacy-aware Berrut Approximated Coded Computing for Federated Learning Xavier Martínez Luana Rebeca P. Díaz Redondo Manuel Fernández-Veiga FedML 108 2 0 02 May 2024
Approximate Gradient Coding for Privacy-Flexible Federated Learning with Non-IID Data Okko Makkonen Sampo Niemelä Camilla Hollanti Serge Kas Hanna 69 0 0 04 Apr 2024
A Survey on Resource Management in Joint Communication and Computing-Embedded SAGIN Qian Chen Zheng Guo Weixiao Meng Shuai Han Cheng Li Tony Q. S. Quek 105 24 0 26 Mar 2024
Distributed Learning based on 1-Bit Gradient Coding in the Presence of Stragglers Chengxi Li Mikael Skoglund 124 5 0 19 Mar 2024
Wireless Distributed Matrix-Vector Multiplication using Over-the-Air Computation and Analog Coding Jinho Choi 62 1 0 17 Feb 2024
FLASH: Federated Learning Across Simultaneous Heterogeneities Xiangyu Chang Sk. Miraj Ahmed S. Krishnamurthy Başak Güler A. Swami Samet Oymak Amit K. Roy-Chowdhury FedML 74 3 0 13 Feb 2024
Successive Refinement in Large-Scale Computation: Advancing Model Inference Applications H. Esfahanizadeh Alejandro Cohen S. Shamai Muriel Médard 70 1 0 11 Feb 2024
NeRCC: Nested-Regression Coded Computing for Resilient Distributed Prediction Serving Systems Parsa Moradi M. Maddah-ali 67 0 0 06 Feb 2024
Coded Computing for Fault-Tolerant Parallel QR Decomposition Quang Minh Nguyen Iain Xie Weissburg Haewon Jeong 122 2 0 20 Nov 2023
Accelerating Split Federated Learning over Wireless Communication Networks Ce Xu Jinxuan Li Yuan Liu Yushi Ling Miaowen Wen FedML 66 26 0 24 Oct 2023
A High-throughput and Secure Coded Blockchain for IoT Amirhossein Taherpour Xiaodong Wang 55 1 0 13 Oct 2023
DxPU: Large Scale Disaggregated GPU Pools in the Datacenter Bowen He Xiao Zheng Yuan Chen Weinan Li Yajin Zhou ... Xiaowei Lu Linquan Jiang Qiang Liu Dennis Cai Xiantao Zhang 114 8 0 07 Oct 2023
Workload Distribution with Rateless Encoding: A Low-Latency Computation Offloading Method within Edge Networks Zhongfu Guo Xinsheng Ji Wei You Yu Zhao Bai Yi Lingwei Wang OffRL 116 1 0 04 Oct 2023
Privacy-Preserving Polynomial Computing Over Distributed Data Zhiquan Tan Dingli Yuan Zhongyi Huang FedML 102 1 0 17 Sep 2023
Randomized Polar Codes for Anytime Distributed Machine Learning Burak Bartan Mert Pilanci 67 4 0 01 Sep 2023
Analog Multi-Party Computing: Locally Differential Private Protocols for Collaborative Computations Hsuan-Po Liu M. Soleymani Hessam Mahdavifar 77 1 0 24 Aug 2023
Sparsity and Privacy in Secret Sharing: A Fundamental Trade-Off Rawad Bitar Maximilian Egger Antonia Wachter-Zeh M. Xhemrishi 67 4 0 11 Aug 2023
Preserving Sparsity and Privacy in Straggler-Resilient Distributed Matrix Computations A. Das A. Ramamoorthy David J. Love Christopher G. Brinton 72 1 0 08 Aug 2023
Iterative Sketching for Secure Coded Regression Neophytos Charalambides Hessam Mahdavifar Mert Pilanci Alfred Hero 65 2 0 08 Aug 2023
Gradient Coding with Iterative Block Leverage Score Sampling Neophytos Charalambides Mert Pilanci Alfred Hero 78 2 0 06 Aug 2023
Population Expansion for Training Language Models with Private Federated Learning Tatsuki Koga Congzheng Song Martin Pelikan Mona Chitnis FedML 50 1 0 14 Jul 2023
Sparse and Private Distributed Matrix Multiplication with Straggler Tolerance Maximilian Egger M. Xhemrishi Antonia Wachter-Zeh Rawad Bitar 75 3 0 27 Jun 2023
Confidential Computing in Edge-Cloud Hierarchy Y. Alaverdyan S. Poghosyan V. Poghosyan 136 2 0 19 Jun 2023
Efficient Coded Multi-Party Computation at Edge Networks Elahe Vedadi Yasaman Keshtkarjahromi H. Seferoglu 65 4 0 11 May 2023
Fast and Straggler-Tolerant Distributed SGD with Reduced Computation Load Maximilian Egger Serge Kas Hanna Rawad Bitar FedML 71 1 0 17 Apr 2023
A Survey on Vertical Federated Learning: From a Layered Perspective Liu Yang Di Chai Junxue Zhang Yilun Jin Leye Wang Hao Liu Han Tian Qian Xu Kai Chen FedML 91 30 0 04 Apr 2023
Efficient Parallel Split Learning over Resource-constrained Wireless Edge Networks Zhengyi Lin Guangyu Zhu Yiqin Deng Xianhao Chen Yue Gao Kaibin Huang Yuguang Fang 94 113 0 26 Mar 2023
Redundancy Management for Fast Service (Rates) in Edge Computing Systems Pei Peng E. Soljanin 82 1 0 01 Mar 2023
Coded Matrix Computations for D2D-enabled Linearized Federated Learning A. Das A. Ramamoorthy David J. Love Christopher G. Brinton FedML 115 4 0 23 Feb 2023
ByzSecAgg: A Byzantine-Resistant Secure Aggregation Scheme for Federated Learning Based on Coded Computing and Vector Commitment Tayyebeh Jahani-Nezhad M. Maddah-ali Giuseppe Caire FedML 89 4 0 20 Feb 2023
Securely Aggregated Coded Matrix Inversion Neophytos Charalambides Mert Pilanci Alfred Hero FedML 79 3 0 09 Jan 2023
Nested Gradient Codes for Straggler Mitigation in Distributed Machine Learning Luis Maßny Christoph Hofmeister Maximilian Egger Rawad Bitar Antonia Wachter-Zeh 123 0 0 16 Dec 2022
MOB-FL: Mobility-Aware Federated Learning for Intelligent Connected Vehicles Bowen Xie Yuxuan Sun Sheng Zhou Z. Niu Yang Xu Jingran Chen Deniz Gündüz 60 12 0 07 Dec 2022
Straggler-Resilient Differentially-Private Decentralized Learning Yauhen Yakimenka Chung-Wei Weng Hsuan-Yin Lin E. Rosnes J. Kliewer 89 7 0 06 Dec 2022
Sequential Gradient Coding For Straggler Mitigation M. Krishnan Mohammadreza Ebrahimi Ashish Khisti 52 0 0 24 Nov 2022
Multi-Job Intelligent Scheduling with Cross-Device Federated Learning Ji Liu Juncheng Jia Beichen Ma Chen Zhou Jingbo Zhou Yang Zhou H. Dai Dejing Dou FedML 104 24 0 24 Nov 2022
Impact of Redundancy on Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 111 2 0 16 Nov 2022