A Fundamental Tradeoff between Computation and Communication in Distributed Computing

24 April 2016

Papers citing "A Fundamental Tradeoff between Computation and Communication in Distributed Computing"

41 / 41 papers shown

Title
Perfect Multi-User Distributed Computing Ali Khalesi P. Elia 21 2 0 04 Feb 2024
When Edge Computing Meets Compact Data Structures Zheng Li Diego Seco José Fuentes-Sepúlveda 29 1 0 01 Jun 2023
A New Interference-Alignment Scheme for Wireless MapReduce Yue Bi Michèle A. Wigger Yue Wu 8 2 0 12 Oct 2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization Feng Zhu Jingjing Zhang Xin Eric Wang 33 3 0 06 Oct 2022
Communication Efficient Distributed Learning over Wireless Channels Idan Achituve Wenbo Wang Ethan Fetaya Amir Leshem 22 2 0 04 Sep 2022
Root of Unity for Secure Distributed Matrix Multiplication: Grid Partition Case R. A. Machado Felice Manganiello 16 9 0 03 Jun 2022
Adaptive Gap Entangled Polynomial Coding for Multi-Party Computation at the Edge Elahe Vedadi Yasaman Keshtkarjahromi H. Seferoglu 27 1 0 13 Mar 2022
Robust Federated Learning with Connectivity Failures: A Semi-Decentralized Framework with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 53 8 0 24 Feb 2022
Cooperative Solutions to Exploration Tasks Under Speed and Budget Constraints Karishma Shrisha Rao 16 1 0 11 Feb 2022
Stochastic Coded Federated Learning with Convergence and Privacy Guarantees Yuchang Sun Jiawei Shao Songze Li Yuyi Mao Jun Zhang FedML 23 17 0 25 Jan 2022
Adaptive Worker Grouping For Communication-Efficient and Straggler-Tolerant Distributed SGD Feng Zhu Jingjing Zhang Osvaldo Simeone Xin Eric Wang 26 0 0 12 Jan 2022
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications Khaled B. Letaief Yuanming Shi Jianmin Lu Jianhua Lu 48 417 0 24 Nov 2021
On Gradient Coding with Partial Recovery Sahasrajit Sarmasarkar V. Lalitha Nikhil Karamchandani 26 8 0 19 Feb 2021
Coded Computing for Low-Latency Federated Learning over Wireless Edge Networks Saurav Prakash S. Dhakal M. Akdeniz Yair Yona S. Talwar Salman Avestimehr N. Himayat FedML 35 92 0 12 Nov 2020
Communication-Efficient Gradient Coding for Straggler Mitigation in Distributed Learning S. Kadhe O. O. Koyluoglu Kannan Ramchandran 32 11 0 14 May 2020
Rateless Codes for Private Distributed Matrix-Matrix Multiplication Rawad Bitar M. Xhemrishi Antonia Wachter-Zeh 33 6 0 27 Apr 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 29 327 0 22 Feb 2020
Secure Coded Cooperative Computation at the Heterogeneous Edge against Byzantine Attacks Yasaman Keshtkarjahromi Rawad Bitar Venkateswara Dasari S. E. Rouayheb H. Seferoglu 11 11 0 15 Aug 2019
Coded State Machine -- Scaling State Machine Execution under Byzantine Faults Songze Li Saeid Sahraei Mingchao Yu A. Avestimehr Sreeram Kannan Pramod Viswanath 27 6 0 26 Jun 2019
Collage Inference: Using Coded Redundancy for Low Variance Distributed Image Classification Krishnagiri Narra Zhifeng Lin Ganesh Ananthanarayanan A. Avestimehr M. Annavaram VLM 28 6 0 27 Apr 2019
Timely-Throughput Optimal Coded Computing over Cloud Networks Chien-Sheng Yang Ramtin Pedarsani A. Avestimehr 24 34 0 11 Apr 2019
CAMR: Coded Aggregated MapReduce Konstantinos Konstantinidis A. Ramamoorthy MoE 23 7 0 22 Jan 2019
PolyShard: Coded Sharding Achieves Linearly Scaling Efficiency and Security Simultaneously Songze Li Mingchao Yu Chien-Sheng Yang A. Avestimehr Sreeram Kannan Pramod Viswanath 29 110 0 27 Sep 2018
On the Fundamental Limits of Coded Data Shuffling for Distributed Machine Learning Adel M. Elmahdy S. Mohajer FedML 19 15 0 11 Jul 2018
Lagrange Coded Computing: Optimal Design for Resiliency, Security and Privacy Qian-long Yu Songze Li Netanel Raviv Seyed Mohammadreza Mousavi Kalan Jinhyun So A. Avestimehr 47 382 0 04 Jun 2018
Polynomially Coded Regression: Optimal Straggler Mitigation via Data Encoding Songze Li Seyed Mohammadreza Mousavi Kalan Qian-long Yu Mahdi Soltanolkotabi A. Avestimehr 26 48 0 24 May 2018
Robust Gradient Descent via Moment Encoding with LDPC Codes R. Maity A. S. Rawat A. Mazumdar 19 41 0 22 May 2018
Compressed Coded Distributed Computing Songze Li M. Maddah-ali A. Avestimehr 24 35 0 05 May 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 31 194 0 03 Mar 2018
A New Combinatorial Design of Coded Distributed Computing Nicholas Woolsey Rong-Rong Chen Mingyue Ji 20 31 0 12 Feb 2018
Coded Sparse Matrix Multiplication Sinong Wang Jiashang Liu Ness B. Shroff 23 123 0 09 Feb 2018
Coded Computing for Distributed Graph Analytics Saurav Prakash Amirhossein Reisizadeh Ramtin Pedarsani A. Avestimehr 18 50 0 17 Jan 2018
Near Optimal Coded Data Shuffling for Distributed Learning Mohamed Adel Attia Ravi Tandon FedML 34 30 0 05 Jan 2018
Private Function Retrieval Mahtab Mirmohseni M. Maddah-ali 22 73 0 13 Nov 2017
Coded Fourier Transform Qian-long Yu M. Maddah-ali A. Avestimehr 35 63 0 17 Oct 2017
On Heterogeneous Coded Distributed Computing Mehrdad Kiamari Chenwei Wang A. Avestimehr 34 57 0 01 Sep 2017
Improving Distributed Gradient Descent Using Reed-Solomon Codes Wael Halbawi Navid Azizan Fariborz Salehi B. Hassibi AI4CE FedML 16 156 0 16 Jun 2017
Polynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplication Qian-long Yu M. Maddah-ali A. Avestimehr 17 460 0 30 May 2017
How to Optimally Allocate Resources for Coded Distributed Computing? Qian-long Yu Songze Li M. Maddah-ali A. Avestimehr 24 51 0 23 Feb 2017
Coded Computation over Heterogeneous Clusters Amirhossein Reisizadeh Saurav Prakash Ramtin Pedarsani A. Avestimehr 27 225 0 21 Jan 2017
Speeding Up Distributed Machine Learning Using Codes Kangwook Lee Maximilian Lam Ramtin Pedarsani Dimitris Papailiopoulos Kannan Ramchandran 51 853 0 08 Dec 2015