ResearchTrend.AI
On the Acceleration of Deep Learning Model Parallelism with Staleness

On the Acceleration of Deep Learning Model Parallelism with Staleness

An Xu
Zhouyuan Huo
Heng-Chiao Huang
ArXivPDFHTML

Papers citing "On the Acceleration of Deep Learning Model Parallelism with Staleness"

7 / 7 papers shown
Title
PETRA: Parallel End-to-end Training with Reversible Architectures
PETRA: Parallel End-to-end Training with Reversible Architectures
Stéphane Rivaud
Louis Fournier
Thomas Pumir
Eugene Belilovsky
Michael Eickenberg
Edouard Oyallon
30
0
0
04 Jun 2024
Cyclic Data Parallelism for Efficient Parallelism of Deep Neural Networks
Cyclic Data Parallelism for Efficient Parallelism of Deep Neural Networks
Louis Fournier
Edouard Oyallon
57
0
0
13 Mar 2024
Layer-Wise Partitioning and Merging for Efficient and Scalable Deep Learning
Layer-Wise Partitioning and Merging for Efficient and Scalable Deep Learning
S. Akintoye
Liangxiu Han
H. Lloyd
Xin Zhang
Darren Dancey
Haoming Chen
Daoqiang Zhang
FedML
34
5
0
22 Jul 2022
Enabling All In-Edge Deep Learning: A Literature Review
Enabling All In-Edge Deep Learning: A Literature Review
Praveen Joshi
Mohammed Hasanuzzaman
Chandra Thapa
Haithem Afli
T. Scully
50
22
0
07 Apr 2022
Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentation
Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentation
An Xu
Wenqi Li
Pengfei Guo
Dong Yang
H. Roth
Ali Hatamizadeh
Can Zhao
Daguang Xu
Heng-Chiao Huang
Ziyue Xu
FedML
38
52
0
18 Mar 2022
A Machine Learning Framework for Distributed Functional Compression over Wireless Channels in IoT
A Machine Learning Framework for Distributed Functional Compression over Wireless Channels in IoT
Yashas Malur Saidutta
Afshin Abdi
Faramarz Fekri
AI4CE
38
4
0
24 Jan 2022
Detached Error Feedback for Distributed SGD with Random Sparsification
Detached Error Feedback for Distributed SGD with Random Sparsification
An Xu
Heng-Chiao Huang
41
9
0
11 Apr 2020