Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2205.00119
Cited By
v1
v2
v3
v4
v5 (latest)
MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud
30 April 2022
Zhen Zhang
Shuai Zheng
Yida Wang
Justin Chiu
George Karypis
Trishul Chilimbi
Mu Li
Xin Jin
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud"
3 / 3 papers shown
Title
Scaling Large Language Model Training on Frontier with Low-Bandwidth Partitioning
Lang Xu
Quentin G. Anthony
Jacob Hatef
Hari Subramoni
Hari Subramoni
Dhabaleswar K.
Panda
103
0
0
08 Jan 2025
Cyclic Data Parallelism for Efficient Parallelism of Deep Neural Networks
Louis Fournier
Edouard Oyallon
99
0
0
13 Mar 2024
Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training
Hongzheng Chen
Cody Hao Yu
Shuai Zheng
Zhen Zhang
Zhiru Zhang
Yida Wang
84
8
0
16 Feb 2023
1
