Cloud Collectives: Towards Cloud-aware Collectives forML Workloads with Rank Reordering

28 May 2021

Papers citing "Cloud Collectives: Towards Cloud-aware Collectives forML Workloads with Rank Reordering"

2 / 2 papers shown

Title
MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud Zhen Zhang Shuai Zheng Yida Wang Justin Chiu George Karypis Trishul Chilimbi Mu Li Xin Jin 28 39 0 30 Apr 2022
Parameter Hub: a Rack-Scale Parameter Server for Distributed Deep Neural Network Training Liang Luo Jacob Nelson Luis Ceze Amar Phanishayee Arvind Krishnamurthy 76 120 0 21 May 2018