ResearchTrend.AI
Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Gabin Schieffer
Jacob Wahlgren
Jie Ren
Jennifer Faj
Ivy Bo Peng
ArXivPDFHTML

Papers citing "Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper"

1 / 1 papers shown
Title
ZeRO-Offload: Democratizing Billion-Scale Model Training
ZeRO-Offload: Democratizing Billion-Scale Model Training
Jie Ren
Samyam Rajbhandari
Reza Yazdani Aminabadi
Olatunji Ruwase
Shuangyang Yang
Minjia Zhang
Dong Li
Yuxiong He
MoE
177
414
0
18 Jan 2021