ResearchTrend.AI
DataStates-LLM: Lazy Asynchronous Checkpointing for Large Language Models

DataStates-LLM: Lazy Asynchronous Checkpointing for Large Language Models

Avinash Maurya
Robert Underwood
M. Rafique
Franck Cappello
Bogdan Nicolae
ArXiv (abs)PDFHTML

Papers citing "DataStates-LLM: Lazy Asynchronous Checkpointing for Large Language Models"

3 / 3 papers shown
Title
PaLM: Scaling Language Modeling with Pathways
PaLM: Scaling Language Modeling with Pathways
Aakanksha Chowdhery
Sharan Narang
Jacob Devlin
Maarten Bosma
Gaurav Mishra
...
Kathy Meier-Hellstern
Douglas Eck
J. Dean
Slav Petrov
Noah Fiedel
PILMLRM
509
6,279
0
05 Apr 2022
M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining
M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining
Junyang Lin
An Yang
Jinze Bai
Chang Zhou
Le Jiang
...
Jie Zhang
Yong Li
Wei Lin
Jingren Zhou
Hongxia Yang
MoE
115
43
0
08 Oct 2021
Very Deep Convolutional Networks for Large-Scale Image Recognition
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan
Andrew Zisserman
FAttMDE
1.7K
100,479
0
04 Sep 2014

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.