Adaptive Loss Scaling for Mixed Precision Training

28 October 2019

Papers citing "Adaptive Loss Scaling for Mixed Precision Training"

4 / 4 papers shown

Title
8-bit Numerical Formats for Deep Neural Networks Badreddine Noune Philip Jones Daniel Justus Dominic Masters Carlo Luschi MQ 100 35 0 06 Jun 2022
Learning to Predict Gradients for Semi-Supervised Continual Learning Yan Luo Yongkang Wong Mohan S. Kankanhalli Qi Zhao SSL CLL 68 8 0 23 Jan 2022
Representation range needs for 16-bit neural network training Valentina Popescu Abhinav Venigalla Di Wu R. Schreiber MQ 21 2 0 29 Mar 2021
Contrastive Weight Regularization for Large Minibatch SGD Qiwei Yuan Weizhe Hua Yi Zhou Cunxi Yu OffRL 83 1 0 17 Nov 2020