The Impact of the Mini-batch Size on the Variance of Gradients in Stochastic Gradient Descent

27 April 2020

Papers citing "The Impact of the Mini-batch Size on the Variance of Gradients in Stochastic Gradient Descent"

6 / 6 papers shown

Title
Adaptive posterior distributions for uncertainty analysis of covariance matrices in Bayesian inversion problems for multioutput signals E. Curbelo Luca Martino F. Llorente D. Delgado-Gomez 47 1 0 03 Jan 2025
Robust Clustering on High-Dimensional Data with Stochastic Quantization Anton Kozyriev Vladimir Norkin MQ 24 3 0 03 Sep 2024
EPINN-NSE: Enhanced Physics-Informed Neural Networks for Solving Navier-Stokes Equations Ayoub Farkane Mounir Ghogho M. Oudani M. Boutayeb PINN 28 5 0 07 Apr 2023
Read the Signs: Towards Invariance to Gradient Descent's Hyperparameter Initialization Davood Wadi M. Fredette S. Sénécal ODL AI4CE 8 0 0 24 Jan 2023
Green, Quantized Federated Learning over Wireless Networks: An Energy-Efficient Design Minsu Kim Walid Saad Mohammad Mozaffari Merouane Debbah FedML MQ 23 27 0 19 Jul 2022
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,890 0 15 Sep 2016