Variance Reduction in Deep Learning: More Momentum is All You Need

23 November 2021

Papers citing "Variance Reduction in Deep Learning: More Momentum is All You Need"

1 / 1 papers shown

Title
The Marginal Value of Momentum for Small Learning Rate SGD Runzhe Wang Sadhika Malladi Tianhao Wang Kaifeng Lyu Zhiyuan Li ODL 82 9 0 27 Jul 2023