Eliminating Sharp Minima from SGD with Truncated Heavy-tailed Noise

8 February 2021

Papers citing "Eliminating Sharp Minima from SGD with Truncated Heavy-tailed Noise"

2 / 2 papers shown

Title
Anticorrelated Noise Injection for Improved Generalization Antonio Orvieto Hans Kersting F. Proske Francis R. Bach Aurelien Lucchi 76 44 0 06 Feb 2022
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,892 0 15 Sep 2016