The Effect of SGD Batch Size on Autoencoder Learning: Sparsity,
Sharpness, and Feature Learning

The Effect of SGD Batch Size on Autoencoder Learning: Sparsity, Sharpness, and Feature Learning

6 August 2023

Papers citing "The Effect of SGD Batch Size on Autoencoder Learning: Sparsity, Sharpness, and Feature Learning"

11 / 11 papers shown

Title
On the Implicit Bias in Deep-Learning Algorithms Gal Vardi FedML AI4CE 45 79 0 26 Aug 2022
Learning a Single Neuron with Bias Using Gradient Descent Gal Vardi Gilad Yehudai Ohad Shamir MLT 40 17 0 02 Jun 2021
On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent Shahar Azulay E. Moroshko Mor Shpigel Nacson Blake E. Woodworth Nathan Srebro Amir Globerson Daniel Soudry AI4CE 48 73 0 19 Feb 2021
Shape Matters: Understanding the Implicit Bias of the Noise Covariance Jeff Z. HaoChen Colin Wei Jason D. Lee Tengyu Ma 97 94 0 15 Jun 2020
Feature Purification: How Adversarial Training Performs Robust Deep Learning Zeyuan Allen-Zhu Yuanzhi Li MLT AAML 59 149 0 20 May 2020
Learning a Single Neuron with Gradient Methods Gilad Yehudai Ohad Shamir MLT 36 63 0 15 Jan 2020
Kernel and Rich Regimes in Overparametrized Models Blake E. Woodworth Suriya Gunasekar Pedro H. P. Savarese E. Moroshko Itay Golan Jason D. Lee Daniel Soudry Nathan Srebro 61 358 0 13 Jun 2019
Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel Colin Wei Jason D. Lee Qiang Liu Tengyu Ma 114 245 0 12 Oct 2018
Three Factors Influencing Minima in SGD Stanislaw Jastrzebski Zachary Kenton Devansh Arpit Nicolas Ballas Asja Fischer Yoshua Bengio Amos Storkey 67 459 0 13 Nov 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 355 2,922 0 15 Sep 2016
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 111 1,830 0 20 Dec 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.