Which Minimizer Does My Neural Network Converge To?

4 November 2020

Papers citing "Which Minimizer Does My Neural Network Converge To?"

8 / 8 papers shown

Title
A Framework and Benchmark for Deep Batch Active Learning for Regression David Holzmüller Viktor Zaverkin Johannes Kastner Ingo Steinwart UQCV BDL GP 56 34 0 17 Mar 2022
To Each Optimizer a Norm, To Each Norm its Generalization Sharan Vaswani Reza Babanezhad Jose Gallego Aaron Mishkin Simon Lacoste-Julien Nicolas Le Roux 34 8 0 11 Jun 2020
The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent Karthik A. Sankararaman Soham De Zheng Xu Wenjie Huang Tom Goldstein ODL 41 103 0 15 Apr 2019
Width Provably Matters in Optimization for Deep Linear Neural Networks S. Du Wei Hu 44 94 0 24 Jan 2019
Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data Yuanzhi Li Yingyu Liang MLT 86 652 0 03 Aug 2018
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min Lin Fred Hamprecht Yoshua Bengio Aaron Courville 76 1,408 0 22 Jun 2018
The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning Siyuan Ma Raef Bassily M. Belkin 39 289 0 18 Dec 2017
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 63 18,534 0 06 Feb 2015