The Surprising Simplicity of the Early-Time Learning Dynamics of Neural Networks

25 June 2020

Papers citing "The Surprising Simplicity of the Early-Time Learning Dynamics of Neural Networks"

9 / 9 papers shown

Title
Towards Understanding the Spectral Bias of Deep Learning Yuan Cao Zhiying Fang Yue Wu Ding-Xuan Zhou Quanquan Gu 68 217 0 03 Dec 2019
A Fine-Grained Spectral Perspective on Neural Networks Greg Yang Hadi Salman 57 112 0 24 Jul 2019
Gradient Descent Maximizes the Margin of Homogeneous Neural Networks Kaifeng Lyu Jian Li 68 332 0 13 Jun 2019
Implicit Regularization in Deep Matrix Factorization Sanjeev Arora Nadav Cohen Wei Hu Yuping Luo AI4CE 61 500 0 31 May 2019
Scaling Limits of Wide Neural Networks with Weight Sharing: Gaussian Process Behavior, Gradient Independence, and Neural Tangent Kernel Derivation Greg Yang 69 286 0 13 Feb 2019
Uniform Hanson-Wright type concentration inequalities for unbounded entries via the entropy method Yegor Klochkov Nikita Zhivotovskiy 40 30 0 09 Dec 2018
Training behavior of deep neural network in frequency domain Zhi-Qin John Xu Yaoyu Zhang Yan Xiao AI4CE 33 319 0 03 Jul 2018
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min Lin Fred Hamprecht Yoshua Bengio Aaron Courville 92 1,408 0 22 Jun 2018
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 107 1,830 0 20 Dec 2013