Neural Tangent Kernel: Convergence and Generalization in Neural Networks

v1v2v3v4 (latest)

Neural Tangent Kernel: Convergence and Generalization in Neural Networks

20 June 2018

Clément Hongler

ArXiv (abs)PDF HTML

Papers citing "Neural Tangent Kernel: Convergence and Generalization in Neural Networks"

13 / 1,163 papers shown

Title
On the Convergence Rate of Training Recurrent Neural Networks Zeyuan Allen-Zhu Yuanzhi Li Zhao Song 232 192 0 29 Oct 2018
A jamming transition from under- to over-parametrization affects loss landscape and generalization S. Spigler Mario Geiger Stéphane dÁscoli Levent Sagun Giulio Biroli Matthieu Wyart 91 150 0 22 Oct 2018
Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel Colin Wei Jason D. Lee Qiang Liu Tengyu Ma 268 245 0 12 Oct 2018
Information Geometry of Orthogonal Initializations and Training Piotr A. Sokól Il-Su Park AI4CE 125 17 0 09 Oct 2018
Gradient Descent Provably Optimizes Over-parameterized Neural Networks S. Du Xiyu Zhai Barnabás Póczós Aarti Singh MLT ODL 250 1,276 0 04 Oct 2018
Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning Charles H. Martin Michael W. Mahoney AI4CE 131 201 0 02 Oct 2018
On Lipschitz Bounds of General Convolutional Neural Networks Dongmian Zou R. Balan Maneesh Kumar Singh 65 54 0 04 Aug 2018
Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach Ryo Karakida S. Akaho S. Amari FedML 191 146 0 04 Jun 2018
Spurious Valleys in Two-layer Neural Network Optimization Landscapes Luca Venturi Afonso S. Bandeira Joan Bruna 80 74 0 18 Feb 2018
High-dimensional dynamics of generalization error in neural networks Madhu S. Advani Andrew M. Saxe AI4CE 145 472 0 10 Oct 2017
Compressive Statistical Learning with Random Feature Moments Rémi Gribonval Gilles Blanchard Nicolas Keriven Y. Traonmilin 149 50 0 22 Jun 2017
Quantifying the probable approximation error of probabilistic inference programs Marco F. Cusumano-Towner Vikash K. Mansinghka 100 7 0 31 May 2016
New insights and perspectives on the natural gradient method James Martens ODL 165 631 0 03 Dec 2014