Understanding training and generalization in deep learning by Fourier
analysis

v1v2v3v4 (latest)

Understanding training and generalization in deep learning by Fourier analysis

13 August 2018

Zhi-Qin John Xu

ArXiv (abs)PDF HTML

Papers citing "Understanding training and generalization in deep learning by Fourier analysis"

13 / 13 papers shown

Title
Inductive Gradient Adjustment For Spectral Bias In Implicit Neural Representations Kexuan Shi Hai Chen Leheng Zhang Shuhang Gu 93 1 0 17 Oct 2024
Implicit Neural Representations with Fourier Kolmogorov-Arnold Networks Ali Mehrabian Parsa Mojarad Adi Moein Heidari Ilker Hacihaliloglu 87 3 0 14 Sep 2024
Generalization in Deep Networks: The Role of Distance from Initialization Vaishnavh Nagarajan J. Zico Kolter ODL 89 96 0 07 Jan 2019
Training behavior of deep neural network in frequency domain Zhi-Qin John Xu Yaoyu Zhang Yan Xiao AI4CE 82 320 0 03 Jul 2018
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min Lin Fred Hamprecht Yoshua Bengio Aaron Courville 167 1,456 0 22 Jun 2018
Generalization in Deep Learning Kenji Kawaguchi L. Kaelbling Yoshua Bengio ODL 150 460 0 16 Oct 2017
Towards Understanding Generalization of Deep Learning: Perspective of Loss Landscapes Lei Wu Zhanxing Zhu E. Weinan ODL 69 221 0 30 Jun 2017
A Closer Look at Memorization in Deep Networks Devansh Arpit Stanislaw Jastrzebski Nicolas Ballas David M. Krueger Emmanuel Bengio ... Tegan Maharaj Asja Fischer Aaron Courville Yoshua Bengio Simon Lacoste-Julien TDI 141 1,829 0 16 Jun 2017
Sharp Minima Can Generalize For Deep Nets Laurent Dinh Razvan Pascanu Samy Bengio Yoshua Bengio ODL 145 774 0 15 Mar 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 356 4,638 0 10 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 447 2,947 0 15 Sep 2016
Train faster, generalize better: Stability of stochastic gradient descent Moritz Hardt Benjamin Recht Y. Singer 120 1,243 0 03 Sep 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.1K 150,433 0 22 Dec 2014

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.