Explicitizing an Implicit Bias of the Frequency Principle in Two-layer Neural Networks

24 May 2019

Papers citing "Explicitizing an Implicit Bias of the Frequency Principle in Two-layer Neural Networks"

10 / 10 papers shown

Title
Spectral Regularization Allows Data-frugal Learning over Combinatorial Spaces Amirali Aghazadeh Nived Rajaraman Tony Tu Kannan Ramchandran 22 2 0 05 Oct 2022
HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging Xiaowan Hu Yuanhao Cai Jing Lin Haoqian Wang X. Yuan Yulun Zhang Radu Timofte Luc Van Gool 37 134 0 04 Mar 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Yaoyu Zhang Tao Luo FaML 33 66 0 19 Jan 2022
Data-informed Deep Optimization Lulu Zhang Z. Xu Yaoyu Zhang AI4CE 35 3 0 17 Jul 2021
Frequency Principle in Deep Learning Beyond Gradient-descent-based Training Yuheng Ma Zhi-Qin John Xu Jiwei Zhang 24 7 0 04 Jan 2021
Fourier-domain Variational Formulation and Its Well-posedness for Supervised Learning Tao Luo Zheng Ma Zhiwei Wang Zhi-Qin John Xu Yaoyu Zhang OOD 47 4 0 06 Dec 2020
Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks Blake Bordelon Abdulkadir Canatar Cengiz Pehlevan 146 201 0 07 Feb 2020
Multi-scale Deep Neural Networks for Solving High Dimensional PDEs Wei Cai Zhi-Qin John Xu AI4CE 19 38 0 25 Oct 2019
Theory of the Frequency Principle for General Deep Neural Networks Tao Luo Zheng Ma Zhi-Qin John Xu Yaoyu Zhang 26 78 0 21 Jun 2019
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,892 0 15 Sep 2016