Understanding training and generalization in deep learning by Fourier analysis

13 August 2018

Papers citing "Understanding training and generalization in deep learning by Fourier analysis"

16 / 16 papers shown

Title
Implicit Neural Representations with Fourier Kolmogorov-Arnold Networks Ali Mehrabian Parsa Mojarad Adi Moein Heidari I. Hacihaliloglu 38 3 0 14 Sep 2024
On the Activation Function Dependence of the Spectral Bias of Neural Networks Q. Hong Jonathan W. Siegel Qinyan Tan Jinchao Xu 34 23 0 09 Aug 2022
Explanation-based Counterfactual Retraining(XCR): A Calibration Method for Black-box Models Liu Zhendong Wenyu Jiang Yan Zhang Chongjun Wang CML 11 0 0 22 Jun 2022
Deep Frequency Filtering for Domain Generalization Shiqi Lin Zhizheng Zhang Zhipeng Huang Yan Lu Cuiling Lan ... Jiang Wang Zicheng Liu Amey Parulkar V. Navkal Zhibo Chen 30 50 0 23 Mar 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Yaoyu Zhang Tao Luo FaML 33 66 0 19 Jan 2022
Discovering and Explaining the Representation Bottleneck of DNNs Huiqi Deng Qihan Ren Hao Zhang Quanshi Zhang 39 59 0 11 Nov 2021
Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networks S. Maddu D. Sturm Christian L. Müller I. Sbalzarini AI4CE 26 81 0 02 Jul 2021
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 34 79 0 17 Sep 2020
Interpreting and Disentangling Feature Components of Various Complexity from DNNs Jie Ren Mingjie Li Zexu Liu Quanshi Zhang CoGe 16 18 0 29 Jun 2020
Towards Understanding the Spectral Bias of Deep Learning Yuan Cao Zhiying Fang Yue Wu Ding-Xuan Zhou Quanquan Gu 32 214 0 03 Dec 2019
Multi-scale Deep Neural Networks for Solving High Dimensional PDEs Wei Cai Zhi-Qin John Xu AI4CE 14 38 0 25 Oct 2019
A Phase Shift Deep Neural Network for High Frequency Approximation and Wave Problems Wei Cai Xiaoguang Li Lizuo Liu 17 84 0 23 Sep 2019
Theory of the Frequency Principle for General Deep Neural Networks Tao Luo Zheng Ma Zhi-Qin John Xu Yaoyu Zhang 23 78 0 21 Jun 2019
A type of generalization error induced by initialization in deep neural networks Yaoyu Zhang Zhi-Qin John Xu Tao Luo Zheng Ma 9 49 0 19 May 2019
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min-Bin Lin Fred Hamprecht Yoshua Bengio Aaron Courville 57 1,394 0 22 Jun 2018
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,890 0 15 Sep 2016