Linear Frequency Principle Model to Understand the Absence of Overfitting in Neural Networks

30 January 2021

Papers citing "Linear Frequency Principle Model to Understand the Absence of Overfitting in Neural Networks"

14 / 14 papers shown

Title
Hypernym Bias: Unraveling Deep Classifier Training Dynamics through the Lens of Class Hierarchy Roman Malashin Valeria Yachnaya Alexander Mullin 131 1 0 17 Feb 2025
A rationale from frequency perspective for grokking in training neural network Zhangchen Zhou Yaoyu Zhang Z. Xu 88 2 0 24 May 2024
Understanding the dynamics of the frequency bias in neural networks Juan Molina Mircea Petrache F. Sahli Costabal Matías Courdurier 74 1 0 23 May 2024
Anchor function: a type of benchmark functions for studying language models Zhongwang Zhang Zhiwei Wang Junjie Yao Zhangchen Zhou Xiaolong Li E. Weinan Z. Xu 118 7 0 16 Jan 2024
Loss Spike in Training Neural Networks Zhongwang Zhang Z. Xu 72 7 0 20 May 2023
Effective Dynamics of Generative Adversarial Networks S. Durr Youssef Mroueh Yuhai Tu Shenshen Wang GAN 54 5 0 08 Dec 2022
Linear Stability Hypothesis and Rank Stratification for Nonlinear Models Yaoyu Zhang Zhongwang Zhang Leyang Zhang Zhiwei Bai Yaoyu Zhang Z. Xu 56 8 0 21 Nov 2022
Implicit regularization of dropout Zhongwang Zhang Zhi-Qin John Xu 70 29 0 13 Jul 2022
Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks Zhiwei Bai Yaoyu Zhang Z. Xu Yaoyu Zhang 122 6 0 26 May 2022
Limitation of Characterizing Implicit Regularization by Data-independent Functions Leyang Zhang Z. Xu Yaoyu Zhang Yaoyu Zhang 33 0 0 28 Jan 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Yaoyu Zhang Yaoyu Zhang FaML 90 73 0 19 Jan 2022
Subspace Decomposition based DNN algorithm for elliptic type multi-scale PDEs Xi-An Li Z. Xu Lei Zhang 60 28 0 10 Dec 2021
Embedding Principle: a hierarchical structure of loss landscape of deep neural networks Yaoyu Zhang Yuqing Li Zhongwang Zhang Yaoyu Zhang Z. Xu 84 23 0 30 Nov 2021
Dropout in Training Neural Networks: Flatness of Solution and Noise Structure Zhongwang Zhang Hanxu Zhou Zhi-Qin John Xu ODL 63 2 0 01 Nov 2021