Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks

19 January 2019

Papers citing "Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks"

47 / 97 papers shown

Title
Finite Expression Method for Solving High-Dimensional Partial Differential Equations Senwei Liang Haizhao Yang 34 18 0 21 Jun 2022
Accelerating Score-based Generative Models for High-Resolution Image Synthesis He Ma Li Zhang Xiatian Zhu Jingfeng Zhang Jianfeng Feng DiffM 22 14 0 08 Jun 2022
Wavelet Regularization Benefits Adversarial Training Jun Yan Huilin Yin Xiaoyang Deng Zi-qin Zhao Wancheng Ge Hao Zhang Gerhard Rigoll AAML 19 2 0 08 Jun 2022
Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow Adam Subel Yifei Guan Ashesh Chattopadhyay Pedram Hassanzadeh AI4CE 35 41 0 07 Jun 2022
A Neural Network Approach for Homogenization of Multiscale Problems Jihun Han Yoonsang Lee 35 13 0 04 Jun 2022
Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks Zhiwei Bai Tao Luo Z. Xu Yaoyu Zhang 31 5 0 26 May 2022
Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width Hanxu Zhou Qixuan Zhou Zhenyuan Jin Tao Luo Yaoyu Zhang Zhi-Qin John Xu 25 20 0 24 May 2022
Sobolev Acceleration and Statistical Optimality for Learning Elliptic Equations via Gradient Descent Yiping Lu Jose H. Blanchet Lexing Ying 38 7 0 15 May 2022
A walk through of time series analysis on quantum computers Ammar Daskin 11 5 0 02 May 2022
HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging Xiaowan Hu Yuanhao Cai Jing Lin Haoqian Wang X. Yuan Yulun Zhang Radu Timofte Luc Van Gool 37 134 0 04 Mar 2022
The Spectral Bias of Polynomial Neural Networks Moulik Choraria L. Dadi Grigorios G. Chrysos Julien Mairal V. Cevher 24 18 0 27 Feb 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Yaoyu Zhang Tao Luo FaML 33 66 0 19 Jan 2022
Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's next S. Cuomo Vincenzo Schiano Di Cola F. Giampaolo G. Rozza Maizar Raissi F. Piccialli PINN 26 1,190 0 14 Jan 2022
A multi-scale sampling method for accurate and robust deep neural network to predict combustion chemical kinetics Tianhan Zhang Yuxiao Yi Yifan Xu Z. X. Chen Yaoyu Zhang E. Weinan Zhi-Qin John Xu 14 51 0 09 Jan 2022
A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning S. Zhang Jieyu Lin Qi Zhang 35 63 0 09 Jan 2022
Hierarchical Learning to Solve Partial Differential Equations Using Physics-Informed Neural Networks Jihun Han Yoonsang Lee AI4CE 24 10 0 02 Dec 2021
Embedding Decomposition for Artifacts Removal in EEG Signals Junjie Yu Chenyi Li Kexin Lou Chen Wei Quanying Liu 19 37 0 02 Dec 2021
Embedding Principle: a hierarchical structure of loss landscape of deep neural networks Yaoyu Zhang Yuqing Li Zhongwang Zhang Tao Luo Z. Xu 29 22 0 30 Nov 2021
Backdoor Attack through Frequency Domain Tong Wang Yuan Yao Feng Xu Shengwei An Hanghang Tong Ting Wang AAML 24 33 0 22 Nov 2021
Understanding Layer-wise Contributions in Deep Neural Networks through Spectral Analysis Yatin Dandi Arthur Jacot FAtt 26 4 0 06 Nov 2021
Solving Partial Differential Equations with Point Source Based on Physics-Informed Neural Networks Xiang Huang Hongsheng Liu Beiji Shi Zidong Wang Kan Yang ... Jing Zhou Fan Yu Bei Hua Lei Chen Bin Dong 19 20 0 02 Nov 2021
Improved architectures and training algorithms for deep operator networks Sizhuang He Hanwen Wang P. Perdikaris AI4CE 52 105 0 04 Oct 2021
Data-informed Deep Optimization Lulu Zhang Z. Xu Yaoyu Zhang AI4CE 35 3 0 17 Jul 2021
Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equations Benjamin Moseley Andrew Markham T. Nissen‐Meyer PINN 48 211 0 16 Jul 2021
MOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEs Lulu Zhang Tao Luo Yaoyu Zhang Weinan E Z. Xu Zheng Ma AI4CE 27 33 0 08 Jul 2021
On Measuring and Controlling the Spectral Bias of the Deep Image Prior Prithvijit Chakrabarty Pascal Mettes Subhransu Maji Cees G. M. Snoek 13 60 0 02 Jul 2021
Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networks S. Maddu D. Sturm Christian L. Müller I. Sbalzarini AI4CE 29 81 0 02 Jul 2021
The Old and the New: Can Physics-Informed Deep-Learning Replace Traditional Linear Solvers? Stefano Markidis PINN 39 183 0 12 Mar 2021
Reproducing Activation Function for Deep Learning Senwei Liang Liyao Lyu Chunmei Wang Haizhao Yang 36 21 0 13 Jan 2021
Robust Text CAPTCHAs Using Adversarial Examples Rulin Shao Zhouxing Shi Jinfeng Yi Pin-Yu Chen Cho-Jui Hsieh AAML 32 16 0 07 Jan 2021
Frequency Principle in Deep Learning Beyond Gradient-descent-based Training Yuheng Ma Zhi-Qin John Xu Jiwei Zhang 24 7 0 04 Jan 2021
FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training Y. Fu Haoran You Yang Katie Zhao Yue Wang Chaojian Li K. Gopalakrishnan Zhangyang Wang Yingyan Lin MQ 38 32 0 24 Dec 2020
Fourier-domain Variational Formulation and Its Well-posedness for Supervised Learning Tao Luo Zheng Ma Zhiwei Wang Zhi-Qin John Xu Yaoyu Zhang OOD 47 4 0 06 Dec 2020
Gradient Starvation: A Learning Proclivity in Neural Networks Mohammad Pezeshki Sekouba Kaba Yoshua Bengio Aaron Courville Doina Precup Guillaume Lajoie MLT 50 258 0 18 Nov 2020
Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher Guangda Ji Zhanxing Zhu 59 42 0 20 Oct 2020
When and why PINNs fail to train: A neural tangent kernel perspective Sizhuang He Xinling Yu P. Perdikaris 33 880 0 28 Jul 2020
Frequency Bias in Neural Networks for Input of Non-Uniform Density Ronen Basri Meirav Galun Amnon Geifman David Jacobs Yoni Kasten S. Kritchman 42 183 0 10 Mar 2020
Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks Blake Bordelon Abdulkadir Canatar Cengiz Pehlevan 146 201 0 07 Feb 2020
Machine Learning from a Continuous Viewpoint E. Weinan Chao Ma Lei Wu 33 102 0 30 Dec 2019
Towards Understanding the Spectral Bias of Deep Learning Yuan Cao Zhiying Fang Yue Wu Ding-Xuan Zhou Quanquan Gu 41 215 0 03 Dec 2019
Multi-scale Deep Neural Networks for Solving High Dimensional PDEs Wei Cai Zhi-Qin John Xu AI4CE 19 38 0 25 Oct 2019
A Phase Shift Deep Neural Network for High Frequency Approximation and Wave Problems Wei Cai Xiaoguang Li Lizuo Liu 19 84 0 23 Sep 2019
DeepXDE: A deep learning library for solving differential equations Lu Lu Xuhui Meng Zhiping Mao George Karniadakis PINN AI4CE 52 1,489 0 10 Jul 2019
Theory of the Frequency Principle for General Deep Neural Networks Tao Luo Zheng Ma Zhi-Qin John Xu Yaoyu Zhang 26 78 0 21 Jun 2019
Explicitizing an Implicit Bias of the Frequency Principle in Two-layer Neural Networks Yaoyu Zhang Zhi-Qin John Xu Tao Luo Zheng Ma MLT AI4CE 36 38 0 24 May 2019
A type of generalization error induced by initialization in deep neural networks Yaoyu Zhang Zhi-Qin John Xu Tao Luo Zheng Ma 9 50 0 19 May 2019
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,892 0 15 Sep 2016