Frequency Bias in Neural Networks for Input of Non-Uniform Density

10 March 2020

Papers citing "Frequency Bias in Neural Networks for Input of Non-Uniform Density"

46 / 46 papers shown

Title
Transformer-Based Dual-Optical Attention Fusion Crowd Head Point Counting and Localization Network Fei Zhou Yi Li Mingqing Zhu 28 0 0 11 May 2025
Attention to Detail: Fine-Scale Feature Preservation-Oriented Geometric Pre-training for AI-Driven Surrogate Modeling Yu-Hsuan Chen Jing Bi Cyril Ngo Ngoc Victor Oancea Jonathan Cagan L. Kara AI4CE 31 0 0 27 Apr 2025
Corner Gradient Descent Dmitry Yarotsky 41 0 0 16 Apr 2025
TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problems Si-Yang Liu Han-Jia Ye 68 6 0 04 Feb 2025
SNeRV: Spectra-preserving Neural Representation for Video Jina Kim Jihoo Lee Je-Won Kang 43 3 0 03 Jan 2025
SHAP values via sparse Fourier representation Ali Gorji Andisheh Amrollahi A. Krause FAtt 38 0 0 08 Oct 2024
Fast Training of Sinusoidal Neural Fields via Scaling Initialization Taesun Yeom Sangyoon Lee Jaeho Lee 61 2 0 07 Oct 2024
Fourier PINNs: From Strong Boundary Conditions to Adaptive Fourier Bases Madison Cooley Varun Shankar Robert M. Kirby Shandian Zhe 32 2 0 04 Oct 2024
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu S. H. Lim Michael W. Mahoney N. Benjamin Erichson 47 3 0 02 Oct 2024
On the expressiveness and spectral bias of KANs Yixuan Wang Jonathan W. Siegel Ziming Liu Thomas Y. Hou 37 10 0 02 Oct 2024
LaDTalk: Latent Denoising for Synthesizing Talking Head Videos with High Frequency Details Jian Yang Xukun Wang Wentao Wang Guoming Li Qihang Fang Ruihong Yuan Tianyang Wang Jason Zhaoxin Fan Yeying Jin Zhaoxin Fan VGen 47 1 0 01 Oct 2024
Deep Learning without Global Optimization by Random Fourier Neural Networks Owen Davis Gianluca Geraci Mohammad Motamed BDL 60 0 0 16 Jul 2024
Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation Madison Cooley Shandian Zhe Robert M. Kirby Varun Shankar 59 1 0 04 Jun 2024
Spectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction Huan Chen Wangcai Zhao Tingfa Xu Shiyun Zhou Peifu Liu Jianan Li 53 20 0 02 Dec 2023
FreeU: Free Lunch in Diffusion U-Net Chenyang Si Ziqi Huang Yuming Jiang Ziwei Liu DiffM 51 132 0 20 Sep 2023
Double Descent of Discrepancy: A Task-, Data-, and Model-Agnostic Phenomenon Yi-Xiao Luo Bin Dong 26 0 0 25 May 2023
Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution Haoming Chen Yu-Syuan Xu Minui Hong Yi-Min Tsai Hsien-Kai Kuo Chun-Yi Lee OffRL 39 46 0 29 Mar 2023
Implicit neural representations for unsupervised super-resolution and denoising of 4D flow MRI S. Saitta M. Carioni Subhadip Mukherjee Carola-Bibiane Schönlieb A. Redaelli 18 9 0 24 Feb 2023
Understanding the Spectral Bias of Coordinate Based MLPs Via Training Dynamics J. Lazzari Xiuwen Liu 26 3 0 14 Jan 2023
Enhancing Neural Network Differential Equation Solvers Matthew J. H. Wright 21 0 0 28 Dec 2022
Generalizable Implicit Neural Representations via Instance Pattern Composers Chiheon Kim Doyup Lee Saehoon Kim Minsu Cho Wook-Shin Han AI4CE 20 24 0 23 Nov 2022
Characterizing the Spectrum of the NTK via a Power Series Expansion Michael Murray Hui Jin Benjamin Bowman Guido Montúfar 38 11 0 15 Nov 2022
What Can the Neural Tangent Kernel Tell Us About Adversarial Robustness? Nikolaos Tsilivis Julia Kempe AAML 44 17 0 11 Oct 2022
Implicit Full Waveform Inversion with Deep Neural Representation Jian Sun K. Innanen AI4CE 40 32 0 08 Sep 2022
On the Activation Function Dependence of the Spectral Bias of Neural Networks Q. Hong Jonathan W. Siegel Qinyan Tan Jinchao Xu 34 23 0 09 Aug 2022
Calibrate the inter-observer segmentation uncertainty via diagnosis-first principle Junde Wu Huihui Fang Hoayi Xiong Lixin Duan Mingkui Tan Weihua Yang Huiying Liu Yanwu Xu MedIm 46 1 0 05 Aug 2022
Momentum Diminishes the Effect of Spectral Bias in Physics-Informed Neural Networks G. Farhani Alexander Kazachek Boyu Wang 24 6 0 29 Jun 2022
Relaxing Equivariance Constraints with Non-stationary Continuous Filters Tycho F. A. van der Ouderaa David W. Romero Mark van der Wilk 24 33 0 14 Apr 2022
Exemplar-based Pattern Synthesis with Implicit Periodic Field Network Haiwei Chen Jiayi Liu Weikai Chen Shichen Liu Yajie Zhao 3DV GAN 24 5 0 04 Apr 2022
On the Spectral Bias of Convolutional Neural Tangent and Gaussian Process Kernels Amnon Geifman Meirav Galun David Jacobs Ronen Basri 30 13 0 17 Mar 2022
The Spectral Bias of Polynomial Neural Networks Moulik Choraria L. Dadi Grigorios G. Chrysos Julien Mairal V. Cevher 24 18 0 27 Feb 2022
Diffeomorphic Image Registration with Neural Velocity Field Kun Han Shanlin Sun Xiangyi Yan Chenyu You Hao Tang Junayed Naushad Haoyu Ma Deying Kong Xiaohui Xie MedIm 22 21 0 25 Feb 2022
Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions Maksim Velikanov Dmitry Yarotsky 9 6 0 02 Feb 2022
Overview frequency principle/spectral bias in deep learning Z. Xu Yaoyu Zhang Tao Luo FaML 33 66 0 19 Jan 2022
Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks Benjamin Bowman Guido Montúfar 28 11 0 12 Jan 2022
Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPs Sameera Ramasinghe Simon Lucey 22 119 0 30 Nov 2021
Understanding Layer-wise Contributions in Deep Neural Networks through Spectral Analysis Yatin Dandi Arthur Jacot FAtt 23 4 0 06 Nov 2021
Spectral Bias in Practice: The Role of Function Frequency in Generalization Sara Fridovich-Keil Raphael Gontijo-Lopes Rebecca Roelofs 41 28 0 06 Oct 2021
A Neural Tangent Kernel Perspective of GANs Jean-Yves Franceschi Emmanuel de Bézenac Ibrahim Ayed Mickaël Chen Sylvain Lamprier Patrick Gallinari 34 26 0 10 Jun 2021
COTR: Correspondence Transformer for Matching Across Images Wei Jiang Eduard Trulls J. Hosang Andrea Tagliasacchi K. M. Yi ViT 46 258 0 25 Mar 2021
Unsupervised part representation by Flow Capsules S. Sabour Andrea Tagliasacchi S. Yazdani Geoffrey E. Hinton David J. Fleet 3DPC OCL 30 37 0 27 Nov 2020
Spatial Frequency Bias in Convolutional Generative Adversarial Networks Mahyar Khayatkhoei Ahmed Elgammal GAN 21 45 0 04 Oct 2020
Deep Equals Shallow for ReLU Networks in Kernel Regimes A. Bietti Francis R. Bach 28 86 0 30 Sep 2020
When and why PINNs fail to train: A neural tangent kernel perspective Sizhuang He Xinling Yu P. Perdikaris 33 878 0 28 Jul 2020
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains Matthew Tancik Pratul P. Srinivasan B. Mildenhall Sara Fridovich-Keil N. Raghavan Utkarsh Singhal R. Ramamoorthi Jonathan T. Barron Ren Ng 60 2,344 0 18 Jun 2020
Towards Understanding the Spectral Bias of Deep Learning Yuan Cao Zhiying Fang Yue Wu Ding-Xuan Zhou Quanquan Gu 32 214 0 03 Dec 2019