On the Spectral Bias of Neural Networks

22 June 2018

Aaron Courville

Papers citing "On the Spectral Bias of Neural Networks"

50 / 269 papers shown

Title
Implicit Full Waveform Inversion with Deep Neural Representation Jian Sun K. Innanen AI4CE 40 32 0 08 Sep 2022
Neural Novel Actor: Learning a Generalized Animatable Neural Representation for Human Actors Yiming Wang Qingzhe Gao Libin Liu Lingjie Liu Christian Theobalt B. Chen 3DH 30 23 0 25 Aug 2022
Semi-analytic PINN methods for singularly perturbed boundary value problems G. Gie Youngjoon Hong Chang-Yeol Jung PINN 8 5 0 19 Aug 2022
Wavelet Score-Based Generative Modeling Florentin Guth Simon Coste Valentin De Bortoli S. Mallat DiffM 24 52 0 09 Aug 2022
On the Activation Function Dependence of the Spectral Bias of Neural Networks Q. Hong Jonathan W. Siegel Qinyan Tan Jinchao Xu 34 23 0 09 Aug 2022
Calibrate the inter-observer segmentation uncertainty via diagnosis-first principle Junde Wu Huihui Fang Hoayi Xiong Lixin Duan Mingkui Tan Weihua Yang Huiying Liu Yanwu Xu MedIm 46 1 0 05 Aug 2022
Explicit Use of Fourier Spectrum in Generative Adversarial Networks Soroush Sheikh Gargar GAN OOD 29 0 0 02 Aug 2022
Unsupervised Legendre-Galerkin Neural Network for Singularly Perturbed Partial Differential Equations Junho Choi N. Kim Youngjoon Hong AI4CE 24 0 0 21 Jul 2022
Streamable Neural Fields Junwoo Cho Seungtae Nam Daniel Rho J. Ko Eunbyung Park AI4TS 27 17 0 20 Jul 2022
Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit Boaz Barak Benjamin L. Edelman Surbhi Goel Sham Kakade Eran Malach Cyril Zhang 36 123 0 18 Jul 2022
Why do tree-based models still outperform deep learning on tabular data? Léo Grinsztajn Edouard Oyallon Gaël Varoquaux LMTD 35 356 0 18 Jul 2022
Neural apparent BRDF fields for multiview photometric stereo Meghna Asthana W. Smith P. Huber 14 5 0 14 Jul 2022
Stabilizing Off-Policy Deep Reinforcement Learning from Pixels Edoardo Cetin Philip J. Ball Steve Roberts Oya Celiktutan 30 36 0 03 Jul 2022
Lagrangian Density Space-Time Deep Neural Network Topology B. Bishnoi PINN 22 1 0 30 Jun 2022
Momentum Diminishes the Effect of Spectral Bias in Physics-Informed Neural Networks G. Farhani Alexander Kazachek Boyu Wang 21 6 0 29 Jun 2022
Learning Implicit Feature Alignment Function for Semantic Segmentation Hanzhe Hu Yinbo Chen Jiarui Xu Shubhankar Borse H. Cai Fatih Porikli Xinyu Wang 33 47 0 17 Jun 2022
Overcoming the Spectral Bias of Neural Value Approximation Ge Yang Anurag Ajay Pulkit Agrawal 34 25 0 09 Jun 2022
Explaining the physics of transfer learning a data-driven subgrid-scale closure to a different turbulent flow Adam Subel Yifei Guan A. Chattopadhyay P. Hassanzadeh AI4CE 29 41 0 07 Jun 2022
What do CNNs Learn in the First Layer and Why? A Linear Systems Perspective Rhea Chowers Yair Weiss 33 2 0 06 Jun 2022
A Neural Network Approach for Homogenization of Multiscale Problems Jihun Han Yoonsang Lee 35 13 0 04 Jun 2022
Points2NeRF: Generating Neural Radiance Fields from 3D point cloud D. Zimny Joanna Waczyñska Tomasz Trzciñski P. Spurek 32 18 0 02 Jun 2022
Trading Positional Complexity vs. Deepness in Coordinate Networks Jianqiao Zheng Sameera Ramasinghe Xueqian Li Simon Lucey 28 18 0 18 May 2022
Sobolev Acceleration and Statistical Optimality for Learning Elliptic Equations via Gradient Descent Yiping Lu Jose H. Blanchet Lexing Ying 38 7 0 15 May 2022
FRC-TOuNN: Topology Optimization of Continuous Fiber Reinforced Composites using Neural Network A. Chandrasekhar Amir M. Mirzendehdel M. Behandish K. Suresh 31 29 0 07 May 2022
Relaxing Equivariance Constraints with Non-stationary Continuous Filters Tycho F. A. van der Ouderaa David W. Romero Mark van der Wilk 24 33 0 14 Apr 2022
GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimation Shin-Fang Chng Sameera Ramasinghe Jamie Sherrah Simon Lucey AI4CE 24 86 0 12 Apr 2022
Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations Polina Kirichenko Pavel Izmailov A. Wilson OOD 49 318 0 06 Apr 2022
InstaFormer: Instance-Aware Image-to-Image Translation with Transformer Soohyun Kim Jongbeom Baek Jihye Park Gyeongnyeon Kim Seung Wook Kim ViT 39 47 0 30 Mar 2022
On Embeddings for Numerical Features in Tabular Deep Learning Yura Gorishniy Ivan Rubachev Artem Babenko LMTD 13 156 0 10 Mar 2022
HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging Xiaowan Hu Yuanhao Cai Jing Lin Haoqian Wang X. Yuan Yulun Zhang Radu Timofte Luc Van Gool 37 134 0 04 Mar 2022
The Spectral Bias of Polynomial Neural Networks Moulik Choraria L. Dadi Grigorios G. Chrysos Julien Mairal V. Cevher 24 18 0 27 Feb 2022
Diffeomorphic Image Registration with Neural Velocity Field Kun Han Shanlin Sun Xiangyi Yan Chenyu You Hao Tang Junayed Naushad Haoyu Ma Deying Kong Xiaohui Xie MedIm 22 21 0 25 Feb 2022
Physics-informed neural networks for solving parametric magnetostatic problems Andrés Beltrán-Pulido Ilias Bilionis D. Aliprantis 27 34 0 08 Feb 2022
SPAGHETTI: Editing Implicit Shapes Through Part Aware Generation Amir Hertz Or Perel Raja Giryes O. Sorkine-Hornung Daniel Cohen-Or 33 26 0 31 Jan 2022
Neural Implicit Mapping via Nested Neighborhoods V. Silva Tiago Novello Guilherme Gonçalves Schardong L. Schirmer Helio Lopes Luiz Velho 60 3 0 22 Jan 2022
Stitch it in Time: GAN-Based Facial Editing of Real Videos Rotem Tzaban Ron Mokady Rinon Gal Amit H. Bermano Daniel Cohen-Or CVBM 30 86 0 20 Jan 2022
Simpler is better: spectral regularization and up-sampling techniques for variational autoencoders Sara Bjork Jonas Nordhaug Myhre T. Johansen DRL 42 5 0 19 Jan 2022
Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks Benjamin Bowman Guido Montúfar 23 11 0 12 Jan 2022
A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning S. Zhang Jieyu Lin Qi Zhang 35 63 0 09 Jan 2022
Learning Positional Embeddings for Coordinate-MLPs Sameera Ramasinghe Simon Lucey 27 10 0 21 Dec 2021
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 205 351 0 06 Dec 2021
Multi-scale Feature Learning Dynamics: Insights for Double Descent Mohammad Pezeshki Amartya Mitra Yoshua Bengio Guillaume Lajoie 61 25 0 06 Dec 2021
A Structured Dictionary Perspective on Implicit Neural Representations Gizem Yüce Guillermo Ortiz-Jiménez Beril Besbinar P. Frossard 31 86 0 03 Dec 2021
Hierarchical Learning to Solve Partial Differential Equations Using Physics-Informed Neural Networks Jihun Han Yoonsang Lee AI4CE 24 10 0 02 Dec 2021
Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPs Sameera Ramasinghe Simon Lucey 16 119 0 30 Nov 2021
ISNAS-DIP: Image-Specific Neural Architecture Search for Deep Image Prior Metin Ersin Arican Ozgur Kara G. Bredell E. Konukoglu 30 17 0 27 Nov 2021
Neural Fields in Visual Computing and Beyond Yiheng Xie Towaki Takikawa Shunsuke Saito Or Litany Shiqin Yan Numair Khan Federico Tombari James Tompkin Vincent Sitzmann Srinath Sridhar 3DH 49 615 0 22 Nov 2021
PointMixer: MLP-Mixer for Point Cloud Understanding Jaesung Choe Chunghyun Park François Rameau Jaesik Park In So Kweon 3DPC 42 98 0 22 Nov 2021
Towards Lightweight Controllable Audio Synthesis with Conditional Implicit Neural Representations Jan Zuiderveld Marco Federici Erik J. Bekkers AI4CE 29 6 0 14 Nov 2021
$Frequency learning for structured CNN filters with Gaussian fractional derivatives$ Frequency learning for structured CNN filters with Gaussian fractional derivatives Nikhil Saldanha S. Pintea J. C. V. Gemert Nergis Tomen 30 8 0 12 Nov 2021