On the Spectral Bias of Neural Networks

22 June 2018

Aaron Courville

Papers citing "On the Spectral Bias of Neural Networks"

50 / 268 papers shown

Title
Frequency and Generalisation of Periodic Activation Functions in Reinforcement Learning Augustine N. Mavor-Parker Matthew J. Sargent Caswell Barry Lewis D. Griffin Clare Lyle 42 2 0 09 Jul 2024
Exploring Cross-Domain Few-Shot Classification via Frequency-Aware Prompting Tiange Zhang Qing Cai Feng Gao Lin Qi Junyu Dong 42 1 0 24 Jun 2024
An Advanced Physics-Informed Neural Operator for Comprehensive Design Optimization of Highly-Nonlinear Systems: An Aerospace Composites Processing Case Study Milad Ramezankhani A. Deodhar Rishi Parekh Dagnachew Birru AI4CE 47 3 0 20 Jun 2024
Model-based learning for multi-antenna multi-frequency location-to-channel mapping Baptiste Chatelier Vincent Corlay M. Crussiére Luc Le Magoarou 31 1 0 17 Jun 2024
Fredformer: Frequency Debiased Transformer for Time Series Forecasting Xihao Piao Zheng Chen Taichi Murayama Yasuko Matsubara Yasushi Sakurai AI4TS 48 17 0 13 Jun 2024
Grounding Continuous Representations in Geometry: Equivariant Neural Fields David R. Wessels David M. Knigge Samuele Papa Riccardo Valperga Sharvaree P. Vadgama E. Gavves Erik J. Bekkers 47 7 0 09 Jun 2024
Quantum Implicit Neural Representations Jiaming Zhao Wenbo Qiao Peng Zhang Hui Gao 55 3 0 06 Jun 2024
Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation Madison Cooley Shandian Zhe Robert M. Kirby Varun Shankar 59 1 0 04 Jun 2024
Physics informed cell representations for variational formulation of multiscale problems Yuxiang Gao Soheil Kolouri R. Duddu AI4CE 32 0 0 27 May 2024
Learned feature representations are biased by complexity, learning order, position, and more Andrew Kyle Lampinen Stephanie C. Y. Chan Katherine Hermann AI4CE FaML SSL OOD 34 6 0 09 May 2024
BANF: Band-limited Neural Fields for Levels of Detail Reconstruction Ahan Shabanov Shrisudhan Govindarajan Cody Reading Lily Goli Daniel Rebain Kwang Moo Yi Andrea Tagliasacchi 37 5 0 19 Apr 2024
O2V-Mapping: Online Open-Vocabulary Mapping with Neural Implicit Representation Muer Tie Julong Wei Zhengjun Wang Ke Wu Shansuai Yuan Kaizhao Zhang Jie Jia Jieru Zhao Zhongxue Gan Wenchao Ding 40 7 0 10 Apr 2024
Federated Multi-Agent Mapping for Planetary Exploration Tiberiu-Ioan Szatmari Abhishek Cauligi FedML AI4CE 39 0 0 02 Apr 2024
SketchINR: A First Look into Sketches as Implicit Neural Representations Hmrishav Bandyopadhyay A. Bhunia Pinaki Nath Chowdhury Aneeshan Sain Tao Xiang Timothy M. Hospedales Yi-Zhe Song SSL 26 9 0 14 Mar 2024
Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations GuanWen Qiu Da Kuang Surbhi Goel 27 8 0 05 Mar 2024
Neural Redshift: Random Networks are not Random Functions Damien Teney A. Nicolicioiu Valentin Hartmann Ehsan Abbasnejad 103 18 0 04 Mar 2024
Learning to See Through Dazzle Xiaopeng Peng Erin F. Fleet A. Watnik Grover A. Swartzlander GAN AAML 32 4 0 24 Feb 2024
The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks Andrea Bonfanti Giuseppe Bruno Cristina Cipriani 32 7 0 06 Feb 2024
Hybrid Neural Representations for Spherical Data Hyomin Kim Yunhui Jang Jaeho Lee Sungsoo Ahn 38 3 0 05 Feb 2024
Rethinking RGB Color Representation for Image Restoration Models Jaerin Lee J. Park Sungyong Baik Kyoung Mu Lee 24 1 0 05 Feb 2024
Architectural Strategies for the optimization of Physics-Informed Neural Networks Hemanth Saratchandran Shin-Fang Chng Simon Lucey AI4CE 36 0 0 05 Feb 2024
Positional Encoding Helps Recurrent Neural Networks Handle a Large Vocabulary Takashi Morita 16 3 0 31 Jan 2024
Spectral Co-Distillation for Personalized Federated Learning Zihan Chen Howard H. Yang Tony Q. S. Quek Kai Fong Ernest Chong OOD FedML 29 13 0 29 Jan 2024
Dream360: Diverse and Immersive Outdoor Virtual Scene Creation via Transformer-Based 360 Image Outpainting Hao Ai Zidong Cao H. Lu Chen Chen Jiancang Ma Pengyuan Zhou Tae-Kyun Kim Pan Hui Lin Wang 40 3 0 19 Jan 2024
Physics-Informed Neural Networks for High-Frequency and Multi-Scale Problems using Transfer Learning Abdul Hannan Mustajab Hao Lyu Z. Rizvi Frank Wuttke AI4CE PINN 20 9 0 05 Jan 2024
Exploring 3D-aware Lifespan Face Aging via Disentangled Shape-Texture Representations Qianrui Teng Rui Wang Xing Cui Peipei Li Zhaofeng He 30 3 0 28 Dec 2023
Machine learning and domain decomposition methods -- a survey A. Klawonn M. Lanser J. Weber AI4CE 21 7 0 21 Dec 2023
Inferring Hybrid Neural Fluid Fields from Videos Hong-Xing Yu Yang Zheng Yuan Gao Yitong Deng Bo Zhu Jiajun Wu 3DH 29 15 0 11 Dec 2023
Spectral-wise Implicit Neural Representation for Hyperspectral Image Reconstruction Huan Chen Wangcai Zhao Tingfa Xu Shiyun Zhou Peifu Liu Jianan Li 50 20 0 02 Dec 2023
In Search of a Data Transformation That Accelerates Neural Field Training Junwon Seo Sangyoon Lee Kwang In Kim Jaeho Lee 41 3 0 28 Nov 2023
IMJENSE: Scan-specific Implicit Representation for Joint Coil Sensitivity and Image Estimation in Parallel MRI Rui-jun Feng Qing Wu Jie Feng Huajun She Chunlei Liu Yuyao Zhang Hongjiang Wei 23 23 0 21 Nov 2023
Frequency Domain-based Dataset Distillation DongHyeok Shin Seungjae Shin Il-Chul Moon DD 35 19 0 15 Nov 2023
Towards stable real-world equation discovery with assessing differentiating quality influence Mikhail Masliaev Ilya Markov Alexander Hvatov 22 0 0 09 Nov 2023
Closed-Form Diffusion Models Christopher Scarvelis Haitz Sáez de Ocáriz Borde Justin Solomon DiffM 95 9 0 19 Oct 2023
Hypernetwork-based Meta-Learning for Low-Rank Physics-Informed Neural Networks Woojin Cho Kookjin Lee Donsub Rim Noseong Park AI4CE PINN 37 16 0 14 Oct 2023
Investigating the Ability of PINNs To Solve Burgers' PDE Near Finite-Time BlowUp Dibyakanti Kumar Anirbit Mukherjee 31 2 0 08 Oct 2023
Local Positional Encoding for Multi-Layer Perceptrons S. Fujieda A. Yoshimura Takahiro Harada 21 1 0 26 Sep 2023
Reconstruct-and-Generate Diffusion Model for Detail-Preserving Image Denoising Yujin Wang Lingen Li Tianfan Xue Liang Feng DiffM 27 4 0 19 Sep 2023
CoNeS: Conditional neural fields with shift modulation for multi-sequence MRI translation Yunjie Chen Marius Staring O. M. Neve Stephan R. Romeijn Erik F. Hensen Berit M. Verbist J. Wolterink Qian Tao DiffM MedIm 22 3 0 06 Sep 2023
Frequency Compensated Diffusion Model for Real-scene Dehazing Jing Wang Songtao Wu Kuanhong Xu Zhiqiang Yuan DiffM 29 26 0 21 Aug 2023
Real-time Light Estimation and Neural Soft Shadows for AR Indoor Scenarios Alexander Sommer Ulrich Schwanecke E. Schoemer 3DH 30 0 0 03 Aug 2023
Mitigating the Learning Bias towards Repetition by Self-Contrastive Training for Open-Ended Generation Jian-Yu Guan Minlie Huang 26 0 0 04 Jul 2023
VIBR: Learning View-Invariant Value Functions for Robust Visual Control Tom Dupuis Jaonary Rabarisoa Q. C. Pham David Filliat 36 0 0 14 Jun 2023
Neural Ideal Large Eddy Simulation: Modeling Turbulence with Neural Stochastic Differential Equations Anudhyan Boral Z. Y. Wan Leonardo Zepeda-Núnez James Lottes Qing Wang Yi-fan Chen John R. Anderson Fei Sha AI4CE PINN 27 11 0 01 Jun 2023
Double Descent of Discrepancy: A Task-, Data-, and Model-Agnostic Phenomenon Yi-Xiao Luo Bin Dong 26 0 0 25 May 2023
Empirical Analysis of the Inductive Bias of Recurrent Neural Networks by Discrete Fourier Transform of Output Sequences Taiga Ishii Ryo Ueda Yusuke Miyao 21 0 0 16 May 2023
Do deep neural networks have an inbuilt Occam's razor? Chris Mingard Henry Rees Guillermo Valle Pérez A. Louis UQCV BDL 21 16 0 13 Apr 2023
Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolution Tingting Liu Yuan Liu Chun-liang Zhang Liyin Yuan Xiubao Sui Qian Chen SupR 21 18 0 10 Apr 2023
NeRF applied to satellite imagery for surface reconstruction Federico Semeraro Yi Zhang Wen-Hao Wu P. Carroll DiffM 11 0 0 09 Apr 2023
Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution Haoming Chen Yu-Syuan Xu Minui Hong Yi-Min Tsai Hsien-Kai Kuo Chun-Yi Lee OffRL 39 46 0 29 Mar 2023