On the Spectral Bias of Neural Networks

22 June 2018

Aaron Courville

Papers citing "On the Spectral Bias of Neural Networks"

50 / 264 papers shown

Title
JSover: Joint Spectrum Estimation and Multi-Material Decomposition from Single-Energy CT Projections Qing Wu Hongjiang Wei Jingyi Yu S. Kevin Zhou Yuyao Zhang 24 0 0 12 May 2025
Transformer-Based Dual-Optical Attention Fusion Crowd Head Point Counting and Localization Network Fei Zhou Yi Li Mingqing Zhu 28 0 0 11 May 2025
Physics-informed solution reconstruction in elasticity and heat transfer using the explicit constraint force method Conor Rowan K. Maute Alireza Doostan AI4CE 45 0 0 08 May 2025
How to Train Your Metamorphic Deep Neural Network Thomas Sommariva Simone Calderara Angelo Porrello 28 0 0 07 May 2025
Attention to Detail: Fine-Scale Feature Preservation-Oriented Geometric Pre-training for AI-Driven Surrogate Modeling Yu-Hsuan Chen Jing Bi Cyril Ngo Ngoc Victor Oancea Jonathan Cagan L. Kara AI4CE 31 0 0 27 Apr 2025
QFGN: A Quantum Approach to High-Fidelity Implicit Neural Representations Hongni Jin Gurinder Singh Kenneth M. Merz Jr 41 0 0 26 Apr 2025
Physics-Driven Neural Compensation For Electrical Impedance Tomography Chuyu Wang Huiting Deng Dong Liu 22 0 0 25 Apr 2025
Spectral Bias Correction in PINNs for Myocardial Image Registration of Pathological Data Bastien C. Baluyot Marta Varela Chen Qin 23 0 0 24 Apr 2025
Frequency-Compensated Network for Daily Arctic Sea Ice Concentration Prediction Jialiang Zhang Feng Gao Yanhai Gan Junyu Dong Q. Du 26 0 0 23 Apr 2025
Hadamard product in deep learning: Introduction, Advances and Challenges Grigorios G. Chrysos Yongtao Wu Razvan Pascanu Philip Torr V. Cevher AAML 98 0 0 17 Apr 2025
Generalization through variance: how noise shapes inductive biases in diffusion models John J. Vastola DiffM 164 1 0 16 Apr 2025
Single View Garment Reconstruction Using Diffusion Mapping Via Pattern Coordinates Ren Li Cong Cao Corentin Dumery Yingxuan You Hao Li Pascal Fua DiffM 3DH 38 0 0 11 Apr 2025
InstantSticker: Realistic Decal Blending via Disentangled Object Reconstruction Yi Zhang Xiaoyang Huang Yishun Dou Yue Shi Rui Shi Ye Chen Bingbing Ni Wenjun Zhang 33 0 0 09 Apr 2025
FANeRV: Frequency Separation and Augmentation based Neural Representation for Video Li Yu Zhihui Li Chao Yao Jimin Xiao Moncef Gabbouj 35 0 0 09 Apr 2025
Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Exploration Yi-Tang Chen Haoyu Li Neng Shi Xihaier Luo Wei-ping Xu Han-Wei Shen 44 0 0 01 Apr 2025
Mitigating Spectral Bias in Neural Operators via High-Frequency Scaling for Physical Systems Siavash Khodakarami Vivek Oommen Aniruddha Bora George Karniadakis AI4CE 65 2 0 17 Mar 2025
FREAK: Frequency-modulated High-fidelity and Real-time Audio-driven Talking Portrait Synthesis Ziqi Ni Ao Fu Yi Zhou 61 0 0 06 Mar 2025
Towards Lossless Implicit Neural Representation via Bit Plane Decomposition Woo Kyoung Han Byeonghun Lee Hyunmin Cho Sunghoon Im Kyong Hwan Jin MQ 147 0 0 28 Feb 2025
Neural Augmentation Based Panoramic High Dynamic Range Stitching Chaobing Zheng Yilun Xu Weihai Chen Shiqian Wu Sen Zhang Zhengguo Li 86 0 0 24 Feb 2025
A distributional simplicity bias in the learning dynamics of transformers Riccardo Rende Federica Gerace A. Laio Sebastian Goldt 79 8 0 17 Feb 2025
EEG Artifact Detection and Correction with Deep Autoencoders David Aquilué-Llorens Aureli Soria-Frisch 45 0 0 12 Feb 2025
ViSIR: Vision Transformer Single Image Reconstruction Method for Earth System Models Ehsan Zeraatkar Salah Faroughi Jelena Tešić 118 0 0 10 Feb 2025
STAF: Sinusoidal Trainable Activation Functions for Implicit Neural Representation Alireza Morsali MohammadJavad Vaez Hossein Soltani A. Kazerouni Babak Taati Morteza Mohammad-Noori 138 1 0 02 Feb 2025
A theoretical framework for overfitting in energy-based modeling Giovanni Catania A. Decelle Cyril Furtlehner Beatriz Seoane 57 2 0 31 Jan 2025
Solving Infinite-Player Games with Player-to-Strategy Networks Carlos Martin T. Sandholm 54 0 0 17 Jan 2025
SafeSplit: A Novel Defense Against Client-Side Backdoor Attacks in Split Learning (Full Version) Phillip Rieger Alessandro Pegoraro Kavita Kumari Tigist Abera Jonathan Knauer A. Sadeghi AAML 48 2 0 11 Jan 2025
Enhancing Implicit Neural Representations via Symmetric Power Transformation Weixiang Zhang Shuzhao Xie Chengwei Ren Shijia Ge Mingzi Wang Zhi Wang 79 2 0 12 Dec 2024
Black Swan: Abductive and Defeasible Video Reasoning in Unpredictable Events Aditya Chinchure Sahithya Ravi R. Ng Vered Shwartz Boyang Albert Li Leonid Sigal ReLM LRM VLM 77 2 0 07 Dec 2024
TSINR: Capturing Temporal Continuity via Implicit Neural Representations for Time Series Anomaly Detection Mengxuan Li Ke Liu Hongyang Chen Jiajun Bu Hongwei Wang Haishuai Wang AI4TS 96 1 0 18 Nov 2024
Continuous K-space Recovery Network with Image Guidance for Fast MRI Reconstruction Yucong Meng Zhiwei Yang Minghong Duan Yonghong Shi Zhijian Song 44 1 0 18 Nov 2024
SIGMA: Single Interpolated Generative Model for Anomalies Ranit Das David Shih DiffM 35 2 0 27 Oct 2024
Ensemble-based, large-eddy reconstruction of wind turbine inflow in a near-stationary atmospheric boundary layer through generative artificial intelligence A. Rybchuk Luis A. Martínez-Tossas Stefano Letizia N. Hamilton Andy Scholbrock Emina Maric Daniel R. Houck Thomas G. Herges Nathaniel B. de Velder P. Doubrawa AI4CE 30 0 0 17 Oct 2024
Transfer Learning on Multi-Dimensional Data: A Novel Approach to Neural Network-Based Surrogate Modeling Adrienne M. Propp Daniel M. Tartakovsky AI4CE 28 2 0 16 Oct 2024
SHAP values via sparse Fourier representation Ali Gorji Andisheh Amrollahi A. Krause FAtt 35 0 0 08 Oct 2024
H-SIREN: Improving implicit neural representations with hyperbolic periodic functions Rui Gao R. Jaiman AI4CE 31 2 0 07 Oct 2024
Fast Training of Sinusoidal Neural Fields via Scaling Initialization Taesun Yeom Sangyoon Lee Jaeho Lee 55 2 0 07 Oct 2024
Sinc Kolmogorov-Arnold Network and Its Applications on Physics-informed Neural Networks Tianchi Yu Jingwei Qiu Jiang Yang Ivan V. Oseledets 26 2 0 05 Oct 2024
Fourier PINNs: From Strong Boundary Conditions to Adaptive Fourier Bases Madison Cooley Varun Shankar Robert M. Kirby Shandian Zhe 24 2 0 04 Oct 2024
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu S. H. Lim Michael W. Mahoney N. Benjamin Erichson 42 3 0 02 Oct 2024
On the expressiveness and spectral bias of KANs Yixuan Wang Jonathan W. Siegel Ziming Liu Thomas Y. Hou 37 10 0 02 Oct 2024
LaDTalk: Latent Denoising for Synthesizing Talking Head Videos with High Frequency Details Jian Yang Xukun Wang Wentao Wang Guoming Li Qihang Fang Ruihong Yuan Tianyang Wang Jason Zhaoxin Fan Yeying Jin Zhaoxin Fan VGen 47 1 0 01 Oct 2024
Scientific Machine Learning Seismology Tomohisa Okazaki PINN AI4CE 48 0 0 27 Sep 2024
Moner: Motion Correction in Undersampled Radial MRI with Unsupervised Neural Representation Qing Wu Chenhe Du Xuanyu Tian Jingyi Yu Yuyao Zhang Hongjiang Wei 36 0 0 25 Sep 2024
Co-occurrence is not Factual Association in Language Models Xiao Zhang Miao Li Ji Wu KELM 68 2 0 21 Sep 2024
Implicit Neural Representations with Fourier Kolmogorov-Arnold Networks Ali Mehrabian Parsa Mojarad Adi Moein Heidari I. Hacihaliloglu 38 3 0 14 Sep 2024
Spectrum-Informed Multistage Neural Networks: Multiscale Function Approximators of Machine Precision Jakin Ng Yongjian Wang Ching-Yao Lai 38 1 0 24 Jul 2024
DC is all you need: describing ReLU from a signal processing standpoint Christodoulos Kechris Jonathan Dan Jose Miranda David Atienza 36 1 0 23 Jul 2024
Attention Beats Linear for Fast Implicit Neural Representation Generation Shuyi Zhang Ke Liu Jingjun Gu Xiaoxu Cai Zhihua Wang Jiajun Bu Haishuai Wang 45 2 0 22 Jul 2024
Many Perception Tasks are Highly Redundant Functions of their Input Data Rahul Ramesh Anthony Bisulco Ronald W. DiTullio Linran Wei Vijay Balasubramanian Kostas Daniilidis Pratik Chaudhari 41 2 0 18 Jul 2024
Deep Learning without Global Optimization by Random Fourier Neural Networks Owen Davis Gianluca Geraci Mohammad Motamed BDL 60 0 0 16 Jul 2024