v1v2 (latest)

STAF: Sinusoidal Trainable Activation Functions for Implicit Neural Representation

2 February 2025

Alireza Morsali

MohammadJavad Vaez

Mohammadhossein Soltani

Amirhossein Kazerouni

Babak Taati

Morteza Mohammad-Noori

Author Contacts:

alireza.morsali@mail.mcgill.ca mjvaez@ut.ac.ir mohammad.hossein19soltani@gmail.com amirhossein@cs.toronto.edu babak.taati@uhn.ca mmnoori@ut.ac.ir

ArXiv (abs)PDF HTML

Papers citing "STAF: Sinusoidal Trainable Activation Functions for Implicit Neural Representation"

36 / 36 papers shown

Title
LIFT: Latent Implicit Functions for Task- and Data-Agnostic Encoding Amirhossein Kazerouni Soroush Mehraban Michael Brudno Babak Taati 90 2 0 19 Mar 2025
Fourier Multi-Component and Multi-Layer Neural Networks: Unlocking High-Frequency Potential Shijun Zhang Hongkai Zhao Yimin Zhong Haomin Zhou 82 0 0 26 Feb 2025
How Far Can We Compress Instant-NGP-Based NeRF? Yihang Chen Qianyi Wu Mehrtash Harandi Jianfei Cai 60 18 0 06 Jun 2024
Chebyshev Polynomial-Based Kolmogorov-Arnold Networks: An Efficient Architecture for Nonlinear Function Approximation SS Sidharth Keerthana AR R. Gokul Anas KP 112 85 0 12 May 2024
KAN: Kolmogorov-Arnold Networks Ziming Liu Yixuan Wang Sachin Vaidya Fabian Ruehle James Halverson Marin Soljacic Thomas Y. Hou Max Tegmark 240 549 0 30 Apr 2024
NeRF-XL: Scaling NeRFs with Multiple GPUs Ruilong Li Sanja Fidler Angjoo Kanazawa Francis Williams 57 9 0 24 Apr 2024
FastSR-NeRF: Improving NeRF Efficiency on Consumer Devices with A Simple Super-Resolution Pipeline Chien-Yu Lin Qichen Fu Thomas Merth Karren D. Yang Anurag Ranjan 68 11 0 15 Dec 2023
FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functions Zhen Liu Hao Zhu Qi Zhang Jingde Fu Weibing Deng Zhan Ma Yanwen Guo Xun Cao 90 34 0 05 Dec 2023
NeRF Revisited: Fixing Quadrature Instability in Volume Rendering Mikaela Angelina Uy Kiyohiro Nakayama Guandao Yang Rahul Krishna Thomas Leonidas Guibas Ke Li 45 11 0 31 Oct 2023
INCODE: Implicit Neural Conditioning with Prior Knowledge Embeddings Amirhossein Kazerouni Reza Azad Alireza Hosseini Dorit Merhof Ulas Bagci AI4CE 73 20 0 28 Oct 2023
Learning Specialized Activation Functions for Physics-informed Neural Networks Honghui Wang Lu Lu Shiji Song Gao Huang PINN AI4CE 72 13 0 08 Aug 2023
Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields Jonathan T. Barron B. Mildenhall Dor Verbin Pratul P. Srinivasan Peter Hedman 45 504 0 13 Apr 2023
JacobiNeRF: NeRF Shaping with Mutual Information Gradients Xiaomeng Xu Yanchao Yang Kaichun Mo Boxiao Pan L. Yi Leonidas Guibas 66 10 0 01 Apr 2023
WIRE: Wavelet Implicit Neural Representations Vishwanath Saragadam Daniel LeJeune Jasper Tan Guha Balakrishnan Ashok Veeraraghavan Richard G. Baraniuk AI4CE 80 143 0 05 Jan 2023
Neural Tangent Kernel: A Survey Eugene Golikov Eduard Pokonechnyy Vladimir Korviakov 55 14 0 29 Aug 2022
A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel Mohamad Amin Mohamadi Wonho Bae Danica J. Sutherland AAML 75 28 0 25 Jun 2022
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding Thomas Müller Alex Evans Christoph Schied A. Keller 330 4,037 0 16 Jan 2022
A Structured Dictionary Perspective on Implicit Neural Representations Gizem Yüce Guillermo Ortiz-Jiménez Beril Besbinar P. Frossard 81 90 0 03 Dec 2021
Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPs Sameera Ramasinghe Simon Lucey 69 128 0 30 Nov 2021
Multi-Head ReLU Implicit Neural Representation Networks Arya Aftab Alireza Morsali 57 11 0 07 Oct 2021
Ensemble Neural Representation Networks Milad Soltany Kadarvish Hesam Mojtahedi Hossein Entezari Zarch Amirhossein Kazerouni Alireza Morsali Azra Abtahi F. Marvasti 64 6 0 07 Oct 2021
Reproducing Kernel Hilbert Space, Mercer's Theorem, Eigenfunctions, Nyström Method, and Use of Kernels in Machine Learning: Tutorial and Survey Benyamin Ghojogh A. Ghodsi Fakhri Karray Mark Crowley 58 36 0 15 Jun 2021
Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions Ameya Dilip Jagtap Yeonjong Shin Kenji Kawaguchi George Karniadakis ODL 81 134 0 20 May 2021
Modulated Periodic Activations for Generalizable Local Functional Representations Ishit Mehta Michael Gharbi Connelly Barnes Eli Shechtman R. Ramamoorthi Manmohan Chandraker 50 156 0 08 Apr 2021
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs Christian Reiser Songyou Peng Yiyi Liao Andreas Geiger 55 824 0 25 Mar 2021
Learning Continuous Image Representation with Local Implicit Image Function Yinbo Chen Sifei Liu Xiaolong Wang SSL SupR CLL 87 679 0 16 Dec 2020
When and why PINNs fail to train: A neural tangent kernel perspective Sizhuang He Xinling Yu P. Perdikaris 135 914 0 28 Jul 2020
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains Matthew Tancik Pratul P. Srinivasan B. Mildenhall Sara Fridovich-Keil N. Raghavan Utkarsh Singhal R. Ramamoorthi Jonathan T. Barron Ren Ng 124 2,421 0 18 Jun 2020
Implicit Neural Representations with Periodic Activation Functions Vincent Sitzmann Julien N. P. Martel Alexander W. Bergman David B. Lindell Gordon Wetzstein AI4TS 153 2,556 0 17 Jun 2020
Neural Tangents: Fast and Easy Infinite Neural Networks in Python Roman Novak Lechao Xiao Jiri Hron Jaehoon Lee Alexander A. Alemi Jascha Narain Sohl-Dickstein S. Schoenholz 73 229 0 05 Dec 2019
Occupancy Networks: Learning 3D Reconstruction in Function Space L. Mescheder Michael Oechsle Michael Niemeyer Sebastian Nowozin Andreas Geiger 3DV 246 2,899 0 10 Dec 2018
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min Lin Fred Hamprecht Yoshua Bengio Aaron Courville 152 1,451 0 22 Jun 2018
Neural Tangent Kernel: Convergence and Generalization in Neural Networks Arthur Jacot Franck Gabriel Clément Hongler 267 3,203 0 20 Jun 2018
Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning Stefan Elfwing E. Uchibe Kenji Doya 133 1,728 0 10 Feb 2017
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 172 5,011 0 27 Jun 2016
Deep Learning Face Attributes in the Wild Ziwei Liu Ping Luo Xiaogang Wang Xiaoou Tang CVBM 244 8,408 0 28 Nov 2014