Neural Network with Unbounded Activation Functions is Universal Approximator

14 May 2015

Papers citing "Neural Network with Unbounded Activation Functions is Universal Approximator"

50 / 109 papers shown

Title
Interpreting Deep Neural Network-Based Receiver Under Varying Signal-To-Noise Ratios Marko Tuononen Dani Korpi Ville Hautamäki FAtt 41 2 0 10 Jan 2025
Universal approximation property of ODENet and ResNet with a single activation function M. Kimura Kazunori Matsui Yosuke Mizuno 28 0 0 22 Oct 2024
Universal approximation results for neural networks with non-polynomial activation function over non-compact domains Ariel Neufeld Philipp Schmocker 28 2 0 18 Oct 2024
Nonuniform random feature models using derivative information Konstantin Pieper Zezhong Zhang Guannan Zhang 14 2 0 03 Oct 2024
Disentangling Latent Shifts of In-Context Learning Through Self-Training Josip Jukić Jan Snajder 21 0 0 02 Oct 2024
Decomposition of Equivariant Maps via Invariant Maps: Application to Universal Approximation under Symmetry Akiyoshi Sannai Yuuki Takai Matthieu Cordonnier 246 0 0 25 Sep 2024
Aspects of importance sampling in parameter selection for neural networks using ridgelet transform Hikaru Homma Jun Ohkubo 24 0 0 26 Jul 2024
On the Complexity of Learning Sparse Functions with Statistical and Gradient Queries Nirmit Joshi Theodor Misiakiewicz Nathan Srebro 35 6 0 08 Jul 2024
From Robustness to Improved Generalization and Calibration in Pre-trained Language Models Josip Jukić Jan Snajder 40 0 0 31 Mar 2024
Approximation with Random Shallow ReLU Networks with Applications to Model Reference Adaptive Control Andrew G. Lamperski Tyler Lekang 35 3 0 25 Mar 2024
Neural Fractional Differential Equations C. Coelho M. F. P. Costa L. L. Ferrás 16 1 0 05 Mar 2024
A unified Fourier slice method to derive ridgelet transform for a variety of depth-2 neural networks Sho Sonoda Isao Ishikawa Masahiro Ikeda 49 4 0 25 Feb 2024
Analytical Verification of Performance of Deep Neural Network Based Time-Synchronized Distribution System State Estimation Behrouz Azimian Shiva Moshtagh Anamitra Pal Shanshan Ma 18 4 0 12 Nov 2023
Piecewise Linear Functions Representable with Infinite Width Shallow ReLU Neural Networks Sarah McCarty 10 1 0 25 Jul 2023
Out-of-Distribution Optimality of Invariant Risk Minimization S. Toyota Kenji Fukumizu OOD 15 1 0 22 Jul 2023
The Implicit Bias of Minima Stability in Multivariate Shallow ReLU Networks Mor Shpigel Nacson Rotem Mulayoff Greg Ongie T. Michaeli Daniel Soudry 20 12 0 30 Jun 2023
Universal approximation with complex-valued deep narrow neural networks Paul Geuchen Thomas Jahn Hannes Matt 18 3 0 26 May 2023
Improving Classification Neural Networks by using Absolute activation function (MNIST/LeNET-5 example) Oleg I.Berngardt 24 2 0 23 Apr 2023
Quantum Ridgelet Transform: Winning Lottery Ticket of Neural Networks with Quantum Computation H. Yamasaki Sathyawageeswar Subramanian Satoshi Hayakawa Sho Sonoda MLT 30 4 0 27 Jan 2023
Noncommutative $C^$ -algebra Net: Learning Neural Networks with Powerful Product Structure in $C^$ -algebra Ryuichiro Hataya Yuka Hashimoto 47 4 0 26 Jan 2023
Towards Global Neural Network Abstractions with Locally-Exact Reconstruction Edoardo Manino I. Bessa Lucas C. Cordeiro 21 1 0 21 Oct 2022
Optimization-Informed Neural Networks Da-Lin Wu A. Lisser 27 0 0 05 Oct 2022
Information Removal at the bottleneck in Deep Neural Networks Enzo Tartaglione 51 2 0 30 Sep 2022
Deep Reinforcement Learning for Adaptive Mesh Refinement C. Foucart A. Charous Pierre FJ Lermusiaux AI4CE 44 22 0 25 Sep 2022
Relational Reasoning via Set Transformers: Provable Efficiency and Applications to MARL Fengzhuo Zhang Boyi Liu Kaixin Wang Vincent Y. F. Tan Zhuoran Yang Zhaoran Wang OffRL LRM 51 10 0 20 Sep 2022
The (Un)Scalability of Heuristic Approximators for NP-Hard Search Problems Sumedh Pendurkar Taoan Huang Sven Koenig Guni Sharon 28 1 0 07 Sep 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directions Ameya Dilip Jagtap George Karniadakis AI4CE 37 71 0 06 Sep 2022
A Feedforward Unitary Equivariant Neural Network P. Ma Terence Chan 34 4 0 25 Aug 2022
Disentangling private classes through regularization Enzo Tartaglione F. Gennari Marco Grangetto AILaw 6 4 0 05 Jul 2022
LaTeRF: Label and Text Driven Object Radiance Fields Ashkan Mirzaei Yash Kant Jonathan Kelly Igor Gilitschenski 30 36 0 04 Jul 2022
From Kernel Methods to Neural Networks: A Unifying Variational Formulation M. Unser 48 7 0 29 Jun 2022
$C^$ -algebra Net: A New Approach Generalizing Neural Network Parameters to $C^$ -algebra Yuka Hashimoto Zhao Wang Tomoko Matsui 22 8 0 20 Jun 2022
Universality of Group Convolutional Neural Networks Based on Ridgelet Analysis on Groups Sho Sonoda Isao Ishikawa Masahiro Ikeda 30 9 0 30 May 2022
Nonparametric Value-at-Risk via Sieve Estimation Philipp Ratz 13 0 0 14 May 2022
Fully-Connected Network on Noncompact Symmetric Space and Ridgelet Transform based on Helgason-Fourier Analysis Sho Sonoda Isao Ishikawa Masahiro Ikeda 21 15 0 03 Mar 2022
L4KDE: Learning for KinoDynamic Tree Expansion Tin Lai Weiming Zhi Tucker Hermans Fabio Ramos 28 2 0 02 Mar 2022
Deep learning fluid flow reconstruction around arbitrary two-dimensional objects from sparse sensors using conformal mappings Ali Girayhan Ozbay S. Laizet AI4CE 38 16 0 08 Feb 2022
Next2You: Robust Copresence Detection Based on Channel State Information Mikhail Fomichev L. F. Abanto-Leon Maximilian Stiegler Alejandro Molina Jakob Link M. Hollick 17 6 0 09 Nov 2021
Cooperative Deep $Q$ -learning Framework for Environments Providing Image Feedback Krishnan Raghavan Vignesh Narayanan S. Jagannathan VLM OffRL 26 1 0 28 Oct 2021
Learning to Control using Image Feedback Krishnan Raghavan Vignesh Narayanan Jagannathan Saraangapani 26 0 0 28 Oct 2021
Growing Cosine Unit: A Novel Oscillatory Activation Function That Can Speedup Training and Reduce Parameters in Convolutional Neural Networks M. M. Noel L. Arunkumar A. Trivedi Praneet Dutta 27 26 0 30 Aug 2021
Deep Algorithm Unrolling for Biomedical Imaging Yuelong Li Or Bar-Shira V. Monga Yonina C. Eldar SyDa 31 10 0 15 Aug 2021
A Simple Approach to Automated Spectral Clustering Jicong Fan Y. Tu Zhao Zhang Mingbo Zhao Haijun Zhang 30 18 0 23 Jul 2021
Autoencoder-driven Spiral Representation Learning for Gravitational Wave Surrogate Modelling Paraskevi Nousi Styliani-Christina Fragkouli Nikolaos Passalis P. Iosif T. Apostolatos George Pappas N. Stergioulas Anastasios Tefas 15 7 0 09 Jul 2021
Universal approximation and model compression for radial neural networks I. Ganev Twan van Laarhoven Robin Walters 27 8 0 06 Jul 2021
Theory of Deep Convolutional Neural Networks III: Approximating Radial Functions Tong Mao Zhongjie Shi Ding-Xuan Zhou 16 33 0 02 Jul 2021
Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space Sho Sonoda Isao Ishikawa Masahiro Ikeda BDL 22 9 0 09 Jun 2021
State and Topology Estimation for Unobservable Distribution Systems using Deep Neural Networks Behrouz Azimian R. Biswas Shiva Moshtagh A. Pal Lang Tong Gautam Dasarathy 22 53 0 15 Apr 2021
CDiNN -Convex Difference Neural Networks S. Parameswaran R. Rengaswamy 16 6 0 31 Mar 2021
Rapid Risk Minimization with Bayesian Models Through Deep Learning Approximation Mathias Löwe Per Lunnemann Hansen S. Risi BDL 4 1 0 29 Mar 2021