The Expressive Power of Neural Networks: A View from the Width

8 September 2017

Papers citing "The Expressive Power of Neural Networks: A View from the Width"

50 / 121 papers shown

Title
Learning with Noisy Labels: the Exploration of Error Bounds in Classification Haixia Liu Boxiao Li Can Yang Yang Wang 41 0 0 28 Jan 2025
Optimality of Message-Passing Architectures for Sparse Graphs Aseem Baranwal K. Fountoulakis Aukosh Jagannath 81 11 0 10 Jan 2025
TL-PCA: Transfer Learning of Principal Component Analysis Sharon Hendy Yehuda Dar 161 1 0 14 Oct 2024
On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory Guhan Chen Yicheng Li Qian Lin AAML 38 1 0 08 Oct 2024
Neural Networks Trained by Weight Permutation are Universal Approximators Yongqiang Cai Gaohang Chen Zhonghua Qiao 69 1 0 01 Jul 2024
Neural networks in non-metric spaces Luca Galimberti 53 1 0 13 Jun 2024
Anytime Neural Architecture Search on Tabular Data Naili Xing Shaofeng Cai Zhaojing Luo Bengchin Ooi Jian Pei 34 1 0 15 Mar 2024
Cross Entropy versus Label Smoothing: A Neural Collapse Perspective Li Guo Keith Ross Zifan Zhao George Andriopoulos Shuyang Ling Yufeng Xu Zixuan Dong UQCV NoLa 30 9 0 06 Feb 2024
Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts Anastasis Kratsios Haitz Sáez de Ocáriz Borde Takashi Furuya Marc T. Law MoE 41 1 0 05 Feb 2024
Expressivity and Approximation Properties of Deep Neural Networks with ReLU $^k$ Activation Juncai He Tong Mao Jinchao Xu 37 3 0 27 Dec 2023
Mixture of Weak & Strong Experts on Graphs Hanqing Zeng Hanjia Lyu Diyi Hu Yinglong Xia Jiebo Luo 25 3 0 09 Nov 2023
From Alexnet to Transformers: Measuring the Non-linearity of Deep Neural Networks with Affine Optimal Transport Quentin Bouniot I. Redko Anton Mallasto Charlotte Laclau Karol Arndt Oliver Struckmeier Markus Heinonen Ville Kyrki Samuel Kaski 54 2 0 17 Oct 2023
Minimum width for universal approximation using ReLU networks on compact domain Namjun Kim Chanho Min Sejun Park VLM 29 10 0 19 Sep 2023
Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Loss T. Getu Georges Kaddoum M. Bennis 40 1 0 13 Sep 2023
Predicting and explaining nonlinear material response using deep Physically Guided Neural Networks with Internal Variables Javier Orera-Echeverria J. Ayensa-Jiménez Manuel Doblaré 25 1 0 07 Aug 2023
Are Transformers with One Layer Self-Attention Using Low-Rank Weight Matrices Universal Approximators? T. Kajitsuka Issei Sato 31 16 0 26 Jul 2023
Multi-Path Transformer is Better: A Case Study on Neural Machine Translation Ye Lin Shuhan Zhou Yanyang Li Anxiang Ma Tong Xiao Jingbo Zhu 32 0 0 10 May 2023
When Deep Learning Meets Polyhedral Theory: A Survey Joey Huchette Gonzalo Muñoz Thiago Serra Calvin Tsay AI4CE 94 32 0 29 Apr 2023
The R-mAtrIx Net Shailesh Lal Suvajit Majumder E. Sobko 24 5 0 14 Apr 2023
Deep neural network approximation of composite functions without the curse of dimensionality Adrian Riekert 24 0 0 12 Apr 2023
Error convergence and engineering-guided hyperparameter search of PINNs: towards optimized I-FENN performance Panos Pantidis Habiba Eldababy Christopher Miguel Tagle M. Mobasher 35 20 0 03 Mar 2023
On the Correctness of Automatic Differentiation for Neural Networks with Machine-Representable Parameters Wonyeol Lee Sejun Park A. Aiken PINN 13 6 0 31 Jan 2023
Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions Junyang Cai Khai-Nguyen Nguyen Nishant Shrestha Aidan Good Ruisen Tu Xin Yu Shandian Zhe Thiago Serra MLT 37 7 0 19 Jan 2023
Renormalization in the neural network-quantum field theory correspondence Harold Erbin Vincent Lahoche D. O. Samary 39 7 0 22 Dec 2022
Bort: Towards Explainable Neural Networks with Bounded Orthogonal Constraint Borui Zhang Wenzhao Zheng Jie Zhou Jiwen Lu AAML 25 7 0 18 Dec 2022
LU decomposition and Toeplitz decomposition of a neural network Yucong Liu Simiao Jiao Lek-Heng Lim 30 7 0 25 Nov 2022
Do Bayesian Neural Networks Need To Be Fully Stochastic? Mrinank Sharma Sebastian Farquhar Eric T. Nalisnick Tom Rainforth BDL 23 52 0 11 Nov 2022
Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy Michael J. Smith James E. Geach 35 32 0 07 Nov 2022
On the Approximation and Complexity of Deep Neural Networks to Invariant Functions Gao Zhang Jin-Hui Wu Shao-Qun Zhang 16 0 0 27 Oct 2022
When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work Jiawei Zhang Yushun Zhang Mingyi Hong Ruoyu Sun Zhi-Quan Luo 26 10 0 21 Oct 2022
Neural Estimation of Submodular Functions with Applications to Differentiable Subset Selection A. De Soumen Chakrabarti 18 4 0 20 Oct 2022
Improved Bounds on Neural Complexity for Representing Piecewise Linear Functions Kuan-Lin Chen H. Garudadri Bhaskar D. Rao 11 18 0 13 Oct 2022
Neural-Symbolic Recursive Machine for Systematic Generalization Qing Li Yixin Zhu Yitao Liang Ying Nian Wu Song-Chun Zhu Siyuan Huang NAI 38 9 0 04 Oct 2022
Are All Losses Created Equal: A Neural Collapse Perspective Jinxin Zhou Chong You Xiao Li Kangning Liu Sheng Liu Qing Qu Zhihui Zhu 36 58 0 04 Oct 2022
Accelerating hypersonic reentry simulations using deep learning-based hybridization (with guarantees) Paul Novello Gaël Poëtte D. Lugato S. Peluchon P. Congedo AI4CE 19 7 0 27 Sep 2022
Variational Inference for Infinitely Deep Neural Networks Achille Nazaret David M. Blei BDL 25 11 0 21 Sep 2022
Neural Collapse with Normalized Features: A Geometric Analysis over the Riemannian Manifold Can Yaras Peng Wang Zhihui Zhu Laura Balzano Qing Qu 25 41 0 19 Sep 2022
On the Privacy Risks of Cell-Based NAS Architectures Haiping Huang Zhikun Zhang Yun Shen Michael Backes Qi Li Yang Zhang 27 7 0 04 Sep 2022
A Model-Constrained Tangent Slope Learning Approach for Dynamical Systems Hai V. Nguyen T. Bui-Thanh 31 2 0 09 Aug 2022
HouseX: A Fine-grained House Music Dataset and its Potential in the Music Industry Xinyu Li 22 3 0 24 Jul 2022
Approximating Discontinuous Nash Equilibrial Values of Two-Player General-Sum Differential Games Lei Zhang Mukesh Ghimire Wenlong Zhang Zhenni Xu Yi Ren 22 7 0 05 Jul 2022
Lower and Upper Bounds for Numbers of Linear Regions of Graph Convolutional Networks Hao Chen Yu Wang Huan Xiong GNN 16 6 0 01 Jun 2022
Why Robust Generalization in Deep Learning is Difficult: Perspective of Expressive Power Binghui Li Jikai Jin Han Zhong J. Hopcroft Liwei Wang OOD 82 27 0 27 May 2022
Decoupling multivariate functions using a nonparametric filtered tensor decomposition J. Decuyper K. Tiels S. Weiland M. Runacres J. Schoukens 19 3 0 23 May 2022
Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice Peihao Wang Wenqing Zheng Tianlong Chen Zhangyang Wang ViT 22 127 0 09 Mar 2022
On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features Jinxin Zhou Xiao Li Tian Ding Chong You Qing Qu Zhihui Zhu 24 97 0 02 Mar 2022
Completely Quantum Neural Networks Steve Abel J. C. Criado M. Spannowsky 22 25 0 23 Feb 2022
Training Thinner and Deeper Neural Networks: Jumpstart Regularization Carles Roger Riera Molina Camilo Rey Thiago Serra Eloi Puertas O. Pujol 27 4 0 30 Jan 2022
Early Detection of Network Attacks Using Deep Learning Tanwir Ahmad D. Truscan Juri Vain Ivan Porres AAML 14 17 0 27 Jan 2022
GPEX, A Framework For Interpreting Artificial Neural Networks Amir Akbarnejad G. Bigras Nilanjan Ray 39 4 0 18 Dec 2021