Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions

20 April 2024

Papers citing "Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions"

11 / 11 papers shown

Title
Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks B. Annesi Enrico M. Malatesta Francesco Zamponi 81 3 0 09 Oct 2024
Capacity of the treelike sign perceptrons neural networks with one hidden layer -- RDT based upper bounds M. Stojnic 36 4 0 13 Dec 2023
Activation function dependence of the storage capacity of treelike neural networks Jacob A. Zavatone-Veth Cengiz Pehlevan 39 15 0 21 Jul 2020
Deep Double Descent: Where Bigger Models and More Data Hurt Preetum Nakkiran Gal Kaplun Yamini Bansal Tristan Yang Boaz Barak Ilya Sutskever 121 942 0 04 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 496 42,449 0 03 Dec 2019
Properties of the geometry of solutions and capacity of multi-layer neural networks with Rectified Linear Units activations Carlo Baldassi Enrico M. Malatesta R. Zecchina MLT 30 44 0 17 Jul 2019
Reconciling modern machine learning practice and the bias-variance trade-off M. Belkin Daniel J. Hsu Siyuan Ma Soumik Mandal 232 1,650 0 28 Dec 2018
The committee machine: Computational to statistical gaps in learning a two-layers neural network Benjamin Aubin Antoine Maillard Jean Barbier Florent Krzakala N. Macris Lenka Zdeborová 72 106 0 14 Jun 2018
Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks Peter L. Bartlett Nick Harvey Christopher Liaw Abbas Mehrabian 203 432 0 08 Mar 2017
Topology and Geometry of Half-Rectified Network Optimization C. Freeman Joan Bruna 194 235 0 04 Nov 2016
In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Nathan Srebro AI4CE 94 658 0 20 Dec 2014