Size and Depth Separation in Approximating Benign Functions with Neural
Networks

v1v2v3 (latest)

Size and Depth Separation in Approximating Benign Functions with Neural Networks

30 January 2021

Gal Vardi

Daniel Reichman

ArXiv (abs)PDF HTML

Papers citing "Size and Depth Separation in Approximating Benign Functions with Neural Networks"

19 / 19 papers shown

Title
The Connection Between Approximation, Depth Separation and Learnability in Neural Networks Eran Malach Gilad Yehudai Shai Shalev-Shwartz Ohad Shamir 74 20 0 31 Jan 2021
Expressivity of Deep Neural Networks Ingo Gühring Mones Raslan Gitta Kutyniok 88 51 0 09 Jul 2020
Sharp Representation Theorems for ReLU Networks with Precise Dependence on Depth Guy Bresler Dheeraj M. Nagaraj 45 21 0 07 Jun 2020
Neural Networks with Small Weights and Depth-Separation Barriers Gal Vardi Ohad Shamir 81 18 0 31 May 2020
Deep Network Approximation for Smooth Functions Jianfeng Lu Zuowei Shen Haizhao Yang Shijun Zhang 145 248 0 09 Jan 2020
The phase diagram of approximation rates for deep neural networks Dmitry Yarotsky Anton Zhevnerchuk 76 122 0 22 Jun 2019
Deep Network Approximation Characterized by Number of Neurons Zuowei Shen Haizhao Yang Shijun Zhang 62 186 0 13 Jun 2019
Depth Separations in Neural Networks: What is Actually Being Separated? Itay Safran Ronen Eldan Ohad Shamir MDE 65 36 0 15 Apr 2019
Limits on representing Boolean functions by linear combinations of simple functions: thresholds, ReLUs, and low-degree polynomials Richard Ryan Williams 57 27 0 26 Feb 2018
Optimal approximation of continuous functions by very deep ReLU networks Dmitry Yarotsky 207 294 0 10 Feb 2018
Lower bounds over Boolean inputs for deep neural networks with ReLU gates Anirbit Mukherjee A. Basu 75 21 0 08 Nov 2017
Optimal approximation of piecewise smooth functions using deep ReLU neural networks P. Petersen Felix Voigtländer 225 475 0 15 Sep 2017
Depth Separation for Neural Networks Amit Daniely MDE 47 74 0 27 Feb 2017
Depth-Width Tradeoffs in Approximating Natural Functions with Neural Networks Itay Safran Ohad Shamir 87 175 0 31 Oct 2016
Why Deep Neural Networks for Function Approximation? Shiyu Liang R. Srikant 140 385 0 13 Oct 2016
Error bounds for approximations with deep ReLU networks Dmitry Yarotsky 202 1,236 0 03 Oct 2016
Benefits of depth in neural networks Matus Telgarsky 380 609 0 14 Feb 2016
The Power of Depth for Feedforward Neural Networks Ronen Eldan Ohad Shamir 230 732 0 12 Dec 2015
Super-Linear Gate and Super-Quadratic Wire Lower Bounds for Depth-Two and Depth-Three Threshold Circuits D. Kane Ryan Williams 55 61 0 24 Nov 2015