v1v2 (latest)

On the Number of Regions of Piecewise Linear Neural Networks

17 June 2022

Papers citing "On the Number of Regions of Piecewise Linear Neural Networks"

30 / 30 papers shown

Title
Spectral complexity of deep neural networks Simmaco Di Lillo Domenico Marinucci Michele Salvi Stefano Vigogna BDL 116 2 0 15 May 2024
When Deep Learning Meets Polyhedral Theory: A Survey Joey Huchette Gonzalo Muñoz Thiago Serra Calvin Tsay AI4CE 151 37 0 29 Apr 2023
Approximation of Lipschitz Functions using Deep Spline Neural Networks Sebastian Neumayer Alexis Goujon Pakshal Bohra M. Unser 62 17 0 13 Apr 2022
Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100 Sahil Singla Surbhi Singla Soheil Feizi AAML 74 58 0 05 Aug 2021
On the Expected Complexity of Maxout Networks Hanna Tseran Guido Montúfar 52 12 0 01 Jul 2021
Sharp bounds for the number of regions of maxout networks and vertices of Minkowski sums Guido Montúfar Yue Ren Leon Zhang 44 41 0 16 Apr 2021
Deep ReLU Networks Preserve Expected Length Boris Hanin Ryan Jeong David Rolnick 54 14 0 21 Feb 2021
Approximating Lipschitz continuous functions with GroupSort neural networks Ugo Tanielian Maxime Sangnier Gérard Biau 64 39 0 09 Jun 2020
On the Number of Linear Regions of Convolutional Neural Networks Huan Xiong Lei Huang Mengyang Yu Li Liu Fan Zhu Ling Shao MLT 61 68 0 01 Jun 2020
Training robust neural networks using Lipschitz bounds Patricia Pauli Anne Koch J. Berberich Paul Kohler Frank Allgöwer 71 161 0 06 May 2020
Deep ReLU Networks Have Surprisingly Few Activation Patterns Boris Hanin David Rolnick 84 228 0 03 Jun 2019
The Geometry of Deep Networks: Power Diagram Subdivision Randall Balestriero Romain Cosentino B. Aazhang Richard Baraniuk AI4CE 51 64 0 21 May 2019
Complexity of Linear Regions in Deep Networks Boris Hanin David Rolnick 49 234 0 25 Jan 2019
Sorting out Lipschitz function approximation Cem Anil James Lucas Roger C. Grosse 90 325 0 13 Nov 2018
A Framework for the construction of upper bounds on the number of affine linear regions of ReLU feed-forward neural networks Peter Hinz Sara van de Geer 52 23 0 05 Jun 2018
Mad Max: Affine Spline Insights into Deep Learning Randall Balestriero Richard Baraniuk AI4CE 69 78 0 17 May 2018
A representer theorem for deep neural networks M. Unser 57 98 0 26 Feb 2018
Bounding and Counting Linear Regions of Deep Neural Networks Thiago Serra Christian Tjandraatmadja Srikumar Ramalingam MLT 65 251 0 06 Nov 2017
Understanding Deep Neural Networks with Rectified Linear Units R. Arora A. Basu Poorya Mianjy Anirbit Mukherjee PINN 154 643 0 04 Nov 2016
Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Review T. Poggio H. Mhaskar Lorenzo Rosasco Brando Miranda Q. Liao 126 576 0 02 Nov 2016
Deep vs. shallow networks : An approximation theory perspective H. Mhaskar T. Poggio 165 341 0 10 Aug 2016
On the Expressive Power of Deep Neural Networks M. Raghu Ben Poole Jon M. Kleinberg Surya Ganguli Jascha Narain Sohl-Dickstein 63 790 0 16 Jun 2016
Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units Wenling Shang Kihyuk Sohn Diogo Almeida Honglak Lee 74 506 0 16 Mar 2016
The Power of Depth for Feedforward Neural Networks Ronen Eldan Ohad Shamir 219 732 0 12 Dec 2015
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 465 43,341 0 11 Feb 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 338 18,651 0 06 Feb 2015
Learning Activation Functions to Improve Deep Neural Networks Forest Agostinelli Matthew Hoffman Peter Sadowski Pierre Baldi ODL 230 475 0 21 Dec 2014
On the Number of Linear Regions of Deep Neural Networks Guido Montúfar Razvan Pascanu Kyunghyun Cho Yoshua Bengio 92 1,256 0 08 Feb 2014
Maxout Networks Ian Goodfellow David Warde-Farley M. Berk Mirza Aaron Courville Yoshua Bengio OOD 253 2,179 0 18 Feb 2013