v1v2 (latest)

Complexity of Linear Regions in Deep Networks

25 January 2019

Papers citing "Complexity of Linear Regions in Deep Networks"

39 / 89 papers shown

Title
What training reveals about neural network complexity Andreas Loukas Marinos Poiitis Stefanie Jegelka 53 11 0 08 Jun 2021
Sharp bounds for the number of regions of maxout networks and vertices of Minkowski sums Guido Montúfar Yue Ren Leon Zhang 61 41 0 16 Apr 2021
Fast Jacobian-Vector Product for Deep Networks Randall Balestriero Richard Baraniuk 56 6 0 01 Apr 2021
Using activation histograms to bound the number of affine regions in ReLU feed-forward neural networks Peter Hinz 36 6 0 31 Mar 2021
SMILE: Self-Distilled MIxup for Efficient Transfer LEarning Xingjian Li Haoyi Xiong Chengzhong Xu Dejing Dou 32 6 0 25 Mar 2021
Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective Wuyang Chen Xinyu Gong Zhangyang Wang OOD 165 239 0 23 Feb 2021
Deep ReLU Networks Preserve Expected Length Boris Hanin Ryan Jeong David Rolnick 68 14 0 21 Feb 2021
Scaling Up Exact Neural Network Compression by ReLU Stability Thiago Serra Xin Yu Abhinav Kumar Srikumar Ramalingam 66 24 0 15 Feb 2021
CKConv: Continuous Kernel Convolution For Sequential Data David W. Romero Anna Kuzina Erik J. Bekkers Jakub M. Tomczak Mark Hoogendoorn 73 126 0 04 Feb 2021
Depth separation beyond radial functions Luca Venturi Samy Jelassi Tristan Ozuch Joan Bruna 65 15 0 02 Feb 2021
Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition Ming Lin Pichao Wang Zhenhong Sun Hesen Chen Xiuyu Sun Qi Qian Hao Li Rong Jin 84 109 0 01 Feb 2021
A simple geometric proof for the benefit of depth in ReLU networks Asaf Amrami Yoav Goldberg 45 1 0 18 Jan 2021
A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks Asaf Noy Yi Tian Xu Y. Aflalo Lihi Zelnik-Manor Rong Jin 68 3 0 12 Jan 2021
SyReNN: A Tool for Analyzing Deep Neural Networks Matthew Sotoudeh Aditya V. Thakur AAML GNN 63 16 0 09 Jan 2021
Dissipative Deep Neural Dynamical Systems Ján Drgoňa Soumya Vasisht Aaron Tuor D. Vrabie 44 8 0 26 Nov 2020
Exploring the Security Boundary of Data Reconstruction via Neuron Exclusivity Analysis Xudong Pan Mi Zhang Yifan Yan Jiaming Zhu Zhemin Yang AAML 67 22 0 26 Oct 2020
On the Number of Linear Functions Composing Deep Neural Network: Towards a Refined Definition of Neural Networks Complexity Yuuki Takai Akiyoshi Sannai Matthieu Cordonnier 82 4 0 23 Oct 2020
How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks Keyulu Xu Mozhi Zhang Jingling Li S. Du Ken-ichi Kawarabayashi Stefanie Jegelka MLT 182 313 0 24 Sep 2020
When Hardness of Approximation Meets Hardness of Learning Eran Malach Shai Shalev-Shwartz 55 9 0 18 Aug 2020
How benign is benign overfitting? Amartya Sanyal P. Dokania Varun Kanade Philip Torr NoLa AAML 86 58 0 08 Jul 2020
Liquid Time-constant Networks Ramin Hasani Mathias Lechner Alexander Amini Daniela Rus Radu Grosu AI4TS AI4CE 93 228 0 08 Jun 2020
On the Number of Linear Regions of Convolutional Neural Networks Huan Xiong Lei Huang Mengyang Yu Li Liu Fan Zhu Ling Shao MLT 83 68 0 01 Jun 2020
Provably Good Solutions to the Knapsack Problem via Neural Networks of Bounded Size Christoph Hertrich M. Skutella 99 22 0 28 May 2020
Piecewise linear activations substantially shape the loss surfaces of neural networks Fengxiang He Bohan Wang Dacheng Tao ODL 86 30 0 27 Mar 2020
Reachability Analysis for Feed-Forward Neural Networks using Face Lattices Xiaodong Yang Hoang-Dung Tran Weiming Xiang Taylor Johnson CVBM 94 19 0 02 Mar 2020
Uncertainty Quantification for Sparse Deep Learning Yuexi Wang Veronika Rockova BDL UQCV 95 31 0 26 Feb 2020
Investigating the Compositional Structure Of Deep Neural Networks Francesco Craighero Fabrizio Angaroni Alex Graudenzi Fabio Stella M. Antoniotti FAtt 56 5 0 17 Feb 2020
Self-explaining AI as an alternative to interpretable AI Daniel C. Elton 90 56 0 12 Feb 2020
Empirical Studies on the Properties of Linear Regions in Deep Neural Networks Xiao Zhang Dongrui Wu 58 38 0 04 Jan 2020
Lossless Compression of Deep Neural Networks Thiago Serra Abhinav Kumar Srikumar Ramalingam 106 57 0 01 Jan 2020
The Local Elasticity of Neural Networks Hangfeng He Weijie J. Su 149 46 0 15 Oct 2019
Reverse-Engineering Deep ReLU Networks David Rolnick Konrad Paul Kording 79 105 0 02 Oct 2019
Optimal Function Approximation with Relu Neural Networks Bo Liu Yi Liang 57 33 0 09 Sep 2019
Computing Linear Restrictions of Neural Networks Matthew Sotoudeh Aditya V. Thakur 39 24 0 17 Aug 2019
Gradient Dynamics of Shallow Univariate ReLU Networks Francis Williams Matthew Trager Claudio Silva Daniele Panozzo Denis Zorin Joan Bruna 70 80 0 18 Jun 2019
Deep ReLU Networks Have Surprisingly Few Activation Patterns Boris Hanin David Rolnick 96 228 0 03 Jun 2019
Expression of Fractals Through Neural Network Functions Nadav Dym B. Sober Ingrid Daubechies 76 15 0 27 May 2019
The Geometry of Deep Networks: Power Diagram Subdivision Randall Balestriero Romain Cosentino B. Aazhang Richard Baraniuk AI4CE 63 64 0 21 May 2019
Empirical Bounds on Linear Regions of Deep Rectifier Networks Thiago Serra Srikumar Ramalingam 76 42 0 08 Oct 2018