v1v2 (latest)

Complexity of Linear Regions in Deep Networks

25 January 2019

Papers citing "Complexity of Linear Regions in Deep Networks"

50 / 89 papers shown

Title
Time to Spike? Understanding the Representational Power of Spiking Neural Networks in Discrete Time Duc Anh Nguyen Ernesto Araya Adalbert Fono Gitta Kutyniok 162 0 0 23 May 2025
Fractal and Regular Geometry of Deep Neural Networks Simmaco Di Lillo Domenico Marinucci Michele Salvi Stefano Vigogna MDE AI4CE 62 1 0 08 Apr 2025
Beyond the Next Token: Towards Prompt-Robust Zero-Shot Classification via Efficient Multi-Token Prediction Junlang Qian Zixiao Zhu Hanzhang Zhou Zijian Feng Zepeng Zhai K. Mao AAML VLM 123 0 0 04 Apr 2025
ReLU Networks as Random Functions: Their Distribution in Probability Space Shreyas Chaudhari J. M. F. Moura 85 0 0 28 Mar 2025
On Space Folds of ReLU Neural Networks Michal Lewandowski Hamid Eghbalzadeh Bernhard Heinzl Raphael Pisoni Bernhard A.Moser MLT 166 2 0 17 Feb 2025
Growing Tiny Networks: Spotting Expressivity Bottlenecks and Fixing Them Optimally Manon Verbockhaven Sylvain Chevallier Guillaume Charpiat 65 4 0 30 May 2024
Spectral Truncation Kernels: Noncommutativity in $C^*$ -algebraic Kernel Machines Yuka Hashimoto Ayoub Hafid Masahiro Ikeda Hachem Kadri 79 2 0 28 May 2024
Spectral complexity of deep neural networks Simmaco Di Lillo Domenico Marinucci Michele Salvi Stefano Vigogna BDL 171 2 0 15 May 2024
Graph is all you need? Lightweight data-agnostic neural architecture search without training Zhenhan Huang Tejaswini Pedapati Pin-Yu Chen Chunheng Jiang Jianxi Gao GNN 84 1 0 02 May 2024
Analyzing Generalization in Policy Networks: A Case Study with the Double-Integrator System Ruining Zhang H. Han Maolong Lv Qisong Yang Jian Cheng OffRL 66 2 0 16 Dec 2023
The Evolution of the Interplay Between Input Distributions and Linear Regions in Networks Xuan Qi Yi Wei 37 0 0 28 Oct 2023
Quantitative CLTs in Deep Neural Networks Stefano Favaro Boris Hanin Domenico Marinucci I. Nourdin G. Peccati BDL 112 16 0 12 Jul 2023
Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities Guihong Li Duc-Tuong Hoang Kartikeya Bhardwaj Ming Lin Zhangyang Wang R. Marculescu 120 15 0 05 Jul 2023
Neural Polytopes Koji Hashimoto T. Naito Hisashi Naito 113 1 0 03 Jul 2023
Polyhedral Complex Extraction from ReLU Networks using Edge Subdivision Arturs Berzins 66 6 0 12 Jun 2023
Deep ReLU Networks Have Surprisingly Simple Polytopes Fenglei Fan Wei Huang Xiang-yu Zhong Lecheng Ruan T. Zeng Huan Xiong Fei Wang 108 5 0 16 May 2023
SkelEx and BoundEx: Natural Visualization of ReLU Neural Networks Pawel Pukowski Haiping Lu 69 0 0 09 May 2023
When Deep Learning Meets Polyhedral Theory: A Survey Joey Huchette Gonzalo Muñoz Thiago Serra Calvin Tsay AI4CE 160 37 0 29 Apr 2023
Expressivity of Shallow and Deep Neural Networks for Polynomial Approximation Itai Shapira 23 0 0 06 Mar 2023
Towards Rigorous Understanding of Neural Networks via Semantics-preserving Transformations Maximilian Schlüter Gerrit Nolte Alnis Murtovi Bernhard Steffen 71 6 0 19 Jan 2023
Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions Junyang Cai Khai-Nguyen Nguyen Nishant Shrestha Aidan Good Ruisen Tu Xin Yu Shandian Zhe Thiago Serra MLT 83 10 0 19 Jan 2023
Expected Gradients of Maxout Networks and Consequences to Parameter Initialization Hanna Tseran Guido Montúfar ODL 56 0 0 17 Jan 2023
Understanding the Spectral Bias of Coordinate Based MLPs Via Training Dynamics J. Lazzari Xiuwen Liu 118 3 0 14 Jan 2023
Effects of Data Geometry in Early Deep Learning Saket Tiwari George Konidaris 150 7 0 29 Dec 2022
Maximal Initial Learning Rates in Deep ReLU Networks Gaurav M. Iyer Boris Hanin David Rolnick 81 10 0 14 Dec 2022
Interpreting Neural Networks through the Polytope Lens Sid Black Lee D. Sharkey Léo Grinsztajn Eric Winsor Daniel A. Braun ... Kip Parker Carlos Ramón Guevara Beren Millidge Gabriel Alfour Connor Leahy FAtt MILM 88 26 0 22 Nov 2022
Scalar Invariant Networks with Zero Bias Chuqin Geng Xiaojie Xu Haolin Ye X. Si 74 2 0 15 Nov 2022
Towards Reliable Neural Specifications Chuqin Geng Nham Le Xiaojie Xu Zhaoyue Wang A. Gurfinkel X. Si AAML 124 10 0 28 Oct 2022
Non-Linear Coordination Graphs Yipeng Kang Tonghan Wang Xiao-Ren Wu Qianlan Yang Chongjie Zhang 91 10 0 26 Oct 2022
Deep Model Reassembly Xingyi Yang Zhou Daquan Songhua Liu Jingwen Ye Xinchao Wang MoMe 98 129 0 24 Oct 2022
When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work Jiawei Zhang Yushun Zhang Mingyi Hong Ruoyu Sun Zhi-Quan Luo 122 10 0 21 Oct 2022
Improved Bounds on Neural Complexity for Representing Piecewise Linear Functions Kuan-Lin Chen H. Garudadri Bhaskar D. Rao 60 20 0 13 Oct 2022
Curved Representation Space of Vision Transformers Juyeop Kim Junha Park Songkuk Kim Jongseok Lee ViT 75 7 0 11 Oct 2022
On Scrambling Phenomena for Randomly Initialized Recurrent Networks Vaggos Chatziafratis Ioannis Panageas Clayton Sanford S. Stavroulakis 61 2 0 11 Oct 2022
Magnitude and Angle Dynamics in Training Single ReLU Neurons Sangmin Lee Byeongsu Sim Jong Chul Ye MLT 133 6 0 27 Sep 2022
Piecewise Linear Neural Networks and Deep Learning Qinghua Tao Li Li Xiaolin Huang Xiangming Xi Shuning Wang Johan A. K. Suykens 43 30 0 18 Jun 2022
On the Number of Regions of Piecewise Linear Neural Networks Alexis Goujon Arian Etemadi M. Unser 116 15 0 17 Jun 2022
Lower and Upper Bounds for Numbers of Linear Regions of Graph Convolutional Networks Hao Chen Yu Wang Huan Xiong GNN 63 6 0 01 Jun 2022
$Training Fully Connected Neural Networks is $\exists\mathbb{R}$-Complete$ Training Fully Connected Neural Networks is $\exists\mathbb{R}$ -Complete Daniel Bertschinger Christoph Hertrich Paul Jungeblut Tillmann Miltzow Simon Weber OffRL 115 30 0 04 Apr 2022
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks Xin Yu Thiago Serra Srikumar Ramalingam Shandian Zhe 92 49 0 09 Mar 2022
Neural Architecture Search for Spiking Neural Networks Youngeun Kim Yuhang Li Hyoungseob Park Yeshwanth Venkatesha Priyadarshini Panda 104 92 0 23 Jan 2022
Measuring Complexity of Learning Schemes Using Hessian-Schatten Total Variation Shayan Aziznejad Joaquim Campos M. Unser 93 10 0 12 Dec 2021
MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection Zhenhong Sun Ming Lin Xiuyu Sun Zhiyu Tan Hao Li Rong Jin 136 33 0 26 Nov 2021
Labeled sample compression schemes for complexes of oriented matroids V. Chepoi K. Knauer Manon Philibert MQ 56 7 0 28 Oct 2021
Gradient representations in ReLU networks as similarity functions Dániel Rácz Balint Daroczy FAtt 52 1 0 26 Oct 2021
When are Deep Networks really better than Decision Forests at small sample sizes, and how? Haoyin Xu K. A. Kinfu Will LeVine Sambit Panda Jayanta Dey ... M. Kusmanov F. Engert Christopher M. White Joshua T. Vogelstein Carey E. Priebe 71 24 0 31 Aug 2021
Random Neural Networks in the Infinite Width Limit as Gaussian Processes Boris Hanin BDL 100 48 0 04 Jul 2021
On the Expected Complexity of Maxout Networks Hanna Tseran Guido Montúfar 60 12 0 01 Jul 2021
Multifidelity Modeling for Physics-Informed Neural Networks (PINNs) Michael Penwarden Shandian Zhe A. Narayan Robert M. Kirby 99 46 0 25 Jun 2021
Reachability Analysis of Convolutional Neural Networks Xiaodong Yang Tomoya Yamaguchi Hoang-Dung Tran Bardh Hoxha Taylor T. Johnson Danil Prokhorov FAtt 43 6 0 22 Jun 2021