An Embedding of ReLU Networks and an Analysis of their Identifiability

An Embedding of ReLU Networks and an Analysis of their Identifiability

20 July 2021

Rémi Gribonval

Papers citing "An Embedding of ReLU Networks and an Analysis of their Identifiability"

17 / 17 papers shown

Title
Learning compositional functions via multiplicative weight updates Jeremy Bernstein Jiawei Zhao M. Meister Xuan Li Anima Anandkumar Yisong Yue 32 26 0 25 Jun 2020
Cryptanalytic Extraction of Neural Network Models Nicholas Carlini Matthew Jagielski Ilya Mironov FedML MLAU MIACV AAML 100 135 0 10 Mar 2020
Reverse-Engineering Deep ReLU Networks David Rolnick Konrad Paul Kording 52 103 0 02 Oct 2019
Robust and Resource Efficient Identification of Two Hidden Layer Neural Networks M. Fornasier T. Klock Michael Rauchensteiner 50 18 0 30 Jun 2019
Data-Free Quantization Through Weight Equalization and Bias Correction Markus Nagel M. V. Baalen Tijmen Blankevoort Max Welling MQ 46 505 0 11 Jun 2019
Deep ReLU Networks Have Surprisingly Few Activation Patterns Boris Hanin David Rolnick 58 225 0 03 Jun 2019
Positively Scale-Invariant Flatness of ReLU Neural Networks Mingyang Yi Qi Meng Wei-neng Chen Zhi-Ming Ma Tie-Yan Liu 44 17 0 06 Mar 2019
Equi-normalization of Neural Networks Pierre Stock Benjamin Graham Rémi Gribonval Hervé Jégou ODL 44 16 0 27 Feb 2019
Same, Same But Different - Recovering Neural Network Quantization Error Through Weight Factorization Eldad Meller Alexander Finkelstein Uri Almog Mark Grobman MQ 51 85 0 05 Feb 2019
$$\mathcal{G}$-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space$ $\mathcal{G}$ -SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space Qi Meng Shuxin Zheng Huishuai Zhang Wei Chen Zhi-Ming Ma Tie-Yan Liu 58 38 0 11 Feb 2018
On the stable recovery of deep structured linear networks under sparsity constraints F. Malgouyres 44 7 0 31 May 2017
The Shattered Gradients Problem: If resnets are the answer, then what is the question? David Balduzzi Marcus Frean Lennox Leary J. P. Lewis Kurt Wan-Duo Ma Brian McWilliams ODL 68 399 0 28 Feb 2017
On the Expressive Power of Deep Neural Networks M. Raghu Ben Poole Jon M. Kleinberg Surya Ganguli Jascha Narain Sohl-Dickstein 58 780 0 16 Jun 2016
Path-SGD: Path-Normalized Optimization in Deep Neural Networks Behnam Neyshabur Ruslan Salakhutdinov Nathan Srebro ODL 73 305 0 08 Jun 2015
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 255 583 0 27 Feb 2015
On the Number of Linear Regions of Deep Neural Networks Guido Montúfar Razvan Pascanu Kyunghyun Cho Yoshua Bengio 82 1,250 0 08 Feb 2014
On the number of response regions of deep feed forward networks with piece-wise linear activations Razvan Pascanu Guido Montúfar Yoshua Bengio FAtt 104 257 0 20 Dec 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.