v1v2v3v4v5v6 (latest)

On the Expressive Power of Deep Neural Networks

16 June 2016

Jascha Narain Sohl-Dickstein

ArXiv (abs)PDF HTML

Papers citing "On the Expressive Power of Deep Neural Networks"

50 / 267 papers shown

Title
Optimal Function Approximation with Relu Neural Networks Bo Liu Yi Liang 57 33 0 09 Sep 2019
Automated Architecture Design for Deep Neural Networks Steven Abreu 3DV AI4CE 67 16 0 22 Aug 2019
LassoNet: A Neural Network with Feature Sparsity Ismael Lemhadri Feng Ruan L. Abraham Robert Tibshirani 168 131 0 29 Jul 2019
Universality and individuality in neural dynamics across large populations of recurrent networks Niru Maheswaranathan Alex H. Williams Matthew D. Golub Surya Ganguli David Sussillo 101 144 0 19 Jul 2019
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges N. Arivazhagan Ankur Bapna Orhan Firat Dmitry Lepikhin Melvin Johnson ... George F. Foster Colin Cherry Wolfgang Macherey Zhiwen Chen Yonghui Wu 105 428 0 11 Jul 2019
Understanding the Representation Power of Graph Neural Networks in Learning Graph Topology Nima Dehmamy Albert-László Barabási Rose Yu GNN 97 135 0 11 Jul 2019
Towards Robust, Locally Linear Deep Networks Guang-He Lee David Alvarez-Melis Tommi Jaakkola ODL 135 48 0 07 Jul 2019
ReLU Networks as Surrogate Models in Mixed-Integer Linear Programs B. Grimstad H. Andersson 64 143 0 06 Jul 2019
Efficient Neural Interaction Function Search for Collaborative Filtering Quanming Yao Xiangning Chen James T. Kwok Yong Li Cho-Jui Hsieh 84 44 0 28 Jun 2019
Densely Connected Search Space for More Flexible Neural Architecture Search Jiemin Fang Yuzhu Sun Qian Zhang Yuan Li Wenyu Liu Xinggang Wang 120 125 0 23 Jun 2019
Deep Semi-Supervised Anomaly Detection Lukas Ruff Robert A. Vandermeulen Nico Görnitz Alexander Binder Emmanuel Müller K. Müller Marius Kloft UQCV 66 549 0 06 Jun 2019
Adversarial Training is a Form of Data-dependent Operator Norm Regularization Kevin Roth Yannic Kilcher Thomas Hofmann 58 13 0 04 Jun 2019
Deep ReLU Networks Have Surprisingly Few Activation Patterns Boris Hanin David Rolnick 98 228 0 03 Jun 2019
Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics Giancarlo Kerg Kyle Goyette M. P. Touzel Gauthier Gidel Eugene Vorontsov Yoshua Bengio Guillaume Lajoie 99 58 0 28 May 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 261 18,302 0 28 May 2019
Expression of Fractals Through Neural Network Functions Nadav Dym B. Sober Ingrid Daubechies 76 15 0 27 May 2019
Enhancing Adversarial Defense by k-Winners-Take-All Chang Xiao Peilin Zhong Changxi Zheng AAML 80 99 0 25 May 2019
Fine-grained Optimization of Deep Neural Networks Mete Ozay ODL 57 2 0 22 May 2019
Revisiting hard thresholding for DNN pruning Konstantinos Pitas Mike Davies P. Vandergheynst AAML 52 2 0 21 May 2019
The Geometry of Deep Networks: Power Diagram Subdivision Randall Balestriero Romain Cosentino B. Aazhang Richard Baraniuk AI4CE 63 64 0 21 May 2019
Meta-learners' learning dynamics are unlike learners' Neil C. Rabinowitz OffRL 88 16 0 03 May 2019
Full-Gradient Representation for Neural Network Visualization Suraj Srinivas François Fleuret MILM FAtt 107 278 0 02 May 2019
RadiX-Net: Structured Sparse Matrices for Deep Neural Networks Ryan A. Robinett J. Kepner 48 40 0 30 Apr 2019
HARK Side of Deep Learning -- From Grad Student Descent to Automated Machine Learning O. Gencoglu M. Gils E. Guldogan Chamin Morikawa Mehmet Süzen M. Gruber J. Leinonen H. Huttunen 105 36 0 16 Apr 2019
The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent Karthik A. Sankararaman Soham De Zheng Xu Wenjie Huang Tom Goldstein ODL 112 106 0 15 Apr 2019
On Geometric Structure of Activation Spaces in Neural Networks Yuting Jia Haiwen Wang Shuo Shao Huan Long Yunsong Zhou Xinbing Wang 3DPC 151 8 0 02 Apr 2019
SSN: Learning Sparse Switchable Normalization via SparsestMax Wenqi Shao Jiamin Ren Jingyu Li Ruimao Zhang Yudian Li Xiaogang Wang Ping Luo 69 56 0 09 Mar 2019
Is Deeper Better only when Shallow is Good? Eran Malach Shai Shalev-Shwartz 79 45 0 08 Mar 2019
Limiting Network Size within Finite Bounds for Optimization Linu Pinto Sasi Gopalan 41 2 0 07 Mar 2019
Implicit Regularization in Over-parameterized Neural Networks M. Kubo Ryotaro Banno Hidetaka Manabe Masataka Minoji 78 23 0 05 Mar 2019
Stable and Fair Classification Lingxiao Huang Nisheeth K. Vishnoi FaML 156 72 0 21 Feb 2019
Fast Neural Network Verification via Shadow Prices Vicencc Rubies-Royo Roberto Calandra D. Stipanović Claire Tomlin AAML 89 41 0 19 Feb 2019
Capacity allocation analysis of neural networks: A tool for principled architecture design Jonathan Donier 49 4 0 12 Feb 2019
Technical Considerations for Semantic Segmentation in MRI using Convolutional Neural Networks Arjun D Desai G. Gold B. Hargreaves Akshay S. Chaudhari 72 30 0 05 Feb 2019
Optimal Nonparametric Inference via Deep Neural Network Ruiqi Liu B. Boukai Zuofeng Shang 47 19 0 05 Feb 2019
Stiffness: A New Perspective on Generalization in Neural Networks Stanislav Fort Pawel Krzysztof Nowak Stanislaw Jastrzebski S. Narayanan 138 94 0 28 Jan 2019
Complexity of Linear Regions in Deep Networks Boris Hanin David Rolnick 78 234 0 25 Jan 2019
Machine Learning and Deep Learning Algorithms for Bearing Fault Diagnostics -- A Comprehensive Review Shen Zhang Shibo Zhang Bingnan Wang T. Habetler 71 259 0 24 Jan 2019
Understanding Geometry of Encoder-Decoder CNNs J. C. Ye Woon Kyoung Sung 3DV AI4CE 88 74 0 22 Jan 2019
Graph Neural Networks with convolutional ARMA filters F. Bianchi Daniele Grattarola L. Livi Cesare Alippi GNN 141 399 0 05 Jan 2019
Per-Tensor Fixed-Point Quantization of the Back-Propagation Algorithm Charbel Sakr Naresh R Shanbhag MQ 84 43 0 31 Dec 2018
Neural Persistence: A Complexity Measure for Deep Neural Networks Using Algebraic Topology Bastian Rieck Matteo Togninalli Christian Bock Michael Moor Max Horn Thomas Gumbsch Karsten Borgwardt 93 111 0 23 Dec 2018
Fast convergence rates of deep neural networks for classification Yongdai Kim Ilsang Ohn Dongha Kim 3DH 3DV 85 81 0 10 Dec 2018
Understanding the Importance of Single Directions via Representative Substitution Li Chen Hailun Ding Qi Li Zhuo Li Jian Peng Haifeng Li MILM FAtt AI4CE 11 0 0 27 Nov 2018
RePr: Improved Training of Convolutional Filters Aaditya (Adi) Prakash J. Storer D. Florêncio Cha Zhang VLM CVBM 93 57 0 18 Nov 2018
Gradient Descent Finds Global Minima of Deep Neural Networks S. Du Jason D. Lee Haochuan Li Liwei Wang Masayoshi Tomizuka ODL 336 1,136 0 09 Nov 2018
Characterizing Well-Behaved vs. Pathological Deep Neural Networks Mitchell Stern 45 0 0 07 Nov 2018
On the Geometry of Adversarial Examples Marc Khoury Dylan Hadfield-Menell AAML 79 79 0 01 Nov 2018
Nearly-tight bounds on linear regions of piecewise linear neural networks Qiang Hu Huatian Zhang 60 5 0 31 Oct 2018
Stein Neural Sampler Tianyang Hu Zixiang Chen Hanxi Sun Jincheng Bai Mao Ye Guang Cheng SyDa GAN 79 36 0 08 Oct 2018