v1v2v3v4v5v6 (latest)

Understanding Deep Neural Networks with Rectified Linear Units

4 November 2016

Papers citing "Understanding Deep Neural Networks with Rectified Linear Units"

50 / 199 papers shown

Title
De Rham compatible Deep Neural Network FEM M. Longo J. Opschoor Nico Disch Christoph Schwab Jakob Zech 85 8 0 14 Jan 2022
Efficient Global Optimization of Two-Layer ReLU Networks: Quadratic-Time Algorithms and Adversarial Training Yatong Bai Tanmay Gautam Somayeh Sojoudi AAML 112 17 0 06 Jan 2022
FitAct: Error Resilient Deep Neural Networks via Fine-Grained Post-Trainable Activation Functions B. Ghavami Mani Sadati Zhenman Fang Lesley Shannon AI4CE 56 26 0 27 Dec 2021
Measuring Complexity of Learning Schemes Using Hessian-Schatten Total Variation Shayan Aziznejad Joaquim Campos M. Unser 93 10 0 12 Dec 2021
Tailored neural networks for learning optimal value functions in MPC Dieter Teichrib M. S. Darup 67 4 0 07 Dec 2021
The Geometric Occam's Razor Implicit in Deep Learning Benoit Dherin Micheal Munn David Barrett 62 7 0 30 Nov 2021
Towards Understanding the Unreasonable Effectiveness of Learning AC-OPF Solutions M. H. Dinh Ferdinando Fioretto M. Mohammadian K. Baker 13 1 0 22 Nov 2021
On the Existence of Universal Lottery Tickets R. Burkholz Nilanjana Laha Rajarshi Mukherjee Alkis Gotovos UQCV 85 33 0 22 Nov 2021
Neural networks with linear threshold activations: structure and algorithms Sammy Khalife Hongyu Cheng A. Basu 105 16 0 15 Nov 2021
Reliably-stabilizing piecewise-affine neural network controllers F. Fabiani Paul Goulart 83 37 0 13 Nov 2021
Mixtures of Laplace Approximations for Improved Post-Hoc Uncertainty in Deep Learning Runa Eschenhagen Erik A. Daxberger Philipp Hennig Agustinus Kristiadi UQCV BDL 73 23 0 05 Nov 2021
Availability Attacks Create Shortcuts Da Yu Huishuai Zhang Wei Chen Jian Yin Tie-Yan Liu AAML 123 58 0 01 Nov 2021
Graph Posterior Network: Bayesian Predictive Uncertainty for Node Classification Maximilian Stadler Bertrand Charpentier Simon Geisler Daniel Zügner Stephan Günnemann UQCV BDL 120 89 0 26 Oct 2021
Expressivity of Neural Networks via Chaotic Itineraries beyond Sharkovsky's Theorem Clayton Sanford Vaggos Chatziafratis 29 1 0 19 Oct 2021
Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks Tolga Ergen Mert Pilanci 94 16 0 18 Oct 2021
Sound and Complete Neural Network Repair with Minimality and Locality Guarantees Feisi Fu Wenchao Li KELM AAML 96 26 0 14 Oct 2021
Multi-Head ReLU Implicit Neural Representation Networks Arya Aftab Alireza Morsali 68 11 0 07 Oct 2021
Activation Functions in Deep Learning: A Comprehensive Survey and Benchmark S. Dubey S. Singh B. B. Chaudhuri 124 688 0 29 Sep 2021
Robust Generalization of Quadratic Neural Networks via Function Identification Kan Xu Hamsa Bastani Osbert Bastani OOD 67 8 0 22 Sep 2021
On the space of coefficients of a Feed Forward Neural Network Dinesh Valluri R. Campbell MLT 59 2 0 07 Sep 2021
Approximation Properties of Deep ReLU CNNs Juncai He Lin Li Jinchao Xu 91 19 0 01 Sep 2021
On minimal representations of shallow ReLU networks Steffen Dereich Sebastian Kassing FAtt 48 15 0 12 Aug 2021
PI3NN: Out-of-distribution-aware prediction intervals from three neural networks Si-Yuan Liu Pei Zhang Dan Lu Guannan Zhang OODD 65 10 0 05 Aug 2021
Neural Network Based Model Predictive Control for an Autonomous Vehicle Maria Luiza Costa Vianna Eric Goubault S. Putot 28 3 0 30 Jul 2021
Mitigating severe over-parameterization in deep convolutional neural networks through forced feature abstraction and compression with an entropy-based heuristic Nidhi Gowdra R. Sinha Stephen G. MacDonell W. Yan 25 9 0 27 Jun 2021
Provably Robust Detection of Out-of-distribution Data (almost) for free Alexander Meinke Julian Bitterwolf Matthias Hein OODD 70 22 0 08 Jun 2021
What training reveals about neural network complexity Andreas Loukas Marinos Poiitis Stefanie Jegelka 60 11 0 08 Jun 2021
Adversarial Robustness against Multiple and Single $l_p$ -Threat Models via Quick Fine-Tuning of Robust Classifiers Francesco Croce Matthias Hein OOD AAML 67 18 0 26 May 2021
The Computational Complexity of ReLU Network Training Parameterized by Data Dimensionality Vincent Froese Christoph Hertrich R. Niedermeier 67 24 0 18 May 2021
ReLU Deep Neural Networks from the Hierarchical Basis Perspective Juncai He Lin Li Jinchao Xu AI4CE 59 30 0 10 May 2021
Examining and Mitigating Kernel Saturation in Convolutional Neural Networks using Negative Images Nidhi Gowdra R. Sinha Stephen G. MacDonell 9 2 0 10 May 2021
What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory Rahul Parhi Robert D. Nowak MLT 125 71 0 07 May 2021
Sharp bounds for the number of regions of maxout networks and vertices of Minkowski sums Guido Montúfar Yue Ren Leon Zhang 64 41 0 16 Apr 2021
Fast Jacobian-Vector Product for Deep Networks Randall Balestriero Richard Baraniuk 58 6 0 01 Apr 2021
SMILE: Self-Distilled MIxup for Efficient Transfer LEarning Xingjian Li Haoyi Xiong Chengzhong Xu Dejing Dou 32 6 0 25 Mar 2021
Error Estimates for the Deep Ritz Method with Boundary Penalty Johannes Müller Marius Zeinhofer 93 17 0 01 Mar 2021
Exploiting Spline Models for the Training of Fully Connected Layers in Neural Network Kanya Mo Shen Zheng Xiwei Wang Jinghua Wang Klaus-Dieter Schewe Zhejiang University 18 0 0 12 Feb 2021
Searching for Fast Model Families on Datacenter Accelerators Sheng Li Mingxing Tan Ruoming Pang Andrew Li Liqun Cheng Quoc V. Le N. Jouppi 90 34 0 10 Feb 2021
Depth separation beyond radial functions Luca Venturi Samy Jelassi Tristan Ozuch Joan Bruna 69 15 0 02 Feb 2021
Pareto GAN: Extending the Representational Power of GANs to Heavy-Tailed Distributions Todd P. Huster Jérémy E. Cohen Zinan Lin Kevin S. Chan Charles A. Kamhoua Nandi O. Leslie C. Chiang Vyas Sekar GAN 70 29 0 22 Jan 2021
A simple geometric proof for the benefit of depth in ReLU networks Asaf Amrami Yoav Goldberg 45 1 0 18 Jan 2021
Are DNNs fooled by extremely unrecognizable images? Soichiro Kumano Hiroshi Kera T. Yamasaki AAML 44 3 0 07 Dec 2020
Tight Hardness Results for Training Depth-2 ReLU Networks Surbhi Goel Adam R. Klivans Pasin Manurangsi Daniel Reichman 78 41 0 27 Nov 2020
Dissipative Deep Neural Dynamical Systems Ján Drgoňa Soumya Vasisht Aaron Tuor D. Vrabie 53 8 0 26 Nov 2020
Layer-Wise Data-Free CNN Compression Maxwell Horton Yanzi Jin Ali Farhadi Mohammad Rastegari MQ 67 17 0 18 Nov 2020
Distance-Based Anomaly Detection for Industrial Surfaces Using Triplet Networks Tareq Tayeh Sulaiman A. Aburakhia Ryan Myers Abdallah Shami 69 32 0 09 Nov 2020
Provable Memorization via Deep Neural Networks using Sub-linear Parameters Sejun Park Jaeho Lee Chulhee Yun Jinwoo Shin FedML MDE 82 37 0 26 Oct 2020
Deep neural network for solving differential equations motivated by Legendre-Galerkin approximation Bryce Chudomelka Youngjoon Hong Hyunwoo J. Kim Jinyoung Park 74 7 0 24 Oct 2020
On the Number of Linear Functions Composing Deep Neural Network: Towards a Refined Definition of Neural Networks Complexity Yuuki Takai Akiyoshi Sannai Matthieu Cordonnier 84 4 0 23 Oct 2020
Measure Transport with Kernel Stein Discrepancy Matthew A. Fisher T. Nolan Matthew M. Graham D. Prangle Chris J. Oates OT 124 15 0 22 Oct 2020