ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1611.01491
  4. Cited By
Understanding Deep Neural Networks with Rectified Linear Units
v1v2v3v4v5v6 (latest)

Understanding Deep Neural Networks with Rectified Linear Units

4 November 2016
R. Arora
A. Basu
Poorya Mianjy
Anirbit Mukherjee
    PINN
ArXiv (abs)PDFHTML

Papers citing "Understanding Deep Neural Networks with Rectified Linear Units"

50 / 199 papers shown
Title
Neural Star Domain as Primitive Representation
Neural Star Domain as Primitive Representation
Yuki Kawana
Yusuke Mukuta
Tatsuya Harada
3DV
64
25
0
21 Oct 2020
Learning to Embed Categorical Features without Embedding Tables for
  Recommendation
Learning to Embed Categorical Features without Embedding Tables for Recommendation
Wang-Cheng Kang
D. Cheng
Tiansheng Yao
Xinyang Yi
Ting-Li Chen
Lichan Hong
Ed H. Chi
LMTDCMLDML
108
72
0
21 Oct 2020
Stationary Activations for Uncertainty Calibration in Deep Learning
Stationary Activations for Uncertainty Calibration in Deep Learning
Lassi Meronen
Christabella Irwanto
Arno Solin
UQCVBDL
54
19
0
19 Oct 2020
An Approximation Algorithm for Optimal Subarchitecture Extraction
An Approximation Algorithm for Optimal Subarchitecture Extraction
Adrian de Wynter
75
1
0
16 Oct 2020
Depth-Width Trade-offs for Neural Networks via Topological Entropy
Depth-Width Trade-offs for Neural Networks via Topological Entropy
Kaifeng Bu
Yaobo Zhang
Qingxian Luo
52
8
0
15 Oct 2020
Effects of the Nonlinearity in Activation Functions on the Performance
  of Deep Learning Models
Effects of the Nonlinearity in Activation Functions on the Performance of Deep Learning Models
N. Kulathunga
N. R. Ranasinghe
D. Vrinceanu
Zackary Kinsman
Lei Huang
Yunjiao Wang
18
5
0
14 Oct 2020
An Infinite-Feature Extension for Bayesian ReLU Nets That Fixes Their
  Asymptotic Overconfidence
An Infinite-Feature Extension for Bayesian ReLU Nets That Fixes Their Asymptotic Overconfidence
Agustinus Kristiadi
Matthias Hein
Philipp Hennig
BDL
63
9
0
06 Oct 2020
How Neural Networks Extrapolate: From Feedforward to Graph Neural
  Networks
How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks
Keyulu Xu
Mozhi Zhang
Jingling Li
S. Du
Ken-ichi Kawarabayashi
Stefanie Jegelka
MLT
184
313
0
24 Sep 2020
Learning to associate detections for real-time multiple object tracking
Learning to associate detections for real-time multiple object tracking
Michel C. Meneses
L. Matos
Bruno O. Prado
André C. P. L. F. de Carvalho
Hendrik T. Macedo
VOT
115
5
0
12 Jul 2020
Expressivity of Deep Neural Networks
Expressivity of Deep Neural Networks
Ingo Gühring
Mones Raslan
Gitta Kutyniok
97
51
0
09 Jul 2020
ConFoc: Content-Focus Protection Against Trojan Attacks on Neural
  Networks
ConFoc: Content-Focus Protection Against Trojan Attacks on Neural Networks
Miguel Villarreal-Vasquez
B. Bhargava
AAML
98
39
0
01 Jul 2020
Interpreting and Disentangling Feature Components of Various Complexity
  from DNNs
Interpreting and Disentangling Feature Components of Various Complexity from DNNs
Jie Ren
Mingjie Li
Zexu Liu
Quanshi Zhang
CoGe
77
18
0
29 Jun 2020
Sparse-RS: a versatile framework for query-efficient sparse black-box
  adversarial attacks
Sparse-RS: a versatile framework for query-efficient sparse black-box adversarial attacks
Francesco Croce
Maksym Andriushchenko
Naman D. Singh
Nicolas Flammarion
Matthias Hein
105
101
0
23 Jun 2020
Analytical Probability Distributions and EM-Learning for Deep Generative
  Networks
Analytical Probability Distributions and EM-Learning for Deep Generative Networks
Randall Balestriero
Sébastien Paris
Richard G. Baraniuk
UQCVDRL
55
1
0
17 Jun 2020
Approximating Lipschitz continuous functions with GroupSort neural
  networks
Approximating Lipschitz continuous functions with GroupSort neural networks
Ugo Tanielian
Maxime Sangnier
Gérard Biau
82
39
0
09 Jun 2020
On the Number of Linear Regions of Convolutional Neural Networks
On the Number of Linear Regions of Convolutional Neural Networks
Huan Xiong
Lei Huang
Mengyang Yu
Li Liu
Fan Zhu
Ling Shao
MLT
83
68
0
01 Jun 2020
Provably Good Solutions to the Knapsack Problem via Neural Networks of
  Bounded Size
Provably Good Solutions to the Knapsack Problem via Neural Networks of Bounded Size
Christoph Hertrich
M. Skutella
99
22
0
28 May 2020
Hierarchical Decomposition of Nonlinear Dynamics and Control for System
  Identification and Policy Distillation
Hierarchical Decomposition of Nonlinear Dynamics and Control for System Identification and Policy Distillation
Hany Abdulsamad
Jan Peters
8
9
0
04 May 2020
Rethink the Connections among Generalization, Memorization and the
  Spectral Bias of DNNs
Rethink the Connections among Generalization, Memorization and the Spectral Bias of DNNs
Xiao Zhang
Haoyi Xiong
Dongrui Wu
98
12
0
29 Apr 2020
Universal Function Approximation on Graphs
Universal Function Approximation on Graphs
Rickard Brüel-Gabrielsson
59
6
0
14 Mar 2020
Better Depth-Width Trade-offs for Neural Networks through the lens of
  Dynamical Systems
Better Depth-Width Trade-offs for Neural Networks through the lens of Dynamical Systems
Vaggos Chatziafratis
Sai Ganesh Nagarajan
Ioannis Panageas
59
15
0
02 Mar 2020
Neural Networks are Convex Regularizers: Exact Polynomial-time Convex
  Optimization Formulations for Two-layer Networks
Neural Networks are Convex Regularizers: Exact Polynomial-time Convex Optimization Formulations for Two-layer Networks
Mert Pilanci
Tolga Ergen
101
118
0
24 Feb 2020
Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networks
Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networks
Agustinus Kristiadi
Matthias Hein
Philipp Hennig
BDLUQCV
90
290
0
24 Feb 2020
On the Decision Boundaries of Neural Networks: A Tropical Geometry
  Perspective
On the Decision Boundaries of Neural Networks: A Tropical Geometry Perspective
Motasem Alfarra
Adel Bibi
Hasan Hammoud
M. Gaafar
Guohao Li
71
26
0
20 Feb 2020
A closer look at the approximation capabilities of neural networks
A closer look at the approximation capabilities of neural networks
Kai Fong Ernest Chong
39
16
0
16 Feb 2020
A Limited-Capacity Minimax Theorem for Non-Convex Games or: How I
  Learned to Stop Worrying about Mixed-Nash and Love Neural Nets
A Limited-Capacity Minimax Theorem for Non-Convex Games or: How I Learned to Stop Worrying about Mixed-Nash and Love Neural Nets
Gauthier Gidel
David Balduzzi
Wojciech M. Czarnecki
M. Garnelo
Yoram Bachrach
89
7
0
14 Feb 2020
On Approximation Capabilities of ReLU Activation and Softmax Output
  Layer in Neural Networks
On Approximation Capabilities of ReLU Activation and Softmax Output Layer in Neural Networks
Behnam Asadi
Hui Jiang
68
20
0
10 Feb 2020
A Deep Conditioning Treatment of Neural Networks
A Deep Conditioning Treatment of Neural Networks
Naman Agarwal
Pranjal Awasthi
Satyen Kale
AI4CE
115
16
0
04 Feb 2020
Sharp Rate of Convergence for Deep Neural Network Classifiers under the
  Teacher-Student Setting
Sharp Rate of Convergence for Deep Neural Network Classifiers under the Teacher-Student Setting
Tianyang Hu
Zuofeng Shang
Guang Cheng
123
19
0
19 Jan 2020
Deep Neural Networks with Trainable Activations and Controlled Lipschitz
  Constant
Deep Neural Networks with Trainable Activations and Controlled Lipschitz Constant
Shayan Aziznejad
Harshit Gupta
Joaquim Campos
M. Unser
75
36
0
17 Jan 2020
Unsupervised Learning of the Set of Local Maxima
Unsupervised Learning of the Set of Local Maxima
Lior Wolf
Sagie Benaim
Tomer Galanti
SSL
43
7
0
14 Jan 2020
Empirical Studies on the Properties of Linear Regions in Deep Neural
  Networks
Empirical Studies on the Properties of Linear Regions in Deep Neural Networks
Xiao Zhang
Dongrui Wu
58
38
0
04 Jan 2020
Lossless Compression of Deep Neural Networks
Lossless Compression of Deep Neural Networks
Thiago Serra
Abhinav Kumar
Srikumar Ramalingam
106
57
0
01 Jan 2020
An Analysis of the Expressiveness of Deep Neural Network Architectures
  Based on Their Lipschitz Constants
An Analysis of the Expressiveness of Deep Neural Network Architectures Based on Their Lipschitz Constants
Siqi Zhou
Angela P. Schoellig
44
12
0
24 Dec 2019
Chart Auto-Encoders for Manifold Structured Data
Chart Auto-Encoders for Manifold Structured Data
Stefan C. Schonsheck
Jie Chen
Rongjie Lai
DRLGNN
44
29
0
20 Dec 2019
Almost Uniform Sampling From Neural Networks
Almost Uniform Sampling From Neural Networks
Changlong Wu
N. Santhanam
27
0
0
10 Dec 2019
Robust Training and Initialization of Deep Neural Networks: An Adaptive
  Basis Viewpoint
Robust Training and Initialization of Deep Neural Networks: An Adaptive Basis Viewpoint
E. Cyr
Mamikon A. Gulian
Ravi G. Patel
M. Perego
N. Trask
104
72
0
10 Dec 2019
Depth-Width Trade-offs for ReLU Networks via Sharkovsky's Theorem
Depth-Width Trade-offs for ReLU Networks via Sharkovsky's Theorem
Vaggos Chatziafratis
Sai Ganesh Nagarajan
Ioannis Panageas
Tianlin Li
65
21
0
09 Dec 2019
Deep Ritz revisited
Deep Ritz revisited
Johannes Müller
Marius Zeinhofer
86
26
0
09 Dec 2019
Variational Physics-Informed Neural Networks For Solving Partial
  Differential Equations
Variational Physics-Informed Neural Networks For Solving Partial Differential Equations
E. Kharazmi
Z. Zhang
George Karniadakis
98
246
0
27 Nov 2019
SAL: Sign Agnostic Learning of Shapes from Raw Data
SAL: Sign Agnostic Learning of Shapes from Raw Data
Matan Atzmon
Y. Lipman
3DPCFedML
170
514
0
23 Nov 2019
Deep least-squares methods: an unsupervised learning-based numerical
  method for solving elliptic PDEs
Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEs
Z. Cai
Jingshuang Chen
Min Liu
Xinyu Liu
97
91
0
05 Nov 2019
Deep Learning for MIMO Channel Estimation: Interpretation, Performance,
  and Comparison
Deep Learning for MIMO Channel Estimation: Interpretation, Performance, and Comparison
Qiang Hu
Feifei Gao
Hao Zhang
Shi Jin
Geoffrey Ye Li
36
10
0
05 Nov 2019
AReN: Assured ReLU NN Architecture for Model Predictive Control of LTI
  Systems
AReN: Assured ReLU NN Architecture for Model Predictive Control of LTI Systems
James Ferlez
Yasser Shoukry
49
17
0
05 Nov 2019
Large Scale Model Predictive Control with Neural Networks and Primal
  Active Sets
Large Scale Model Predictive Control with Neural Networks and Primal Active Sets
Steven W. Chen
Tianyu Wang
Nikolay Atanasov
Vijay Kumar
M. Morari
90
93
0
23 Oct 2019
Universal Approximation with Certified Networks
Universal Approximation with Certified Networks
Maximilian Baader
M. Mirman
Martin Vechev
74
22
0
30 Sep 2019
Optimal Function Approximation with Relu Neural Networks
Optimal Function Approximation with Relu Neural Networks
Bo Liu
Yi Liang
57
33
0
09 Sep 2019
PowerNet: Efficient Representations of Polynomials and Smooth Functions
  by Deep Neural Networks with Rectified Power Units
PowerNet: Efficient Representations of Polynomials and Smooth Functions by Deep Neural Networks with Rectified Power Units
Bo Li
Shanshan Tang
Haijun Yu
41
20
0
09 Sep 2019
Information-Theoretic Lower Bounds for Compressive Sensing with
  Generative Models
Information-Theoretic Lower Bounds for Compressive Sensing with Generative Models
Zhaoqiang Liu
Jonathan Scarlett
107
41
0
28 Aug 2019
Efficient Detection and Quantification of Timing Leaks with Neural
  Networks
Efficient Detection and Quantification of Timing Leaks with Neural Networks
Saeid Tizpaz-Niari
Pavol Cerný
S. Sankaranarayanan
Ashutosh Trivedi
26
4
0
23 Jul 2019
Previous
1234
Next