v1v2v3v4 (latest)

Deep Learning meets Nonparametric Regression: Are Weight-Decayed DNNs Locally Adaptive?

20 April 2022

Papers citing "Deep Learning meets Nonparametric Regression: Are Weight-Decayed DNNs Locally Adaptive?"

32 / 32 papers shown

Title
Multivariate Trend Filtering for Lattice Data Veeranjaneyulu Sadhanala Yu Wang Addison J. Hu Robert Tibshirani 46 7 0 29 Dec 2021
Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks Tolga Ergen Mert Pilanci 60 16 0 18 Oct 2021
Global Optimality Beyond Two Layers: Training Deep ReLU Networks via Convex Programs Tolga Ergen Mert Pilanci OffRL MLT 63 33 0 11 Oct 2021
Near-Minimax Optimal Estimation With Shallow ReLU Neural Networks Rahul Parhi Robert D. Nowak 89 39 0 18 Sep 2021
Besov Function Approximation and Binary Classification on Low-Dimensional Manifolds Using Convolutional Residual Networks Hao Liu Minshuo Chen T. Zhao Wenjing Liao 37 34 0 07 Sep 2021
What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory Rahul Parhi Robert D. Nowak MLT 89 71 0 07 May 2021
Adaptive Online Estimation of Piecewise Polynomial Trends Dheeraj Baby Yu Wang 70 13 0 30 Sep 2020
When Do Neural Networks Outperform Kernel Methods? Behrooz Ghorbani Song Mei Theodor Misiakiewicz Andrea Montanari 98 189 0 24 Jun 2020
Statistical Guarantees for Regularized Neural Networks Mahsa Taheri Fang Xie Johannes Lederer 101 39 0 30 May 2020
The large learning rate phase of deep learning: the catapult mechanism Aitor Lewkowycz Yasaman Bahri Ethan Dyer Jascha Narain Sohl-Dickstein Guy Gur-Ari ODL 202 241 0 04 Mar 2020
Convex Geometry and Duality of Over-parameterized Neural Networks Tolga Ergen Mert Pilanci MLT 88 56 0 25 Feb 2020
Neural Networks are Convex Regularizers: Exact Polynomial-time Convex Optimization Formulations for Two-layer Networks Mert Pilanci Tolga Ergen 83 118 0 24 Feb 2020
Revealing the Structure of Deep Neural Networks via Convex Duality Tolga Ergen Mert Pilanci MLT 58 72 0 22 Feb 2020
Deep Double Descent: Where Bigger Models and More Data Hurt Preetum Nakkiran Gal Kaplun Yamini Bansal Tristan Yang Boaz Barak Ilya Sutskever 123 945 0 04 Dec 2019
A Function Space View of Bounded Norm Infinite Width ReLU Nets: The Multivariate Case Greg Ongie Rebecca Willett Daniel Soudry Nathan Srebro 110 161 0 03 Oct 2019
Online Forecasting of Total-Variation-bounded Sequences Dheeraj Baby Yu Wang AI4TS 46 40 0 08 Jun 2019
What Can ResNet Learn Efficiently, Going Beyond Kernels? Zeyuan Allen-Zhu Yuanzhi Li 402 183 0 24 May 2019
On Exact Computation with an Infinitely Wide Neural Net Sanjeev Arora S. Du Wei Hu Zhiyuan Li Ruslan Salakhutdinov Ruosong Wang 238 928 0 26 Apr 2019
Approximation and Non-parametric Estimation of ResNet-type Convolutional Neural Networks Kenta Oono Taiji Suzuki 96 58 0 24 Mar 2019
How do infinite width bounded norm networks look in function space? Pedro H. P. Savarese Itay Evron Daniel Soudry Nathan Srebro 85 166 0 13 Feb 2019
Adaptivity of deep ReLU network for learning in Besov and mixed smooth Besov spaces: optimal rate and curse of dimensionality Taiji Suzuki 185 246 0 18 Oct 2018
Neural Tangent Kernel: Convergence and Generalization in Neural Networks Arthur Jacot Franck Gabriel Clément Hongler 275 3,223 0 20 Jun 2018
To understand deep learning we need to understand kernel learning M. Belkin Siyuan Ma Soumik Mandal 72 420 0 05 Feb 2018
Nonparametric regression using deep neural networks with ReLU activation function Johannes Schmidt-Hieber 238 816 0 22 Aug 2017
Error bounds for approximations with deep ReLU networks Dmitry Yarotsky 198 1,233 0 03 Oct 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 356 8,002 0 23 May 2016
In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Nathan Srebro AI4CE 99 662 0 20 Dec 2014
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 263 1,201 0 30 Nov 2014
The Falling Factorial Basis and Its Statistical Applications Yu Wang Alex Smola Robert Tibshirani 87 48 0 03 May 2014
Degrees of Freedom and Model Search Robert Tibshirani 165 52 0 09 Feb 2014
Dropout Training as Adaptive Regularization Stefan Wager Sida I. Wang Percy Liang 129 600 0 04 Jul 2013
Adaptive piecewise polynomial estimation via trend filtering Robert Tibshirani 90 396 0 10 Apr 2013