Implicit Regularization and Momentum Algorithms in Nonlinearly Parameterized Adaptive Control and Prediction

31 December 2019

Papers citing "Implicit Regularization and Momentum Algorithms in Nonlinearly Parameterized Adaptive Control and Prediction"

29 / 29 papers shown

Title
Learning Stability Certificates from Data Nicholas M. Boffi Stephen Tu Nikolai Matni Jean-Jacques E. Slotine Vikas Sindhwani 48 97 0 13 Aug 2020
Learning nonlinear dynamical systems from a single trajectory Dylan J. Foster Alexander Rakhlin Tuhin Sarkar 50 73 0 30 Apr 2020
Optimization with Momentum: Dynamical, Control-Theoretic, and Symplectic Perspectives Michael Muehlebach Michael I. Jordan 59 65 0 28 Feb 2020
Symplectic Recurrent Neural Networks Zhengdao Chen Jianyu Zhang Martín Arjovsky Léon Bottou 209 225 0 29 Sep 2019
Introduction to Online Convex Optimization Elad Hazan OffRL 172 1,929 0 07 Sep 2019
Benign Overfitting in Linear Regression Peter L. Bartlett Philip M. Long Gábor Lugosi Alexander Tsigler MLT 79 776 0 26 Jun 2019
Stochastic Mirror Descent on Overparameterized Nonlinear Models: Convergence, Implicit Regularization, and Generalization Navid Azizan Sahin Lale B. Hassibi 133 72 0 10 Jun 2019
Generalized Momentum-Based Methods: A Hamiltonian Perspective Jelena Diakonikolas Michael I. Jordan 60 57 0 02 Jun 2019
A Dynamical Systems Perspective on Nesterov Acceleration Michael Muehlebach Michael I. Jordan 64 121 0 17 May 2019
Harmless interpolation of noisy data in regression Vidya Muthukumar Kailas Vodrahalli Vignesh Subramanian A. Sahai 74 202 0 21 Mar 2019
Conformal Symplectic and Relativistic Optimization G. Francca Jeremias Sulam Daniel P. Robinson René Vidal 44 69 0 11 Mar 2019
Acceleration via Symplectic Discretization of High-Resolution Differential Equations Bin Shi S. Du Weijie J. Su Michael I. Jordan 46 121 0 11 Feb 2019
Reconciling modern machine learning practice and the bias-variance trade-off M. Belkin Daniel J. Hsu Siyuan Ma Soumik Mandal 227 1,647 0 28 Dec 2018
A continuous-time analysis of distributed stochastic gradient Nicholas M. Boffi Jean-Jacques E. Slotine 46 15 0 28 Dec 2018
The Sparse Manifold Transform Yubei Chen Dylan M. Paiton Bruno A. Olshausen MedIm 40 57 0 23 Jun 2018
Stochastic Gradient/Mirror Descent: Minimax Optimality and Implicit Regularization Navid Azizan B. Hassibi 46 63 0 04 Jun 2018
Implicit Bias of Gradient Descent on Linear Convolutional Networks Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro MDE 124 412 0 01 Jun 2018
Characterizing Implicit Bias in Terms of Optimization Geometry Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro AI4CE 73 409 0 22 Feb 2018
Iterate averaging as regularization for stochastic gradient descent Gergely Neu Lorenzo Rosasco MoMe 76 61 0 22 Feb 2018
Learning One Convolutional Layer with Overlapping Patches Surbhi Goel Adam R. Klivans Raghu Meka MLT 76 81 0 07 Feb 2018
The Implicit Bias of Gradient Descent on Separable Data Daniel Soudry Elad Hoffer Mor Shpigel Nacson Suriya Gunasekar Nathan Srebro 156 917 0 27 Oct 2017
Cooperative Adaptive Control for Cloud-Based Robotics Patrick M. Wensing Jean-Jacques E. Slotine 48 18 0 21 Sep 2017
Predicting non-linear dynamics by stable local learning in a recurrent spiking neural network Aditya Gilra W. Gerstner 42 80 0 21 Feb 2017
Linear Matrix Inequalities for Physically-Consistent Inertial Parameter Identification: A Statistical Perspective on the Mass Distribution Patrick M. Wensing Sangbae Kim Jean-Jacques E. Slotine 65 123 0 16 Jan 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 339 4,626 0 10 Nov 2016
A Variational Perspective on Accelerated Methods in Optimization Andre Wibisono Ashia Wilson Michael I. Jordan 85 573 0 14 Mar 2016
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 162 1,166 0 04 Mar 2015
Deep learning with Elastic Averaging SGD Sixin Zhang A. Choromańska Yann LeCun FedML 96 610 0 20 Dec 2014
Efficient Learning of Generalized Linear and Single Index Models with Isotonic Regression Sham Kakade Adam Tauman Kalai Varun Kanade Ohad Shamir 192 179 0 11 Apr 2011