A Nonstochastic Control Approach to Optimization

19 January 2023

Papers citing "A Nonstochastic Control Approach to Optimization"

28 / 28 papers shown

Title
Online Nonstochastic Model-Free Reinforcement Learning Udaya Ghai Arushi Gupta Wenhan Xia Karan Singh Elad Hazan OffRL 47 6 0 27 May 2023
VeLO: Training Versatile Learned Optimizers by Scaling Up Luke Metz James Harrison C. Freeman Amil Merchant Lucas Beyer ... Naman Agrawal Ben Poole Igor Mordatch Adam Roberts Jascha Narain Sohl-Dickstein 57 60 0 17 Nov 2022
A Closer Look at Learned Optimization: Stability, Robustness, and Inductive Biases James Harrison Luke Metz Jascha Narain Sohl-Dickstein 74 22 0 22 Sep 2022
Practical tradeoffs between memory, compute, and performance in learned optimizers Luke Metz C. Freeman James Harrison Niru Maheswaranathan Jascha Narain Sohl-Dickstein 65 32 0 22 Mar 2022
Online Control of Unknown Time-Varying Dynamical Systems Edgar Minasyan Paula Gradu Max Simchowitz Elad Hazan OffRL 41 31 0 16 Feb 2022
Learning to Optimize: A Primer and A Benchmark Tianlong Chen Xiaohan Chen Wuyang Chen Howard Heaton Jialin Liu Zhangyang Wang W. Yin 135 231 0 23 Mar 2021
SGD in the Large: Average-case Analysis, Asymptotics, and Stepsize Criticality Courtney Paquette Kiwon Lee Fabian Pedregosa Elliot Paquette 28 33 0 08 Feb 2021
Optimizing Optimizers: Regret-optimal gradient descent algorithms P. Casgrain Anastasis Kratsios 44 5 0 31 Dec 2020
Average-case Acceleration for Bilinear Games and Normal Matrices Carles Domingo-Enrich Fabian Pedregosa Damien Scieur 34 7 0 05 Oct 2020
A Modular Analysis of Provable Acceleration via Polyak's Momentum: Training a Wide ReLU Network and a Deep Linear Network Jun-Kun Wang Chi-Heng Lin Jacob D. Abernethy 26 23 0 04 Oct 2020
Non-Stochastic Control with Bandit Feedback Paula Gradu John Hallman Elad Hazan 34 28 0 12 Aug 2020
Black-Box Control for Linear Dynamical Systems Xinyi Chen Elad Hazan 29 81 0 13 Jul 2020
Adaptive Regret for Control of Time-Varying Dynamics Paula Gradu Elad Hazan Edgar Minasyan 67 47 0 08 Jul 2020
Guarantees for Tuning the Step Size using a Learning-to-Learn Approach Xiang Wang Shuai Yuan Chenwei Wu Rong Ge 38 16 0 30 Jun 2020
Improper Learning for Non-Stochastic Control Max Simchowitz Karan Singh Elad Hazan 42 154 0 25 Jan 2020
Introduction to Online Convex Optimization Elad Hazan OffRL 102 1,922 0 07 Sep 2019
A Dynamical Systems Perspective on Nesterov Acceleration Michael Muehlebach Michael I. Jordan 51 120 0 17 May 2019
Online Control with Adversarial Disturbances Naman Agarwal Brian Bullins Elad Hazan Sham Kakade Karan Singh 30 236 0 23 Feb 2019
Online Linear Quadratic Control Alon Cohen Avinatan Hassidim Tomer Koren N. Lazić Yishay Mansour Kunal Talwar 43 149 0 19 Jun 2018
Hyperparameter Optimization: A Spectral Approach Elad Hazan Adam R. Klivans Yang Yuan 46 118 0 02 Jun 2017
Learned Optimizers that Scale and Generalize Olga Wichrowska Niru Maheswaranathan Matthew W. Hoffman Sergio Gomez Colmenarejo Misha Denil Nando de Freitas Jascha Narain Sohl-Dickstein AI4CE 52 284 0 14 Mar 2017
Online Learning Rate Adaptation with Hypergradient Descent A. G. Baydin R. Cornish David Martínez-Rubio Mark Schmidt Frank Wood ODL 54 247 0 14 Mar 2017
Learning to Optimize Neural Nets Ke Li Jitendra Malik 47 131 0 01 Mar 2017
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 149 1,161 0 04 Mar 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.0K 149,474 0 22 Dec 2014
Practical recommendations for gradient-based training of deep architectures Yoshua Bengio 3DH ODL 150 2,195 0 24 Jun 2012
Practical Bayesian Optimization of Machine Learning Algorithms Jasper Snoek Hugo Larochelle Ryan P. Adams 298 7,883 0 13 Jun 2012
Slow Learners are Fast John Langford Alex Smola Martin A. Zinkevich 76 390 0 03 Nov 2009