Online to Offline Conversions, Universality and Adaptive Minibatch Sizes

30 May 2017

Papers citing "Online to Offline Conversions, Universality and Adaptive Minibatch Sizes"

19 / 19 papers shown

Title
From Gradient Clipping to Normalization for Heavy Tailed SGD Florian Hübler Ilyas Fatkhullin Niao He 40 5 0 17 Oct 2024
Comparisons Are All You Need for Optimizing Smooth Functions Chenyi Zhang Tongyang Li AAML 37 1 0 19 May 2024
Directional Smoothness and Gradient Methods: Convergence and Adaptivity Aaron Mishkin Ahmed Khaled Yuanhao Wang Aaron Defazio Robert Mansel Gower 44 6 0 06 Mar 2024
A simple uniformly optimal method without line search for convex optimization Tianjiao Li Guanghui Lan 26 20 0 16 Oct 2023
DropCompute: simple and more robust distributed synchronous training via compute variance reduction Niv Giladi Shahar Gottlieb Moran Shkolnik A. Karnieli Ron Banner Elad Hoffer Kfir Y. Levy Daniel Soudry 40 2 0 18 Jun 2023
TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization Xiang Li Junchi Yang Niao He 29 8 0 31 Oct 2022
Nest Your Adaptive Algorithm for Parameter-Agnostic Nonconvex Minimax Optimization Junchi Yang Xiang Li Niao He ODL 40 22 0 01 Jun 2022
A Stochastic Bundle Method for Interpolating Networks Alasdair Paren Leonard Berrada Rudra P. K. Poudel M. P. Kumar 24 4 0 29 Jan 2022
No-Regret Dynamics in the Fenchel Game: A Unified Framework for Algorithmic Convex Optimization Jun-Kun Wang Jacob D. Abernethy Kfir Y. Levy 27 21 0 22 Nov 2021
SVRG Meets AdaGrad: Painless Variance Reduction Benjamin Dubois-Taine Sharan Vaswani Reza Babanezhad Mark W. Schmidt Simon Lacoste-Julien 18 18 0 18 Feb 2021
Geometry-Aware Universal Mirror-Prox Reza Babanezhad Simon Lacoste-Julien 18 4 0 23 Nov 2020
Adaptive and Universal Algorithms for Variational Inequalities with Optimal Convergence Alina Ene Huy Le Nguyen 27 14 0 15 Oct 2020
Adaptive Gradient Methods for Constrained Convex Optimization and Variational Inequalities Alina Ene Huy Le Nguyen Adrian Vladu ODL 30 28 0 17 Jul 2020
UniXGrad: A Universal, Adaptive Algorithm with Optimal Guarantees for Constrained Optimization Ali Kavis Kfir Y. Levy Francis R. Bach V. Cevher ODL 27 56 0 30 Oct 2019
Adaptive Regularization via Residual Smoothing in Deep Learning Optimization Jung-Kyun Cho Junseok Kwon Byung-Woo Hong 31 1 0 23 Jul 2019
Anytime Online-to-Batch Conversions, Optimism, and Acceleration Ashok Cutkosky 13 7 0 03 Mar 2019
Online Adaptive Methods, Universality and Acceleration Kfir Y. Levy A. Yurtsever V. Cevher ODL 28 89 0 08 Sep 2018
AdaGrad stepsizes: Sharp convergence over nonconvex landscapes Rachel A. Ward Xiaoxia Wu Léon Bottou ODL 27 361 0 05 Jun 2018
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 182 683 0 07 Dec 2010