Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence

27 February 2024

Papers citing "Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence"

20 / 20 papers shown

Title
Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning Kuan-Fu Ding Jingyang Li Kim-Chuan Toh 108 8 0 26 Jun 2023
Reinforcement Learning with General Utilities: Simpler Variance Reduction and Large State-Action Space Anas Barakat Ilyas Fatkhullin Niao He 87 12 0 02 Jun 2023
Momentum Provably Improves Error Feedback! Ilyas Fatkhullin Alexander Tyurin Peter Richtárik 99 23 0 24 May 2023
Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods Junchi Yang Xiang Li Ilyas Fatkhullin Niao He 76 17 0 21 May 2023
High Probability Convergence of Stochastic Gradient Methods Zijian Liu Ta Duy Nguyen Thien Hai Nguyen Alina Ene Huy Le Nguyen 55 44 0 28 Feb 2023
On the Linear convergence of Natural Policy Gradient Algorithm S. Khodadadian P. Jhunjhunwala Sushil Mahavir Varma S. T. Maguluri 84 57 0 04 May 2021
Non-Euclidean Differentially Private Stochastic Convex Optimization: Optimal Rates in Linear Time Raef Bassily Cristóbal Guzmán Anupama Nandi 119 68 0 01 Mar 2021
On the Convergence and Sample Efficiency of Variance-Reduced Policy Gradient Method Junyu Zhang Chengzhuo Ni Zheng Yu Csaba Szepesvári Mengdi Wang 120 69 0 17 Feb 2021
Independent Policy Gradient Methods for Competitive Reinforcement Learning C. Daskalakis Dylan J. Foster Noah Golowich 238 163 0 11 Jan 2021
Variational Policy Gradient Method for Reinforcement Learning with General Utilities Junyu Zhang Alec Koppel Amrit Singh Bedi Csaba Szepesvári Mengdi Wang 72 140 0 04 Jul 2020
Private Stochastic Non-Convex Optimization: Adaptive Algorithms and Tighter Generalization Bounds Yingxue Zhou Xiangyi Chen Mingyi Hong Zhiwei Steven Wu A. Banerjee 83 25 0 24 Jun 2020
Lower Bounds for Non-Convex Stochastic Optimization Yossi Arjevani Y. Carmon John C. Duchi Dylan J. Foster Nathan Srebro Blake E. Woodworth 105 362 0 05 Dec 2019
Unified Optimal Analysis of the (Stochastic) Gradient Method Sebastian U. Stich 68 113 0 09 Jul 2019
Algorithms of Robust Stochastic Optimization Based on Mirror Descent Method A. Juditsky A. Nazin A. S. Nemirovsky Alexandre B. Tsybakov 63 64 0 05 Jul 2019
Why gradient clipping accelerates training: A theoretical justification for adaptivity J.N. Zhang Tianxing He S. Sra Ali Jadbabaie 86 467 0 28 May 2019
A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization Zhize Li Jian Li 89 116 0 13 Feb 2018
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 289 8,928 0 25 Aug 2017
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark Schmidt 280 1,222 0 16 Aug 2016
Deep Learning with Differential Privacy Martín Abadi Andy Chu Ian Goodfellow H. B. McMahan Ilya Mironov Kunal Talwar Li Zhang FedML SyDa 220 6,172 0 01 Jul 2016
Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming Saeed Ghadimi Guanghui Lan ODL 124 1,562 0 22 Sep 2013