Hybrid Stochastic Gradient Descent Algorithms for Stochastic Nonconvex
Optimization

Hybrid Stochastic Gradient Descent Algorithms for Stochastic Nonconvex Optimization

15 May 2019

Papers citing "Hybrid Stochastic Gradient Descent Algorithms for Stochastic Nonconvex Optimization"

18 / 18 papers shown

Title
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 52 2 0 28 Sep 2024
Probabilistic Guarantees of Stochastic Recursive Gradient in Non-Convex Finite Sum Problems Yanjie Zhong Jiaqi Li Soumendra Lahiri 29 1 0 29 Jan 2024
From Adaptive Query Release to Machine Unlearning Enayat Ullah R. Arora MU 30 4 0 20 Jul 2023
Breaking the Lower Bound with (Little) Structure: Acceleration in Non-Convex Stochastic Optimization with Heavy-Tailed Noise Zijian Liu Jiawei Zhang Zhengyuan Zhou 34 12 0 14 Feb 2023
Near-Optimal Non-Convex Stochastic Optimization under Generalized Smoothness Zijian Liu Srikanth Jagabathula Zhengyuan Zhou 24 5 0 13 Feb 2023
Passage-Mask: A Learnable Regularization Strategy for Retriever-Reader Models Shujian Zhang Chengyue Gong Xingchao Liu RALM 51 6 0 02 Nov 2022
Training Structured Neural Networks Through Manifold Identification and Variance Reduction Zih-Syuan Huang Ching-pei Lee AAML 48 9 0 05 Dec 2021
Faster Perturbed Stochastic Gradient Methods for Finding Local Minima Zixiang Chen Dongruo Zhou Quanquan Gu 43 1 0 25 Oct 2021
Provably Faster Algorithms for Bilevel Optimization Junjie Yang Kaiyi Ji Yingbin Liang 51 132 0 08 Jun 2021
GT-STORM: Taming Sample, Communication, and Memory Complexities in Decentralized Non-Convex Learning Xin Zhang Jia Liu Zhengyuan Zhu Elizabeth S. Bentley 49 14 0 04 May 2021
A Near-Optimal Algorithm for Stochastic Bilevel Optimization via Double-Momentum Prashant Khanduri Siliang Zeng Mingyi Hong Hoi-To Wai Zhaoran Wang Zhuoran Yang 17 129 0 15 Feb 2021
SMG: A Shuffling Gradient-Based Method with Momentum Trang H. Tran Lam M. Nguyen Quoc Tran-Dinh 23 21 0 24 Nov 2020
Optimization for Supervised Machine Learning: Randomized Algorithms for Data and Parameters Filip Hanzely 37 0 0 26 Aug 2020
Riemannian stochastic recursive momentum method for non-convex optimization Andi Han Junbin Gao ODL 28 17 0 11 Aug 2020
Momentum-based variance-reduced proximal stochastic gradient method for composite nonconvex stochastic optimization Yangyang Xu Yibo Xu 28 23 0 31 May 2020
Adaptivity of Stochastic Gradient Methods for Nonconvex Optimization Samuel Horváth Lihua Lei Peter Richtárik Michael I. Jordan 57 30 0 13 Feb 2020
Better Theory for SGD in the Nonconvex World Ahmed Khaled Peter Richtárik 13 179 0 09 Feb 2020
A Proximal Stochastic Gradient Method with Progressive Variance Reduction Lin Xiao Tong Zhang ODL 93 737 0 19 Mar 2014