ResearchTrend.AI
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition
v1v2v3v4 (latest)

Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition

Hamed Karimi
J. Nutini
Mark Schmidt
ArXiv (abs)PDFHTML

Papers citing "Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition"

50 / 589 papers shown
Title
Towards Sharper Risk Bounds for Minimax Problems
Towards Sharper Risk Bounds for Minimax Problems
Bowei Zhu
Shaojie Li
Yong Liu
72
0
0
11 Oct 2024
Nesterov acceleration in benignly non-convex landscapes
Nesterov acceleration in benignly non-convex landscapes
Kanan Gupta
Stephan Wojtowytsch
84
2
0
10 Oct 2024
A Novel Framework of Horizontal-Vertical Hybrid Federated Learning for EdgeIoT
A Novel Framework of Horizontal-Vertical Hybrid Federated Learning for EdgeIoT
Kai Li
Yilei Liang
Xin Yuan
Wei Ni
Jon Crowcroft
Chau Yuen
Ozgur B. Akan
FedML
64
3
0
02 Oct 2024
Zeroth-Order Policy Gradient for Reinforcement Learning from Human Feedback without Reward Inference
Zeroth-Order Policy Gradient for Reinforcement Learning from Human Feedback without Reward Inference
Qining Zhang
Lei Ying
OffRL
141
4
0
25 Sep 2024
From exponential to finite/fixed-time stability: Applications to optimization
From exponential to finite/fixed-time stability: Applications to optimization
Ibrahim Kurban Özaslan
Mihailo R. Jovanović
65
2
0
18 Sep 2024
Rewind-to-Delete: Certified Machine Unlearning for Nonconvex Functions
Rewind-to-Delete: Certified Machine Unlearning for Nonconvex Functions
Siqiao Mu
Diego Klabjan
MU
136
5
0
15 Sep 2024
Compute-Update Federated Learning: A Lattice Coding Approach
Compute-Update Federated Learning: A Lattice Coding Approach
Seyed Mohammad Azimi-Abarghouyi
Lav Varshney
FedML
59
1
0
10 Sep 2024
Smoothed Robust Phase Retrieval
Smoothed Robust Phase Retrieval
Zhong Zheng
Lingzhou Xue
63
2
0
03 Sep 2024
In-Context Learning with Representations: Contextual Generalization of Trained Transformers
In-Context Learning with Representations: Contextual Generalization of Trained Transformers
Tong Yang
Yu Huang
Yingbin Liang
Yuejie Chi
MLT
115
12
0
19 Aug 2024
Mask in the Mirror: Implicit Sparsification
Mask in the Mirror: Implicit Sparsification
Tom Jacobs
R. Burkholz
191
4
0
19 Aug 2024
Absence of Closed-Form Descriptions for Gradient Flow in Two-Layer Narrow Networks
Absence of Closed-Form Descriptions for Gradient Flow in Two-Layer Narrow Networks
Yeachan Park
AI4CE
112
0
0
15 Aug 2024
Nonlinear Perturbation-based Non-Convex Optimization over Time-Varying Networks
Nonlinear Perturbation-based Non-Convex Optimization over Time-Varying Networks
Mohammadreza Doostmohammadian
Zulfiya R. Gabidullina
Hamid R. Rabiee
64
9
0
05 Aug 2024
Complexity of Minimizing Projected-Gradient-Dominated Functions with Stochastic First-order Oracles
Complexity of Minimizing Projected-Gradient-Dominated Functions with Stochastic First-order Oracles
Saeed Masiha
Saber Salehkaleybar
Niao He
Negar Kiyavash
Patrick Thiran
75
2
0
03 Aug 2024
Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization
Optimal Hessian/Jacobian-Free Nonconvex-PL Bilevel Optimization
Feihu Huang
101
5
0
25 Jul 2024
Quantum Natural Stochastic Pairwise Coordinate Descent
Quantum Natural Stochastic Pairwise Coordinate Descent
Mohammad Aamir Sohail
M. H. Khoozani
S. S. Pradhan
79
2
0
18 Jul 2024
An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes
An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes
Antonio Orvieto
Lin Xiao
84
4
0
05 Jul 2024
Online Non-Stationary Stochastic Quasar-Convex Optimization
Online Non-Stationary Stochastic Quasar-Convex Optimization
Yuen-Man Pun
Iman Shames
40
0
0
04 Jul 2024
Tracking solutions of time-varying variational inequalities
Tracking solutions of time-varying variational inequalities
Hédi Hadiji
Sarah Sachs
Cristóbal Guzmán
78
1
0
20 Jun 2024
On the Convergence of Tâtonnement for Linear Fisher Markets
On the Convergence of Tâtonnement for Linear Fisher Markets
Tianlong Nan
Yuan Gao
Christian Kroer
40
1
0
18 Jun 2024
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints
A Primal-Dual-Assisted Penalty Approach to Bilevel Optimization with Coupled Constraints
Liuyuan Jiang
Quan-Wu Xiao
Victor M. Tenorio
Fernando Real-Rojas
Antonio G. Marques
Tianyi Chen
143
2
0
14 Jun 2024
Provable Optimization for Adversarial Fair Self-supervised Contrastive Learning
Provable Optimization for Adversarial Fair Self-supervised Contrastive Learning
Qi Qi
Quanqi Hu
Qihang Lin
Tianbao Yang
126
1
0
09 Jun 2024
A Generalized Version of Chung's Lemma and its Applications
A Generalized Version of Chung's Lemma and its Applications
Li Jiang
Xiao Li
Andre Milzarek
Junwen Qiu
71
1
0
09 Jun 2024
Perturbation Towards Easy Samples Improves Targeted Adversarial Transferability
Perturbation Towards Easy Samples Improves Targeted Adversarial Transferability
Junqi Gao
Biqing Qi
Yao Li
Zhichang Guo
Dong Li
Yuming Xing
Dazhi Zhang
AAML
75
7
0
08 Jun 2024
Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation
Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation
Yibo Yang
Xiaojie Li
Motasem Alfarra
Hasan Hammoud
Adel Bibi
Philip Torr
Guohao Li
81
3
0
07 Jun 2024
Understanding Stochastic Natural Gradient Variational Inference
Understanding Stochastic Natural Gradient Variational Inference
Kaiwen Wu
Jacob R. Gardner
BDL
87
2
0
04 Jun 2024
Demystifying SGD with Doubly Stochastic Gradients
Demystifying SGD with Doubly Stochastic Gradients
Kyurae Kim
Joohwan Ko
Yian Ma
Jacob R. Gardner
147
2
0
03 Jun 2024
Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning
Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning
Tiansheng Huang
Sihao Hu
Fatih Ilhan
Selim Furkan Tekin
Ling Liu
153
32
0
28 May 2024
Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks
Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks
D. Kovalev
Ekaterina Borodich
Alexander Gasnikov
Dmitrii Feoktistov
79
1
0
28 May 2024
On Mesa-Optimization in Autoregressively Trained Transformers: Emergence and Capability
On Mesa-Optimization in Autoregressively Trained Transformers: Emergence and Capability
Chenyu Zheng
Wei Huang
Rongzheng Wang
Guoqiang Wu
Jun Zhu
Chongxuan Li
92
2
0
27 May 2024
Almost sure convergence rates of stochastic gradient methods under gradient domination
Almost sure convergence rates of stochastic gradient methods under gradient domination
Simon Weissmann
Sara Klein
Waïss Azizian
Leif Döring
93
3
0
22 May 2024
Federated Learning With Energy Harvesting Devices: An MDP Framework
Federated Learning With Energy Harvesting Devices: An MDP Framework
Kai Zhang
Xu Cao
Khaled B. Letaief
67
3
0
17 May 2024
Minimisation of Polyak-Łojasewicz Functions Using Random Zeroth-Order Oracles
Minimisation of Polyak-Łojasewicz Functions Using Random Zeroth-Order Oracles
Amir Ali Farzin
Iman Shames
53
1
0
15 May 2024
Fast Two-Time-Scale Stochastic Gradient Method with Applications in Reinforcement Learning
Fast Two-Time-Scale Stochastic Gradient Method with Applications in Reinforcement Learning
Sihan Zeng
Thinh T. Doan
147
5
0
15 May 2024
Data-Efficient and Robust Task Selection for Meta-Learning
Data-Efficient and Robust Task Selection for Meta-Learning
Donglin Zhan
James Anderson
OOD
98
2
0
11 May 2024
Robust Semi-supervised Learning by Wisely Leveraging Open-set Data
Robust Semi-supervised Learning by Wisely Leveraging Open-set Data
Yang Yang
Nan Jiang
Yi Tian Xu
De-Chuan Zhan
96
18
0
11 May 2024
$ε$-Policy Gradient for Online Pricing
εε-Policy Gradient for Online Pricing
Lukasz Szpruch
Tanut Treetanthiploet
Yufei Zhang
OffRL
87
1
0
06 May 2024
Learning Optimal Deterministic Policies with Stochastic Policy Gradients
Learning Optimal Deterministic Policies with Stochastic Policy Gradients
Alessandro Montenegro
Marco Mussi
Alberto Maria Metelli
Matteo Papini
79
3
0
03 May 2024
The Privacy Power of Correlated Noise in Decentralized Learning
The Privacy Power of Correlated Noise in Decentralized Learning
Youssef Allouah
Anastasia Koloskova
Aymane El Firdoussi
Martin Jaggi
R. Guerraoui
82
6
0
02 May 2024
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization
Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization
Chris Junchi Li
102
0
0
01 May 2024
On the Relevance of Byzantine Robust Optimization Against Data Poisoning
On the Relevance of Byzantine Robust Optimization Against Data Poisoning
Sadegh Farhadkhani
R. Guerraoui
Nirupam Gupta
Rafael Pinot
AAML
71
1
0
01 May 2024
Any-Quantile Probabilistic Forecasting of Short-Term Electricity Demand
Any-Quantile Probabilistic Forecasting of Short-Term Electricity Demand
Slawek Smyl
Boris N. Oreshkin
Paweł Pełka
Grzegorz Dudek
AI4TS
76
0
0
26 Apr 2024
Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey
Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey
Feng Liang
Zhen Zhang
Haifeng Lu
Victor C. M. Leung
Yanyi Guo
Xiping Hu
GNN
103
8
0
09 Apr 2024
Revisiting Random Weight Perturbation for Efficiently Improving Generalization
Revisiting Random Weight Perturbation for Efficiently Improving Generalization
Tao Li
Qinghua Tao
Weihao Yan
Zehao Lei
Yingwen Wu
Kun Fang
Mingzhen He
Xiaolin Huang
AAML
114
6
0
30 Mar 2024
The Effectiveness of Local Updates for Decentralized Learning under Data Heterogeneity
The Effectiveness of Local Updates for Decentralized Learning under Data Heterogeneity
Tongle Wu
Ying Sun
51
1
0
23 Mar 2024
Understanding and Improving Training-free Loss-based Diffusion Guidance
Understanding and Improving Training-free Loss-based Diffusion Guidance
Yifei Shen
Xinyang Jiang
Yezhen Wang
Yifan Yang
Dongqi Han
Dongsheng Li
FaML
86
14
0
19 Mar 2024
Friendly Sharpness-Aware Minimization
Friendly Sharpness-Aware Minimization
Tao Li
Pan Zhou
Zhengbao He
Xinwen Cheng
Xiaolin Huang
AAML
80
17
0
19 Mar 2024
Directional Smoothness and Gradient Methods: Convergence and Adaptivity
Directional Smoothness and Gradient Methods: Convergence and Adaptivity
Aaron Mishkin
Ahmed Khaled
Yuanhao Wang
Aaron Defazio
Robert Mansel Gower
133
9
0
06 Mar 2024
Level Set Teleportation: An Optimization Perspective
Level Set Teleportation: An Optimization Perspective
Aaron Mishkin
A. Bietti
Robert Mansel Gower
112
1
0
05 Mar 2024
Error bounds for particle gradient descent, and extensions of the log-Sobolev and Talagrand inequalities
Error bounds for particle gradient descent, and extensions of the log-Sobolev and Talagrand inequalities
Rocco Caprio
Juan Kuntz
Samuel Power
A. M. Johansen
90
10
0
04 Mar 2024
From Inverse Optimization to Feasibility to ERM
From Inverse Optimization to Feasibility to ERM
Saurabh Mishra
Anant Raj
Sharan Vaswani
85
3
0
27 Feb 2024