ResearchTrend.AI
SGD with Clipping is Secretly Estimating the Median Gradient

SGD with Clipping is Secretly Estimating the Median Gradient

Fabian Schaipp
Guillaume Garrigos
Umut Simsekli
Robert M. Gower
ArXivPDFHTML

Papers citing "SGD with Clipping is Secretly Estimating the Median Gradient"

4 / 4 papers shown
Title
Convergence Rates of Stochastic Gradient Descent under Infinite Noise Variance
Convergence Rates of Stochastic Gradient Descent under Infinite Noise Variance
Hongjian Wang
Mert Gurbuzbalaban
Lingjiong Zhu
Umut cSimcsekli
Murat A. Erdogdu
31
42
0
20 Feb 2021
Learning from History for Byzantine Robust Optimization
Learning from History for Byzantine Robust Optimization
Sai Praneeth Karimireddy
Lie He
Martin Jaggi
FedML
AAML
48
177
0
18 Dec 2020
Uncertainty Principle for Communication Compression in Distributed and Federated Learning and the Search for an Optimal Compressor
Uncertainty Principle for Communication Compression in Distributed and Federated Learning and the Search for an Optimal Compressor
M. Safaryan
Egor Shulgin
Peter Richtárik
37
61
0
20 Feb 2020
Mean estimation and regression under heavy-tailed distributions--a survey
Mean estimation and regression under heavy-tailed distributions--a survey
Gabor Lugosi
S. Mendelson
71
241
0
10 Jun 2019

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.