Non asymptotic analysis of Adaptive stochastic gradient algorithms and applications

1 March 2023

Papers citing "Non asymptotic analysis of Adaptive stochastic gradient algorithms and applications"

7 / 7 papers shown

Title
Sharp higher order convergence rates for the Adam optimizer Steffen Dereich Arnulf Jentzen Adrian Riekert ODL 61 0 0 28 Apr 2025
Non-asymptotic Analysis of Biased Adaptive Stochastic Approximation Sobihan Surendran Antoine Godichon-Baggioni Adeline Fermanian Sylvain Le Corff 45 1 0 05 Feb 2024
On Adaptive Stochastic Optimization for Streaming Data: A Newton's Method with O(dN) Operations Antoine Godichon-Baggioni Nicklas Werge ODL 37 3 0 29 Nov 2023
Learning from time-dependent streaming data with online stochastic algorithms Antoine Godichon-Baggioni Nicklas Werge Olivier Wintenberger 27 3 0 25 May 2022
A theoretical and empirical study of new adaptive algorithms with additional momentum steps and shifted updates for stochastic non-convex optimization C. Alecsa 17 0 0 16 Oct 2021
A stochastic Gauss-Newton algorithm for regularized semi-discrete optimal transport Bernard Bercu Jérémie Bigot S. Gadat Emilia Siviero 28 6 0 12 Jul 2021
A Simple Convergence Proof of Adam and Adagrad Alexandre Défossez Léon Bottou Francis R. Bach Nicolas Usunier 56 144 0 05 Mar 2020