Last Iterate Convergence of Incremental Methods and Applications in Continual Learning

11 March 2024

Papers citing "Last Iterate Convergence of Incremental Methods and Applications in Continual Learning"

9 / 9 papers shown

Title
Better Rates for Random Task Orderings in Continual Linear Models Itay Evron Ran Levinstein Matan Schliserman Uri Sherman Tomer Koren Daniel Soudry Nathan Srebro CLL 35 0 0 06 Apr 2025
Privacy of the last iterate in cyclically-sampled DP-SGD on nonconvex composite losses Weiwei Kong Mónica Ribero 26 3 0 07 Jul 2024
On the Last-Iterate Convergence of Shuffling Gradient Methods Zijian Liu Zhengyuan Zhou 39 2 0 12 Mar 2024
The Joint Effect of Task Similarity and Overparameterization on Catastrophic Forgetting -- An Analytical Model Daniel Goldfarb Itay Evron Nir Weinberger Daniel Soudry Paul Hand 39 12 0 23 Jan 2024
High Probability Guarantees for Random Reshuffling Hengxu Yu Xiao Li 37 2 0 20 Nov 2023
The Ideal Continual Learner: An Agent That Never Forgets Liangzu Peng Paris V. Giampouras René Vidal CLL 108 26 0 29 Apr 2023
Cyclic Coordinate Dual Averaging with Extrapolation Chaobing Song Jelena Diakonikolas 27 6 0 26 Feb 2021
Fast Epigraphical Projection-based Incremental Algorithms for Wasserstein Distributionally Robust Support Vector Machine Jiajin Li Caihua Chen Anthony Man-Cho So OOD 38 22 0 24 Oct 2020
Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes Ohad Shamir Tong Zhang 101 570 0 08 Dec 2012