Characterizing & Finding Good Data Orderings for Fast Convergence of Sequential Gradient Methods

3 February 2022

Papers citing "Characterizing & Finding Good Data Orderings for Fast Convergence of Sequential Gradient Methods"

13 / 13 papers shown

Title
Provably Faster Algorithms for Bilevel Optimization via Without-Replacement Sampling Junyi Li Heng Huang 39 1 0 07 Nov 2024
On the Last-Iterate Convergence of Shuffling Gradient Methods Zijian Liu Zhengyuan Zhou 42 2 0 12 Mar 2024
Understanding the Training Speedup from Sampling with Approximate Losses Rudrajit Das Xi Chen Bertram Ieong Parikshit Bansal Sujay Sanghavi 21 0 0 10 Feb 2024
Stochastic optimization with arbitrary recurrent data sampling William G. Powell Hanbaek Lyu 37 0 0 15 Jan 2024
AsGrad: A Sharp Unified Analysis of Asynchronous-SGD Algorithms Rustem Islamov M. Safaryan Dan Alistarh FedML 29 12 0 31 Oct 2023
On The Impact of Machine Learning Randomness on Group Fairness Prakhar Ganesh Hong Chang Martin Strobel Reza Shokri FaML 30 30 0 09 Jul 2023
Ordering for Non-Replacement SGD Yuetong Xu Baharan Mirzasoleiman 15 0 0 28 Jun 2023
On Convergence of Incremental Gradient for Non-Convex Smooth Functions Anastasia Koloskova N. Doikov Sebastian U. Stich Martin Jaggi 36 2 0 30 May 2023
Select without Fear: Almost All Mini-Batch Schedules Generalize Optimally Konstantinos E. Nikolakakis Amin Karbasi Dionysis Kalogerias 33 5 0 03 May 2023
Tighter Lower Bounds for Shuffling SGD: Random Permutations and Beyond Jaeyoung Cha Jaewook Lee Chulhee Yun 28 23 0 13 Mar 2023
Coordinating Distributed Example Orders for Provably Accelerated Training A. Feder Cooper Wentao Guo Khiem Pham Tiancheng Yuan Charlie F. Ruan Yucheng Lu Chris De Sa 38 6 0 02 Feb 2023
GraB: Finding Provably Better Data Permutations than Random Reshuffling Yucheng Lu Wentao Guo Christopher De Sa FedML 26 16 0 22 May 2022
Manipulating SGD with Data Ordering Attacks Ilia Shumailov Zakhar Shumaylov Dmitry Kazhdan Yiren Zhao Nicolas Papernot Murat A. Erdogdu Ross J. Anderson AAML 112 90 0 19 Apr 2021