Graph Oracle Models, Lower Bounds, and Gaps for Parallel Stochastic Optimization

25 May 2018

Papers citing "Graph Oracle Models, Lower Bounds, and Gaps for Parallel Stochastic Optimization"

28 / 28 papers shown

Title
Ringmaster ASGD: The First Asynchronous SGD with Optimal Time Complexity Artavazd Maranjyan A. Tyurin Peter Richtárik 49 3 0 27 Jan 2025
The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication Kumar Kshitij Patel Margalit Glasgow Ali Zindari Lingxiao Wang Sebastian U. Stich Ziheng Cheng Nirmit Joshi Nathan Srebro 48 6 0 19 May 2024
Distributed Personalized Empirical Risk Minimization Yuyang Deng Mohammad Mahdi Kamani Pouria Mahdavinia M. Mahdavi 33 4 0 26 Oct 2023
Communication-Efficient Local SGD with Age-Based Worker Selection Feng Zhu Jingjing Zhang Xin Eric Wang 50 1 0 31 Oct 2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization Feng Zhu Jingjing Zhang Xin Eric Wang 33 3 0 06 Oct 2022
FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction Liang Gao Huazhu Fu Li Li Yingwen Chen Minghua Xu Chengzhong Xu FedML 40 243 0 22 Mar 2022
On the Convergence of Heterogeneous Federated Learning with Arbitrary Adaptive Online Model Pruning Hanhan Zhou Tian-Shing Lan Guru Venkataramani Wenbo Ding FedML 32 6 0 27 Jan 2022
Federated Optimization of Smooth Loss Functions Ali Jadbabaie A. Makur Devavrat Shah FedML 32 7 0 06 Jan 2022
A Stochastic Newton Algorithm for Distributed Convex Optimization Brian Bullins Kumar Kshitij Patel Ohad Shamir Nathan Srebro Blake E. Woodworth 28 15 0 07 Oct 2021
Byzantine-Robust Federated Learning via Credibility Assessment on Non-IID Data Kun Zhai Qiang Ren Junli Wang Chungang Yan 18 11 0 06 Sep 2021
Federated Learning with Taskonomy for Non-IID Data Hadi Jamali Rad Mohammad Abdizadeh Anuj Singh FedML 48 54 0 29 Mar 2021
Personalized Federated Learning: A Unified Framework and Universal Optimization Techniques Filip Hanzely Boxin Zhao Mladen Kolar FedML 34 53 0 19 Feb 2021
FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tiers Zheng Chai Yujing Chen Ali Anwar Liang Zhao Yue Cheng Huzefa Rangwala FedML 26 122 0 12 Oct 2020
Lower Bounds and Optimal Algorithms for Personalized Federated Learning Filip Hanzely Slavomír Hanzely Samuel Horváth Peter Richtárik FedML 59 187 0 05 Oct 2020
Fast-Convergent Federated Learning Hung T. Nguyen Vikash Sehwag Seyyedali Hosseinalipour Christopher G. Brinton M. Chiang H. Vincent Poor FedML 33 192 0 26 Jul 2020
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization Jianyu Wang Qinghua Liu Hao Liang Gauri Joshi H. Vincent Poor MoMe FedML 23 1,304 0 15 Jul 2020
Optimal Complexity in Decentralized Training Yucheng Lu Christopher De Sa 38 72 0 15 Jun 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 43 493 0 23 Mar 2020
Three Approaches for Personalization with Applications to Federated Learning Yishay Mansour M. Mohri Jae Hun Ro A. Suresh FedML 45 566 0 25 Feb 2020
Is Local SGD Better than Minibatch SGD? Blake E. Woodworth Kumar Kshitij Patel Sebastian U. Stich Zhen Dai Brian Bullins H. B. McMahan Ohad Shamir Nathan Srebro FedML 34 253 0 18 Feb 2020
The Error-Feedback Framework: Better Rates for SGD with Delayed Gradients and Compressed Communication Sebastian U. Stich Sai Praneeth Karimireddy FedML 25 20 0 11 Sep 2019
On the Convergence of FedAvg on Non-IID Data Xiang Li Kaixuan Huang Wenhao Yang Shusen Wang Zhihua Zhang FedML 112 2,290 0 04 Jul 2019
Communication-Efficient Accurate Statistical Estimation Jianqing Fan Yongyi Guo Kaizheng Wang 19 110 0 12 Jun 2019
Fair Resource Allocation in Federated Learning Tian Li Maziar Sanjabi Ahmad Beirami Virginia Smith FedML 18 783 0 25 May 2019
Semi-Cyclic Stochastic Gradient Descent Hubert Eichner Tomer Koren H. B. McMahan Nathan Srebro Kunal Talwar 33 106 0 23 Apr 2019
Lower Bounds for Parallel and Randomized Convex Optimization Jelena Diakonikolas Cristóbal Guzmán 33 44 0 05 Nov 2018
Parallelization does not Accelerate Convex Optimization: Adaptivity Lower Bounds for Non-smooth Convex Minimization Eric Balkanski Yaron Singer 22 31 0 12 Aug 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 85 1,047 0 24 May 2018