DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization

4 October 2021

Papers citing "DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization"

15 / 15 papers shown

Title
Characterizing the Accuracy-Communication-Privacy Trade-off in Distributed Stochastic Convex Optimization Sudeep Salgia Nikola Pavlovic Yuejie Chi Qing Zhao 54 0 0 06 Jan 2025
Energy-Aware Decentralized Learning with Intermittent Model Training Akash Dhasade Paolo Dini Elia Guerra Anne-Marie Kermarrec M. Miozzo Rafael Pires Rishi Sharma M. Vos 43 0 0 01 Jul 2024
Robust Decentralized Learning with Local Updates and Gradient Tracking Sajjad Ghiasvand Amirhossein Reisizadeh Mahnoosh Alizadeh Ramtin Pedarsani 42 3 0 02 May 2024
The Effectiveness of Local Updates for Decentralized Learning under Data Heterogeneity Tongle Wu Ying Sun 44 0 0 23 Mar 2024
On the Complexity of Finite-Sum Smooth Optimization under the Polyak-Łojasiewicz Condition Yunyan Bai Yuxing Liu Luo Luo 26 0 0 04 Feb 2024
Decentralized Sum-of-Nonconvex Optimization Zhuanghua Liu K. H. Low 21 0 0 04 Feb 2024
Sparse Training for Federated Learning with Regularized Error Correction Ran Greidi Kobi Cohen FedML 35 1 0 21 Dec 2023
Communication-Efficient Federated Optimization over Semi-Decentralized Networks He Wang Yuejie Chi FedML 44 2 0 30 Nov 2023
Stability and Generalization for Minibatch SGD and Local SGD Yunwen Lei Tao Sun Mingrui Liu 43 3 0 02 Oct 2023
Convergence and Privacy of Decentralized Nonconvex Optimization with Gradient Clipping and Communication Compression Boyue Li Yuejie Chi 26 12 0 17 May 2023
An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization Le‐Yu Chen Haishan Ye Luo Luo 78 5 0 05 Dec 2022
Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization Zhize Li Jian Li 43 6 0 22 Aug 2022
Tackling Data Heterogeneity: A New Unified Framework for Decentralized SGD with Sample-induced Topology Yan Huang Ying Sun Zehan Zhu Changzhi Yan Jinming Xu FedML 38 15 0 08 Jul 2022
SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compression Zhize Li Haoyu Zhao Boyue Li Yuejie Chi FedML 35 41 0 20 Jun 2022
BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression Haoyu Zhao Boyue Li Zhize Li Peter Richtárik Yuejie Chi 37 49 0 31 Jan 2022