Momentum Tracking: Momentum Acceleration for Decentralized Deep Learning
on Heterogeneous Data

Momentum Tracking: Momentum Acceleration for Decentralized Deep Learning on Heterogeneous Data

30 September 2022

Papers citing "Momentum Tracking: Momentum Acceleration for Decentralized Deep Learning on Heterogeneous Data"

14 / 14 papers shown

Title
Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum Yuan Zhou Xinli Shi Xuelong Li Jiachen Zhong G. Wen Jinde Cao FedML 50 0 0 17 Apr 2025
PDSL: Privacy-Preserved Decentralized Stochastic Learning with Heterogeneous Data Distribution Lina Wang Yunsheng Yuan Chunxiao Wang Feng Li FedML 43 0 0 31 Mar 2025
A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration Yuchen Hu Xi Chen Weidong Liu Xiaojun Mao 62 0 0 31 Jan 2025
Scalable Decentralized Learning with Teleportation Yuki Takezawa Sebastian U. Stich 72 1 0 25 Jan 2025
ROSS:RObust decentralized Stochastic learning based on Shapley values Lina Wang Yunsheng Yuan Feng Li Lingjie Duan FedML 52 0 0 01 Nov 2024
FedNMUT -- Federated Noisy Model Update Tracking Convergence Analysis Vishnu Pandi Chellapandi Antesh Upadhyay Abolfazl Hashemi Stanislaw H. .Zak FedML 30 2 0 20 Mar 2024
Averaging Rate Scheduler for Decentralized Learning on Heterogeneous Data Sai Aparna Aketi Sakshi Choudhary Kaushik Roy 32 1 0 05 Mar 2024
An Accelerated Distributed Stochastic Gradient Method with Momentum Kun-Yen Huang Shi Pu Angelia Nedić 35 8 0 15 Feb 2024
Cross-feature Contrastive Loss for Decentralized Deep Learning on Heterogeneous Data Sai Aparna Aketi Kaushik Roy FedML 32 2 0 24 Oct 2023
Momentum Provably Improves Error Feedback! Ilyas Fatkhullin A. Tyurin Peter Richtárik 38 20 0 24 May 2023
Beyond Exponential Graph: Communication-Efficient Topologies for Decentralized Learning via Finite-time Convergence Yuki Takezawa Ryoma Sato Han Bao Kenta Niwa M. Yamada 39 9 0 19 May 2023
Global Update Tracking: A Decentralized Learning Algorithm for Heterogeneous Data Sai Aparna Aketi Abolfazl Hashemi Kaushik Roy FedML 27 12 0 08 May 2023
Communication Compression for Decentralized Learning with Operator Splitting Methods Yuki Takezawa Kenta Niwa M. Yamada 29 3 0 08 May 2022
DecentLaM: Decentralized Momentum SGD for Large-batch Deep Training Kun Yuan Yiming Chen Xinmeng Huang Yingya Zhang Pan Pan Yinghui Xu W. Yin MoE 60 61 0 24 Apr 2021