ResearchTrend.AI
D$^2$: Decentralized Training over Decentralized Data

D2^2: Decentralized Training over Decentralized Data

Hanlin Tang
Xiangru Lian
Ming Yan
Ce Zhang
Ji Liu
ArXivPDFHTML

Papers citing "D$^2$: Decentralized Training over Decentralized Data"

25 / 25 papers shown
Title
A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration
A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration
Yuchen Hu
Xi Chen
Weidong Liu
Xiaojun Mao
92
0
0
31 Jan 2025
Fully First-Order Methods for Decentralized Bilevel Optimization
Fully First-Order Methods for Decentralized Bilevel Optimization
Xiaoyu Wang
Xuxing Chen
Shiqian Ma
Tong Zhang
88
0
0
25 Oct 2024
SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data
SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data
Sakshi Choudhary
Sai Aparna Aketi
Kaushik Roy
FedML
85
0
0
22 May 2024
Communication-Efficient Federated Optimization over Semi-Decentralized Networks
Communication-Efficient Federated Optimization over Semi-Decentralized Networks
He Wang
Yuejie Chi
FedML
121
2
0
30 Nov 2023
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review
Sajjad Emdadi Mahdimahalleh
AI4CE
75
1
0
01 Aug 2023
Distributed Random Reshuffling Methods with Improved Convergence
Distributed Random Reshuffling Methods with Improved Convergence
Kun-Yen Huang
Linli Zhou
Shi Pu
91
4
0
21 Jun 2023
Push-SAGA: A decentralized stochastic algorithm with variance reduction over directed graphs
Push-SAGA: A decentralized stochastic algorithm with variance reduction over directed graphs
Muhammad I. Qureshi
Ran Xin
S. Kar
U. Khan
69
21
0
13 Aug 2020
Asynchronous Decentralized Parallel Stochastic Gradient Descent
Asynchronous Decentralized Parallel Stochastic Gradient Descent
Xiangru Lian
Wei Zhang
Ce Zhang
Ji Liu
ODL
46
500
0
18 Oct 2017
Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization
Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization
A. Nedić
Alexander Olshevsky
Michael G. Rabbat
66
510
0
26 Sep 2017
Fully Decentralized Policies for Multi-Agent Systems: An Information Theoretic Approach
Fully Decentralized Policies for Multi-Agent Systems: An Information Theoretic Approach
Roel Dobbe
David Fridovich-Keil
Claire Tomlin
42
42
0
20 Jul 2017
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent
Xiangru Lian
Ce Zhang
Huan Zhang
Cho-Jui Hsieh
Wei Zhang
Ji Liu
50
1,227
0
25 May 2017
A decentralized proximal-gradient method with network independent step-sizes and separated convergence rates
A decentralized proximal-gradient method with network independent step-sizes and separated convergence rates
Zhi Li
W. Shi
Ming Yan
51
226
0
25 Apr 2017
Dynamic Safe Interruptibility for Decentralized Multi-Agent Reinforcement Learning
Dynamic Safe Interruptibility for Decentralized Multi-Agent Reinforcement Learning
El-Mahdi El-Mhamdi
R. Guerraoui
Hadrien Hendrikx
Alexandre Maurer
42
28
0
10 Apr 2017
Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability
Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability
Shayegan Omidshafiei
Jason Pazis
Chris Amato
Jonathan P. How
J. Vian
129
498
0
17 Mar 2017
Communication-Efficient Algorithms for Decentralized and Stochastic Optimization
Communication-Efficient Algorithms for Decentralized and Stochastic Optimization
Guanghui Lan
Soomin Lee
Yi Zhou
78
218
0
14 Jan 2017
Distributed Mean Estimation with Limited Communication
Distributed Mean Estimation with Limited Communication
A. Suresh
Felix X. Yu
Sanjiv Kumar
H. B. McMahan
FedML
104
364
0
02 Nov 2016
Distributed Online Optimization in Dynamic Environments Using Mirror Descent
Distributed Online Optimization in Dynamic Environments Using Mirror Descent
Shahin Shahrampour
Ali Jadbabaie
219
280
0
09 Sep 2016
Gossip Dual Averaging for Decentralized Optimization of Pairwise Functions
Gossip Dual Averaging for Decentralized Optimization of Pairwise Functions
Igor Colin
A. Bellet
Joseph Salmon
Stephan Clémençon
FedML
65
106
0
08 Jun 2016
TensorFlow: A system for large-scale machine learning
TensorFlow: A system for large-scale machine learning
Martín Abadi
P. Barham
Jianmin Chen
Zhiwen Chen
Andy Davis
...
Vijay Vasudevan
Pete Warden
Martin Wicke
Yuan Yu
Xiaoqiang Zhang
GNN
AI4CE
433
18,361
0
27 May 2016
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
Tianqi Chen
Mu Li
Yutian Li
Min Lin
Naiyan Wang
Minjie Wang
Tianjun Xiao
Bing Xu
Chiyuan Zhang
Zheng Zhang
196
2,247
0
03 Dec 2015
Mini-Batch Semi-Stochastic Gradient Descent in the Proximal Setting
Mini-Batch Semi-Stochastic Gradient Descent in the Proximal Setting
Jakub Konecný
Jie Liu
Peter Richtárik
Martin Takáč
ODL
102
273
0
16 Apr 2015
SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives
SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives
Aaron Defazio
Francis R. Bach
Simon Lacoste-Julien
ODL
133
1,826
0
01 Jul 2014
Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning
Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning
Julien Mairal
147
319
0
18 Feb 2014
Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming
Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming
Saeed Ghadimi
Guanghui Lan
ODL
120
1,550
0
22 Sep 2013
Minimizing Finite Sums with the Stochastic Average Gradient
Minimizing Finite Sums with the Stochastic Average Gradient
Mark Schmidt
Nicolas Le Roux
Francis R. Bach
321
1,248
0
10 Sep 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.