D $^2$ : Decentralized Training over Decentralized Data

19 March 2018

Papers citing "D$^2$: Decentralized Training over Decentralized Data"

25 / 25 papers shown

Title
A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration Yuchen Hu Xi Chen Weidong Liu Xiaojun Mao 94 0 0 31 Jan 2025
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 91 0 0 25 Oct 2024
SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data Sakshi Choudhary Sai Aparna Aketi Kaushik Roy FedML 85 0 0 22 May 2024
Communication-Efficient Federated Optimization over Semi-Decentralized Networks He Wang Yuejie Chi FedML 121 2 0 30 Nov 2023
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review Sajjad Emdadi Mahdimahalleh AI4CE 78 1 0 01 Aug 2023
Distributed Random Reshuffling Methods with Improved Convergence Kun-Yen Huang Linli Zhou Shi Pu 91 4 0 21 Jun 2023
Push-SAGA: A decentralized stochastic algorithm with variance reduction over directed graphs Muhammad I. Qureshi Ran Xin S. Kar U. Khan 69 21 0 13 Aug 2020
Asynchronous Decentralized Parallel Stochastic Gradient Descent Xiangru Lian Wei Zhang Ce Zhang Ji Liu ODL 46 500 0 18 Oct 2017
Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization A. Nedić Alexander Olshevsky Michael G. Rabbat 66 510 0 26 Sep 2017
Fully Decentralized Policies for Multi-Agent Systems: An Information Theoretic Approach Roel Dobbe David Fridovich-Keil Claire Tomlin 42 42 0 20 Jul 2017
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent Xiangru Lian Ce Zhang Huan Zhang Cho-Jui Hsieh Wei Zhang Ji Liu 50 1,227 0 25 May 2017
A decentralized proximal-gradient method with network independent step-sizes and separated convergence rates Zhi Li W. Shi Ming Yan 51 226 0 25 Apr 2017
Dynamic Safe Interruptibility for Decentralized Multi-Agent Reinforcement Learning El-Mahdi El-Mhamdi R. Guerraoui Hadrien Hendrikx Alexandre Maurer 42 28 0 10 Apr 2017
Deep Decentralized Multi-task Multi-Agent Reinforcement Learning under Partial Observability Shayegan Omidshafiei Jason Pazis Chris Amato Jonathan P. How J. Vian 129 498 0 17 Mar 2017
Communication-Efficient Algorithms for Decentralized and Stochastic Optimization Guanghui Lan Soomin Lee Yi Zhou 78 218 0 14 Jan 2017
Distributed Mean Estimation with Limited Communication A. Suresh Felix X. Yu Sanjiv Kumar H. B. McMahan FedML 104 364 0 02 Nov 2016
Distributed Online Optimization in Dynamic Environments Using Mirror Descent Shahin Shahrampour Ali Jadbabaie 219 280 0 09 Sep 2016
Gossip Dual Averaging for Decentralized Optimization of Pairwise Functions Igor Colin A. Bellet Joseph Salmon Stephan Clémençon FedML 65 106 0 08 Jun 2016
TensorFlow: A system for large-scale machine learning Martín Abadi P. Barham Jianmin Chen Zhiwen Chen Andy Davis ... Vijay Vasudevan Pete Warden Martin Wicke Yuan Yu Xiaoqiang Zhang GNN AI4CE 433 18,361 0 27 May 2016
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems Tianqi Chen Mu Li Yutian Li Min Lin Naiyan Wang Minjie Wang Tianjun Xiao Bing Xu Chiyuan Zhang Zheng Zhang 196 2,247 0 03 Dec 2015
Mini-Batch Semi-Stochastic Gradient Descent in the Proximal Setting Jakub Konecný Jie Liu Peter Richtárik Martin Takáč ODL 102 273 0 16 Apr 2015
SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives Aaron Defazio Francis R. Bach Simon Lacoste-Julien ODL 133 1,826 0 01 Jul 2014
Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning Julien Mairal 149 319 0 18 Feb 2014
Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming Saeed Ghadimi Guanghui Lan ODL 120 1,550 0 22 Sep 2013
Minimizing Finite Sums with the Stochastic Average Gradient Mark Schmidt Nicolas Le Roux Francis R. Bach 321 1,248 0 10 Sep 2013

D2^22: Decentralized Training over Decentralized Data

Papers citing "D$^2$: Decentralized Training over Decentralized Data"

D $^2$ : Decentralized Training over Decentralized Data