Optimal algorithms for smooth and strongly convex distributed optimization in networks

28 February 2017

Laurent Massoulié

Papers citing "Optimal algorithms for smooth and strongly convex distributed optimization in networks"

50 / 51 papers shown

Title
OledFL: Unleashing the Potential of Decentralized Federated Learning via Opposite Lookahead Enhancement Qinglun Li Miao Zhang Mengzhu Wang Quanjun Yin Li Shen OODD FedML 26 0 0 09 Oct 2024
Byzantine-Robust Gossip: Insights from a Dual Approach Renaud Gaucher Hadrien Hendrikx Aymeric Dieuleveut AAML 33 0 0 06 May 2024
Compressed and Sparse Models for Non-Convex Decentralized Learning Andrew Campbell Hang Liu Leah Woldemariam Anna Scaglione 22 0 0 09 Nov 2023
Distributed Optimization Methods for Multi-Robot Systems: Part II -- A Survey O. Shorinwa Trevor Halsted Javier Yu Mac Schwager 24 18 0 26 Jan 2023
An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization Le‐Yu Chen Haishan Ye Luo Luo 65 5 0 05 Dec 2022
Efficiency Ordering of Stochastic Gradient Descent Jie Hu Vishwaraj Doshi Do Young Eun 31 6 0 15 Sep 2022
A principled framework for the design and analysis of token algorithms Hadrien Hendrikx FedML 24 13 0 30 May 2022
Collaborative Multi-agent Stochastic Linear Bandits Ahmadreza Moradipari Mohammad Ghavamzadeh M. Alizadeh 16 6 0 12 May 2022
Understanding A Class of Decentralized and Federated Optimization Algorithms: A Multi-Rate Feedback Control Perspective Xinwei Zhang Mingyi Hong N. Elia FedML 18 3 0 27 Apr 2022
Data-heterogeneity-aware Mixing for Decentralized Learning Yatin Dandi Anastasia Koloskova Martin Jaggi Sebastian U. Stich 38 18 0 13 Apr 2022
Automatic Performance Estimation for Decentralized Optimization Sébastien Colla Julien Hendrickx 28 8 0 11 Mar 2022
Optimal Algorithms for Decentralized Stochastic Variational Inequalities D. Kovalev Aleksandr Beznosikov Abdurakhmon Sadiev Michael Persiianov Peter Richtárik Alexander Gasnikov 35 35 0 06 Feb 2022
A dual approach for federated learning Zhenan Fan Huang Fang M. Friedlander FedML 18 3 0 26 Jan 2022
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning Bicheng Ying Kun Yuan Hanbin Hu Yiming Chen W. Yin FedML 39 27 0 08 Nov 2021
Acceleration in Distributed Optimization under Similarity Helena Lofstrom G. Scutari Tianyue Cao Alexander Gasnikov 24 26 0 24 Oct 2021
Decentralized Composite Optimization with Compression Yao Li Xiaorui Liu Jiliang Tang Ming Yan Kun Yuan 27 9 0 10 Aug 2021
Decentralized Constrained Optimization: Double Averaging and Gradient Projection Firooz Shahriari-Mehr David Bosch Ashkan Panahi 16 8 0 21 Jun 2021
Decentralized Local Stochastic Extra-Gradient for Variational Inequalities Aleksandr Beznosikov Pavel Dvurechensky Anastasia Koloskova V. Samokhin Sebastian U. Stich Alexander Gasnikov 32 43 0 15 Jun 2021
A Survey of Distributed Optimization Methods for Multi-Robot Systems Trevor Halsted O. Shorinwa Javier Yu Mac Schwager 25 39 0 23 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 35 32 0 04 Mar 2021
Decentralized Distributed Optimization for Saddle Point Problems Alexander Rogozin Alexander Beznosikov D. Dvinskikh D. Kovalev Pavel Dvurechensky Alexander Gasnikov 28 27 0 15 Feb 2021
Newton Method over Networks is Fast up to the Statistical Precision Amir Daneshmand G. Scutari Pavel Dvurechensky Alexander Gasnikov 30 22 0 12 Feb 2021
Straggler-Resilient Distributed Machine Learning with Dynamic Backup Workers Guojun Xiong Gang Yan Rahul Singh Jian Li 28 12 0 11 Feb 2021
Consensus Control for Decentralized Deep Learning Lingjing Kong Tao R. Lin Anastasia Koloskova Martin Jaggi Sebastian U. Stich 19 76 0 09 Feb 2021
PMGT-VR: A decentralized proximal-gradient algorithmic framework with variance reduction Haishan Ye Wei Xiong Tong Zhang 16 16 0 30 Dec 2020
On the Benefits of Multiple Gossip Steps in Communication-Constrained Decentralized Optimization Abolfazl Hashemi Anish Acharya Rudrajit Das H. Vikalo Sujay Sanghavi Inderjit Dhillon 20 7 0 20 Nov 2020
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! D. Kovalev Anastasia Koloskova Martin Jaggi Peter Richtárik Sebastian U. Stich 23 73 0 03 Nov 2020
Throughput-Optimal Topology Design for Cross-Silo Federated Learning Othmane Marfoq Chuan Xu Giovanni Neglia Richard Vidal FedML 67 85 0 23 Oct 2020
Distributed Optimization, Averaging via ADMM, and Network Topology G. França José Bento 14 9 0 05 Sep 2020
On stochastic mirror descent with interacting particles: convergence properties and variance reduction Anastasia Borovykh N. Kantas P. Parpas G. Pavliotis 28 12 0 15 Jul 2020
Optimal Complexity in Decentralized Training Yucheng Lu Christopher De Sa 38 72 0 15 Jun 2020
FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data Xinwei Zhang Mingyi Hong S. Dhople W. Yin Yang Liu FedML 21 227 0 22 May 2020
A Robust Gradient Tracking Method for Distributed Optimization over Directed Networks Shi Pu 29 38 0 31 Mar 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 41 493 0 23 Mar 2020
Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis Jinming Xu Ye Tian Ying Sun G. Scutari 23 64 0 25 Feb 2020
A Decentralized Proximal Point-type Method for Saddle Point Problems Weijie Liu Aryan Mokhtari Asuman Ozdaglar S. Pattathil Zebang Shen Nenggan Zheng 67 30 0 31 Oct 2019
Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks Jinming Xu Ye Tian Ying Sun G. Scutari 24 37 0 23 Oct 2019
Social Learning in Multi Agent Multi Armed Bandits Abishek Sankararaman A. Ganesh Sanjay Shakkottai 26 84 0 04 Oct 2019
Regularized Diffusion Adaptation via Conjugate Smoothing Stefan Vlaski L. Vandenberghe Ali H. Sayed 15 6 0 20 Sep 2019
Communication-Censored Linearized ADMM for Decentralized Consensus Optimization Weiyu Li Yaohua Liu Z. Tian Qing Ling 14 22 0 15 Sep 2019
Robust and Communication-Efficient Collaborative Learning Amirhossein Reisizadeh Hossein Taheri Aryan Mokhtari Hamed Hassani Ramtin Pedarsani 25 89 0 24 Jul 2019
On linear convergence of two decentralized algorithms Yao Li Ming Yan 11 7 0 17 Jun 2019
Asynchronous Accelerated Proximal Stochastic Gradient for Strongly Convex Distributed Finite Sums Hadrien Hendrikx Francis R. Bach Laurent Massoulié FedML 10 26 0 28 Jan 2019
Push-Pull Gradient Methods for Distributed Optimization in Networks Shi Pu Wei Shi Jinming Xu A. Nedić 16 318 0 15 Oct 2018
Accelerated Decentralized Optimization with Local Updates for Smooth and Strongly Convex Objectives Hadrien Hendrikx Francis R. Bach Laurent Massoulié 13 42 0 05 Oct 2018
COLA: Decentralized Linear Learning Lie He An Bian Martin Jaggi 18 117 0 13 Aug 2018
Decentralize and Randomize: Faster Algorithm for Wasserstein Barycenters Pavel Dvurechensky D. Dvinskikh Alexander Gasnikov César A. Uribe Angelia Nedić 20 104 0 11 Jun 2018
Towards More Efficient Stochastic Decentralized Learning: Faster Convergence and Sparse Communication Zebang Shen Aryan Mokhtari Tengfei Zhou P. Zhao Hui Qian 25 56 0 25 May 2018
A Push-Pull Gradient Method for Distributed Optimization in Networks Shi Pu Wei Shi Jinming Xu A. Nedić 19 98 0 20 Mar 2018
Collaborative Deep Learning in Fixed Topology Networks Zhanhong Jiang Aditya Balu C. Hegde S. Sarkar FedML 18 179 0 23 Jun 2017