NEXT: In-Network Nonconvex Optimization

1 February 2016

Papers citing "NEXT: In-Network Nonconvex Optimization"

50 / 188 papers shown

Title
Beyond spectral gap: The role of the topology in decentralized learning Thijs Vogels Hadrien Hendrikx Martin Jaggi FedML 18 28 0 07 Jun 2022
Theoretical Analysis of Primal-Dual Algorithm for Non-Convex Stochastic Decentralized Optimization Yuki Takezawa Kenta Niwa M. Yamada 11 4 0 23 May 2022
Communication Compression for Decentralized Learning with Operator Splitting Methods Yuki Takezawa Kenta Niwa M. Yamada 29 3 0 08 May 2022
Understanding A Class of Decentralized and Federated Optimization Algorithms: A Multi-Rate Feedback Control Perspective Xinwei Zhang Mingyi Hong N. Elia FedML 21 3 0 27 Apr 2022
Data-heterogeneity-aware Mixing for Decentralized Learning Yatin Dandi Anastasia Koloskova Martin Jaggi Sebastian U. Stich 43 18 0 13 Apr 2022
Triggered Gradient Tracking for Asynchronous Distributed Optimization Guido Carnevale Ivano Notarnicola L. Marconi G. Notarstefano 18 18 0 04 Mar 2022
ProxSkip: Yes! Local Gradient Steps Provably Lead to Communication Acceleration! Finally! Konstantin Mishchenko Grigory Malinovsky Sebastian U. Stich Peter Richtárik 13 152 0 18 Feb 2022
Distributed saddle point problems for strongly concave-convex functions Muhammad I. Qureshi U. Khan 46 12 0 11 Feb 2022
An Improved Analysis of Gradient Tracking for Decentralized Machine Learning Anastasia Koloskova Tao R. Lin Sebastian U. Stich 22 106 0 08 Feb 2022
Variance reduced stochastic optimization over directed graphs with row and column stochastic weights Muhammad I. Qureshi Ran Xin S. Kar U. Khan 26 3 0 07 Feb 2022
Tailoring Gradient Methods for Differentially-Private Distributed Optimization Yongqiang Wang A. Nedić 30 67 0 02 Feb 2022
DoCoM: Compressed Decentralized Optimization with Near-Optimal Sample Complexity Chung-Yiu Yau Hoi-To Wai 90 6 0 01 Feb 2022
BEER: Fast $O(1/T)$ Rate for Decentralized Nonconvex Optimization with Communication Compression Haoyu Zhao Boyue Li Zhize Li Peter Richtárik Yuejie Chi 37 49 0 31 Jan 2022
Distributed Random Reshuffling over Networks Kun-Yen Huang Xiao Li Andre Milzarek Shi Pu Junwen Qiu 39 11 0 31 Dec 2021
Decentralized Optimization Over the Stiefel Manifold by an Approximate Augmented Lagrangian Function Lei Wang Xin Liu 31 24 0 30 Dec 2021
Convergence of sequences: a survey Barbara Franci Sergio Grammatico 38 19 0 22 Nov 2021
Distributed Sparse Regression via Penalization Yao Ji G. Scutari Ying Sun Harsha Honnappa 24 5 0 12 Nov 2021
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning Bicheng Ying Kun Yuan Hanbin Hu Yiming Chen W. Yin FedML 44 27 0 08 Nov 2021
Distributed stochastic proximal algorithm with random reshuffling for non-smooth finite-sum optimization Xia Jiang Xianlin Zeng Jian Sun Jie Chen Lihua Xie 18 6 0 06 Nov 2021
Exponential Graph is Provably Efficient for Decentralized Deep Training Bicheng Ying Kun Yuan Yiming Chen Hanbin Hu Pan Pan W. Yin FedML 44 83 0 26 Oct 2021
Acceleration in Distributed Optimization under Similarity Helena Lofstrom G. Scutari Tianyue Cao Alexander Gasnikov 32 26 0 24 Oct 2021
A Unified and Refined Convergence Analysis for Non-Convex Decentralized Learning Sulaiman A. Alghunaim Kun Yuan 44 57 0 19 Oct 2021
An Empirical Study on Compressed Decentralized Stochastic Gradient Algorithms with Overparameterized Models A. Rao Hoi-To Wai 24 0 0 09 Oct 2021
RelaySum for Decentralized Deep Learning on Heterogeneous Data Thijs Vogels Lie He Anastasia Koloskova Tao R. Lin Sai Praneeth Karimireddy Sebastian U. Stich Martin Jaggi FedML MoE 11 61 0 08 Oct 2021
DESTRESS: Computation-Optimal and Communication-Efficient Decentralized Nonconvex Finite-Sum Optimization Boyue Li Zhize Li Yuejie Chi 20 22 0 04 Oct 2021
On the Convergence of Decentralized Adaptive Gradient Methods Xiangyi Chen Belhal Karimi Weijie Zhao Ping Li 23 21 0 07 Sep 2021
FAST-PCA: A Fast and Exact Algorithm for Distributed Principal Component Analysis Arpita Gang W. Bajwa 65 17 0 27 Aug 2021
Decentralized Composite Optimization with Compression Yao Li Xiaorui Liu Jiliang Tang Ming Yan Kun Yuan 29 9 0 10 Aug 2021
Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphs Zhuoqing Song Lei Shi Shi Pu Ming Yan 21 3 0 26 Jul 2021
Finite-Bit Quantization For Distributed Algorithms With Linear Convergence Nicolò Michelusi G. Scutari Chang-Shen Lee MQ 11 27 0 23 Jul 2021
Decentralized Bayesian Learning with Metropolis-Adjusted Hamiltonian Monte Carlo Vyacheslav Kungurtsev Adam D. Cobb T. Javidi Brian Jalaian 53 4 0 15 Jul 2021
Distributed stochastic gradient tracking algorithm with variance reduction for non-convex optimization Xia Jiang Xianlin Zeng Jian Sun Jie Chen 36 14 0 28 Jun 2021
Decentralized Constrained Optimization: Double Averaging and Gradient Projection Firooz Shahriari-Mehr David Bosch Ashkan Panahi 18 8 0 21 Jun 2021
Accelerating Gossip SGD with Periodic Global Averaging Yiming Chen Kun Yuan Yingya Zhang Pan Pan Yinghui Xu W. Yin 42 41 0 19 May 2021
Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD Kun Yuan Sulaiman A. Alghunaim Xinmeng Huang 36 32 0 17 May 2021
Improving the Transient Times for Distributed Stochastic Gradient Methods Kun-Yen Huang Shi Pu 42 23 0 11 May 2021
GT-STORM: Taming Sample, Communication, and Memory Complexities in Decentralized Non-Convex Learning Xin Zhang Jia Liu Zhengyuan Zhu Elizabeth S. Bentley 49 14 0 04 May 2021
Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization Huan Li Zhouchen Lin 14 31 0 06 Apr 2021
Drowsiness Detection Based On Driver Temporal Behavior Using a New Developed Dataset F. Faraji F. Lotfi Javad Khorramdel Ali Najafi A. Ghaffari 6 1 0 31 Mar 2021
Competing Adaptive Networks Stefan Vlaski Ali H. Sayed 23 2 0 29 Mar 2021
Compressed Gradient Tracking Methods for Decentralized Optimization with Linear Convergence Yiwei Liao Zhuoru Li Kun-Yen Huang Shi Pu 24 11 0 25 Mar 2021
A Survey of Distributed Optimization Methods for Multi-Robot Systems Trevor Halsted O. Shorinwa Javier Yu Mac Schwager 33 39 0 23 Mar 2021
Distributed Principal Subspace Analysis for Partitioned Big Data: Algorithms, Analysis, and Implementation Arpita Gang Bingqing Xiang W. Bajwa 30 14 0 11 Mar 2021
Decentralized Riemannian Gradient Descent on the Stiefel Manifold Shixiang Chen Alfredo García Mingyi Hong Shahin Shahrampour 22 43 0 14 Feb 2021
Newton Method over Networks is Fast up to the Statistical Precision Amir Daneshmand G. Scutari Pavel Dvurechensky Alexander Gasnikov 30 22 0 12 Feb 2021
A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization Ran Xin U. Khan S. Kar 33 39 0 12 Feb 2021
A Linearly Convergent Algorithm for Distributed Principal Component Analysis Arpita Gang W. Bajwa 38 24 0 05 Jan 2021
A Primal-Dual Framework for Decentralized Stochastic Optimization K. Rajawat C. Kumar 13 7 0 08 Dec 2020
Distributed Stochastic Consensus Optimization with Momentum for Nonconvex Nonsmooth Problems Zhiguo Wang Jiawei Zhang Tsung-Hui Chang Jian Li Zhi-Quan Luo 13 36 0 10 Nov 2020
A fast randomized incremental gradient method for decentralized non-convex optimization Ran Xin U. Khan S. Kar 35 33 0 07 Nov 2020