NEXT: In-Network Nonconvex Optimization

1 February 2016

Papers citing "NEXT: In-Network Nonconvex Optimization"

50 / 188 papers shown

Title
Graph-Homomorphic Perturbations for Private Decentralized Learning Stefan Vlaski Ali H. Sayed FedML 53 7 0 23 Oct 2020
Distributed Mirror Descent with Integral Feedback: Asymptotic Convergence Analysis of Continuous-time Dynamics Youbang Sun Shahin Shahrampour 10 7 0 14 Sep 2020
A general framework for decentralized optimization with first-order methods Ran Xin Shi Pu Angelia Nedić U. Khan 19 87 0 12 Sep 2020
GTAdam: Gradient Tracking with Adaptive Momentum for Distributed Online Optimization Guido Carnevale Francesco Farina Ivano Notarnicola G. Notarstefano 14 22 0 03 Sep 2020
On the Convergence of Consensus Algorithms with Markovian Noise and Gradient Bias Hoi-To Wai 9 12 0 18 Aug 2020
Fast decentralized non-convex finite-sum optimization with recursive variance reduction Ran Xin U. Khan S. Kar 23 43 0 17 Aug 2020
Push-SAGA: A decentralized stochastic algorithm with variance reduction over directed graphs Muhammad I. Qureshi Ran Xin S. Kar U. Khan 22 20 0 13 Aug 2020
Distributed Gradient Flow: Nonsmoothness, Nonconvexity, and Saddle Point Evasion Brian Swenson Ryan W. Murray H. Vincent Poor S. Kar 17 16 0 12 Aug 2020
An improved convergence analysis for decentralized online stochastic non-convex optimization Ran Xin U. Khan S. Kar 41 100 0 10 Aug 2020
Distributed Training of Graph Convolutional Networks Simone Scardapane Indro Spinelli P. Lorenzo GNN BDL 51 26 0 13 Jul 2020
On the Divergence of Decentralized Non-Convex Optimization Mingyi Hong Siliang Zeng Junyu Zhang Haoran Sun 4 3 0 20 Jun 2020
S-ADDOPT: Decentralized stochastic first-order optimization over directed graphs Muhammad I. Qureshi Ran Xin S. Kar U. Khan 23 33 0 15 May 2020
Multi-consensus Decentralized Accelerated Gradient Descent Haishan Ye Luo Luo Ziang Zhou Tong Zhang 20 52 0 02 May 2020
Distributed Stochastic Nonconvex Optimization and Learning based on Successive Convex Approximation P. Lorenzo Simone Scardapane 51 2 0 30 Apr 2020
Second-Order Guarantees in Centralized, Federated and Decentralized Nonconvex Optimization Stefan Vlaski Ali H. Sayed 26 5 0 31 Mar 2020
A Robust Gradient Tracking Method for Distributed Optimization over Directed Networks Shi Pu 29 38 0 31 Mar 2020
Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis Jinming Xu Ye Tian Ying Sun G. Scutari 33 64 0 25 Feb 2020
Gradient tracking and variance reduction for decentralized optimization and machine learning Ran Xin S. Kar U. Khan 19 10 0 13 Feb 2020
Collective Learning Francesco Farina FedML 20 23 0 05 Dec 2019
Learn Electronic Health Records by Fully Decentralized Federated Learning Songtao Lu Yawen Zhang Yunlong Wang C. Mack FedML 6 24 0 04 Dec 2019
A System Theoretical Perspective to Gradient-Tracking Algorithms for Distributed Quadratic Optimization Michelangelo Bin Ivano Notarnicola L. Marconi G. Notarstefano 11 18 0 15 Nov 2019
Asynchronous Distributed Learning from Constraints Francesco Farina S. Melacci A. Garulli Antonio Giannitrapani 20 6 0 13 Nov 2019
Linear Speedup in Saddle-Point Escape for Decentralized Non-Convex Optimization Stefan Vlaski Ali H. Sayed 28 2 0 30 Oct 2019
Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks Jinming Xu Ye Tian Ying Sun G. Scutari 24 37 0 23 Oct 2019
On Distributed Stochastic Gradient Algorithms for Global Optimization Brian Swenson Anirudh Sridhar H. Vincent Poor 19 8 0 21 Oct 2019
Robust Distributed Accelerated Stochastic Gradient Methods for Multi-Agent Networks Alireza Fallah Mert Gurbuzbalaban Asuman Ozdaglar Umut Simsekli Lingjiong Zhu 34 28 0 19 Oct 2019
Improving the Sample and Communication Complexity for Decentralized Non-Convex Optimization: A Joint Gradient Estimation and Tracking Approach Haoran Sun Songtao Lu Mingyi Hong 33 37 0 13 Oct 2019
Variance-Reduced Decentralized Stochastic Optimization with Gradient Tracking -- Part II: GT-SVRG Ran Xin U. Khan S. Kar 19 8 0 08 Oct 2019
Regularized Diffusion Adaptation via Conjugate Smoothing Stefan Vlaski L. Vandenberghe Ali H. Sayed 23 6 0 20 Sep 2019
Communication-Censored Linearized ADMM for Decentralized Consensus Optimization Weiyu Li Yaohua Liu Z. Tian Qing Ling 14 22 0 15 Sep 2019
Communication-Efficient Distributed Optimization in Networks with Gradient Tracking and Variance Reduction Boyue Li Shicong Cen Yuxin Chen Yuejie Chi 22 12 0 12 Sep 2019
Distributed Deep Learning with Event-Triggered Communication Jemin George Prudhvi K. Gurram 16 16 0 08 Sep 2019
BRIDGE: Byzantine-resilient Decentralized Gradient Descent Cheng Fang Zhixiong Yang W. Bajwa 19 96 0 21 Aug 2019
A Review of Cooperative Multi-Agent Deep Reinforcement Learning Afshin Oroojlooyjadid Davood Hajinezhad 56 413 0 11 Aug 2019
Distributed Gradient Descent: Nonconvergence to Saddle Points and the Stable-Manifold Theorem Brian Swenson Ryan W. Murray H. Vincent Poor S. Kar 36 14 0 07 Aug 2019
An introduction to decentralized stochastic optimization with gradient tracking Ran Xin S. Kar U. Khan 14 10 0 23 Jul 2019
Distributed Inexact Successive Convex Approximation ADMM: Analysis-Part I Sandeep Kumar K. Rajawat Daniel P. Palomar 26 4 0 21 Jul 2019
Distributed Global Optimization by Annealing Brian Swenson S. Kar H. Vincent Poor José M. F. Moura 25 3 0 20 Jul 2019
Distributed Learning in Non-Convex Environments -- Part II: Polynomial Escape from Saddle-Points Stefan Vlaski Ali H. Sayed 27 53 0 03 Jul 2019
Distributed Learning in Non-Convex Environments -- Part I: Agreement at a Linear Rate Stefan Vlaski Ali H. Sayed 14 69 0 03 Jul 2019
On linear convergence of two decentralized algorithms Yao Li Ming Yan 19 7 0 17 Jun 2019
A Sharp Estimate on the Transient Time of Distributed Stochastic Gradient Descent Shi Pu Alexander Olshevsky I. Paschalidis 18 18 0 06 Jun 2019
A Linearly Convergent Proximal Gradient Algorithm for Decentralized Optimization Sulaiman A. Alghunaim Kun Yuan Ali H. Sayed 14 62 0 20 May 2019
Distributed Optimization Based on Gradient-tracking Revisited: Enhancing Convergence Rate via Surrogation Ying Sun Amir Daneshmand G. Scutari 30 56 0 07 May 2019
Gradient-Free Multi-Agent Nonconvex Nonsmooth Optimization Davood Hajinezhad Michael M. Zavlanos 8 13 0 09 Apr 2019
On the Influence of Bias-Correction on Distributed Stochastic Optimization Kun Yuan Sulaiman A. Alghunaim Bicheng Ying Ali H. Sayed 18 63 0 26 Mar 2019
Annealing for Distributed Global Optimization Brian Swenson S. Kar H. Vincent Poor J. M. F. Moura 35 30 0 18 Mar 2019
A Provably Communication-Efficient Asynchronous Distributed Inference Method for Convex and Nonconvex Problems Jineng Ren Jarvis Haupt FedML 25 4 0 16 Mar 2019
Hybrid Block Successive Approximation for One-Sided Non-Convex Min-Max Problems: Algorithms and Applications Songtao Lu Ioannis C. Tsaknakis Mingyi Hong Yongxin Chen 26 169 0 21 Feb 2019
Dynamic Average Diffusion with randomized Coordinate Updates Bicheng Ying Kun Yuan Ali H. Sayed 19 6 0 21 Oct 2018