On the Trade-off between Flatness and Optimization in Distributed
Learning

On the Trade-off between Flatness and Optimization in Distributed Learning

28 June 2024

Ying Cao

Ali H. Sayed

Papers citing "On the Trade-off between Flatness and Optimization in Distributed Learning"

6 / 6 papers shown

Title
Decentralized Adversarial Training over Graphs Ying Cao Elsa Rizk Stefan Vlaski A. H. Sayed AAML 35 1 0 23 Mar 2023
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning Bicheng Ying Kun Yuan Hanbin Hu Yiming Chen W. Yin FedML 31 27 0 08 Nov 2021
DecentLaM: Decentralized Momentum SGD for Large-batch Deep Training Kun Yuan Yiming Chen Xinmeng Huang Yingya Zhang Pan Pan Yinghui Xu W. Yin MoE 48 60 0 24 Apr 2021
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 281 2,888 0 15 Sep 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu L. V. D. van der Maaten Kilian Q. Weinberger PINN 3DV 249 36,362 0 25 Aug 2016
Distributed Pareto Optimization via Diffusion Strategies Jianshu Chen A. H. Sayed 55 174 0 13 Aug 2012