Compressing Gradient Optimizers via Count-Sketches

Compressing Gradient Optimizers via Count-Sketches

1 February 2019

Anastasios Kyrillidis

Anshumali Shrivastava

Papers citing "Compressing Gradient Optimizers via Count-Sketches"

7 / 7 papers shown

Title
Sketched Adaptive Federated Deep Learning: A Sharp Convergence Analysis Zhijie Chen Qiaobo Li A. Banerjee FedML 37 0 0 11 Nov 2024
Sketch-GNN: Scalable Graph Neural Networks with Sublinear Training Complexity Mucong Ding Tahseen Rabbani Bang An Evan Z Wang Furong Huang 31 21 0 21 Jun 2024
Learning a Neural Diff for Speech Models J. Macoskey Grant P. Strimel Ariya Rastrow 18 2 0 03 Aug 2021
Communication Efficiency in Federated Learning: Achievements and Challenges Osama Shahid Seyedamin Pouriyeh R. Parizi Quan Z. Sheng Gautam Srivastava Liang Zhao FedML 40 74 0 23 Jul 2021
From Distributed Machine Learning to Federated Learning: A Survey Ji Liu Jizhou Huang Yang Zhou Xuhong Li Shilei Ji Haoyi Xiong Dejing Dou FedML OOD 56 244 0 29 Apr 2021
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed Hanlin Tang Shaoduo Gan A. A. Awan Samyam Rajbhandari Conglong Li Xiangru Lian Ji Liu Ce Zhang Yuxiong He AI4CE 45 84 0 04 Feb 2021
FetchSGD: Communication-Efficient Federated Learning with Sketching D. Rothchild Ashwinee Panda Enayat Ullah Nikita Ivkin Ion Stoica Vladimir Braverman Joseph E. Gonzalez Raman Arora FedML 28 361 0 15 Jul 2020