Federated Select: A Primitive for Communication- and Memory-Efficient
Federated Learning

Federated Select: A Primitive for Communication- and Memory-Efficient Federated Learning

19 August 2022

Zachary B. Charles

Kallista A. Bonawitz

Stanislav Chiknavaryan

Blaise Agüera y Arcas

Papers citing "Federated Select: A Primitive for Communication- and Memory-Efficient Federated Learning"

18 / 18 papers shown

Title
Scaling Language Model Size in Cross-Device Federated Learning Jae Hun Ro Theresa Breiner Lara McConnaughey Mingqing Chen A. Suresh Shankar Kumar Rajiv Mathews FedML 42 24 0 31 Mar 2022
Efficient Image Representation Learning with Federated Sampled Softmax Sagar M. Waghmare Qi Huizhong Chen Mikhail Sirotenko Tomer Meron FedML 19 2 0 09 Mar 2022
Towards Sparse Federated Analytics: Location Heatmaps under Distributed Differential Privacy with Secure Aggregation Eugene Bagdasaryan Peter Kairouz S. Mellem Adria Gascon Kallista A. Bonawitz D. Estrin Marco Gruteser 43 29 0 03 Nov 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 267 418 0 14 Jul 2021
On Large-Cohort Training for Federated Learning Zachary B. Charles Zachary Garrett Zhouyuan Huo Sergei Shmulyian Virginia Smith FedML 58 112 0 15 Jun 2021
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning Sai Praneeth Karimireddy Martin Jaggi Satyen Kale M. Mohri Sashank J. Reddi Sebastian U. Stich A. Suresh FedML 113 218 0 08 Aug 2020
FetchSGD: Communication-Efficient Federated Learning with Sketching D. Rothchild Ashwinee Panda Enayat Ullah Nikita Ivkin Ion Stoica Vladimir Braverman Joseph E. Gonzalez Raman Arora FedML 60 367 0 15 Jul 2020
Adaptive Federated Optimization Sashank J. Reddi Zachary B. Charles Manzil Zaheer Zachary Garrett Keith Rush Jakub Konecný Sanjiv Kumar H. B. McMahan FedML 153 1,431 0 29 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 526 4,773 0 23 Jan 2020
Think Locally, Act Globally: Federated Learning with Local and Global Representations Paul Pu Liang Terrance Liu Liu Ziyin Nicholas B. Allen Randy P. Auerbach David Brent Ruslan Salakhutdinov Louis-Philippe Morency FedML 108 559 0 06 Jan 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 192 6,229 0 10 Dec 2019
FedMD: Heterogenous Federated Learning via Model Distillation Daliang Li Junpu Wang FedML 88 851 0 08 Oct 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 215 8,415 0 19 Jun 2019
Language Modeling with Deep Transformers Kazuki Irie Albert Zeyer Ralf Schluter Hermann Ney KELM 74 174 0 10 May 2019
Robust and Communication-Efficient Federated Learning from Non-IID Data Felix Sattler Simon Wiedemann K. Müller Wojciech Samek FedML 58 1,353 0 07 Mar 2019
Federated Heavy Hitters Discovery with Differential Privacy Wennan Zhu Peter Kairouz H. B. McMahan Haicheng Sun Wei Li FedML 66 109 0 22 Feb 2019
Towards Federated Learning at Scale: System Design Keith Bonawitz Hubert Eichner W. Grieskamp Dzmitry Huba A. Ingerman ... H. B. McMahan Timon Van Overveldt David Petrou Daniel Ramage Jason Roselander FedML 119 2,660 0 04 Feb 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 192 3,724 0 09 Jan 2019