Adaptive Federated Optimization

29 February 2020

Sanjiv Kumar

Papers citing "Adaptive Federated Optimization"

50 / 792 papers shown

Title
On Large-Cohort Training for Federated Learning Zachary B. Charles Zachary Garrett Zhouyuan Huo Sergei Shmulyian Virginia Smith FedML 21 113 0 15 Jun 2021
Dynamic Gradient Aggregation for Federated Domain Adaptation Dimitrios Dimitriadis K. Kumatani R. Gmyr Yashesh Gaur Sefik Emre Eskimez FedML 26 5 0 14 Jun 2021
CFedAvg: Achieving Efficient Communication and Fast Convergence in Non-IID Federated Learning Haibo Yang Jia Liu Elizabeth S. Bentley FedML 21 17 0 14 Jun 2021
Heterogeneous Federated Learning using Dynamic Model Pruning and Adaptive Gradient Sixing Yu P. Nguyen Ali Anwar Ali Jannesari 37 12 0 13 Jun 2021
Federated Learning on Non-IID Data: A Survey Hangyu Zhu Jinjin Xu Shiqing Liu Yaochu Jin OOD FedML 39 769 0 12 Jun 2021
Federated Learning with Buffered Asynchronous Aggregation John Nguyen Kshitiz Malik Hongyuan Zhan Ashkan Yousefpour Michael G. Rabbat Mani Malek Dzmitry Huba FedML 33 289 0 11 Jun 2021
Multi-VFL: A Vertical Federated Learning System for Multiple Data and Label Owners Vaikkunth Mugunthan P. Goyal Lalana Kagal FedML 32 9 0 10 Jun 2021
Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing M. Khodak Renbo Tu Tian Li Liam Li Maria-Florina Balcan Virginia Smith Ameet Talwalkar FedML 43 78 0 08 Jun 2021
A multi-centre polyp detection and segmentation dataset for generalisability assessment Sharib Ali Debesh Jha N. Ghatwary S. Realdon R. Cannizzaro ... Andreas Petlund P. Halvorsen J. Rittscher Thomas de Lange J. East 24 84 0 08 Jun 2021
FedNL: Making Newton-Type Methods Applicable to Federated Learning M. Safaryan Rustem Islamov Xun Qian Peter Richtárik FedML 33 78 0 05 Jun 2021
SpreadGNN: Serverless Multi-task Federated Learning for Graph Neural Networks Chaoyang He Emir Ceyani Keshav Balasubramanian M. Annavaram Salman Avestimehr FedML 25 50 0 04 Jun 2021
Local Adaptivity in Federated Learning: Convergence and Consistency Jianyu Wang Zheng Xu Zachary Garrett Zachary B. Charles Luyang Liu Gauri Joshi FedML 32 39 0 04 Jun 2021
SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training Enmao Diao Jie Ding Vahid Tarokh FedML 22 73 0 02 Jun 2021
FedScale: Benchmarking Model and System Performance of Federated Learning at Scale Fan Lai Yinwei Dai Sanjay Sri Vallabh Singapuram Jiachen Liu Xiangfeng Zhu H. Madhyastha Mosharaf Chowdhury FedML 45 196 0 24 May 2021
Prototype Guided Federated Learning of Visual Feature Representations Umberto Michieli Mete Ozay FedML 19 37 0 19 May 2021
DRIVE: One-bit Distributed Mean Estimation S. Vargaftik Ran Ben-Basat Amit Portnoy Gal Mendelson Y. Ben-Itzhak Michael Mitzenmacher OOD FedML 84 52 0 18 May 2021
EasyFL: A Low-code Federated Learning Platform For Dummies Weiming Zhuang Xin Gan Yonggang Wen Shuai Zhang FedML 27 46 0 17 May 2021
Federated Unbiased Learning to Rank Chang Li Ouyang Hua FedML 11 2 0 11 May 2021
End-to-End Speech Recognition from Federated Acoustic Models Yan Gao Titouan Parcollet Salah Zaiem Javier Fernandez-Marques Pedro Porto Buarque de Gusmão Daniel J. Beutel Nicholas D. Lane 28 43 0 29 Apr 2021
Decentralized Federated Averaging Tao Sun Dongsheng Li Bao Wang FedML 54 208 0 23 Apr 2021
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks Bill Yuchen Lin Chaoyang He ZiHang Zeng Hulin Wang Yufen Huang Christophe Dupuy Rahul Gupta Mahdi Soltanolkotabi Xiang Ren Salman Avestimehr FedML 24 109 0 18 Apr 2021
FedGraphNN: A Federated Learning System and Benchmark for Graph Neural Networks Chaoyang He Keshav Balasubramanian Emir Ceyani Carl Yang Han Xie ... Yu Rong P. Zhao Junzhou Huang M. Annavaram Salman Avestimehr FedML OOD 26 2 0 14 Apr 2021
Communication-Efficient Agnostic Federated Averaging Jae Hun Ro Mingqing Chen Rajiv Mathews M. Mohri A. Suresh FedML 19 17 0 06 Apr 2021
Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learning Zachary B. Charles Jakub Konecný FedML 26 63 0 08 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 37 32 0 04 Mar 2021
Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability Jeremy M. Cohen Simran Kaur Yuanzhi Li J. Zico Kolter Ameet Talwalkar ODL 37 251 0 26 Feb 2021
Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning Shaoxiong Ji Yue Tan Teemu Saravirta Zhiqin Yang Yixin Liu Lauri Vasankari Shirui Pan Guodong Long A. Walid FedML 37 76 0 25 Feb 2021
FedBN: Federated Learning on Non-IID Features via Local Batch Normalization Xiaoxiao Li Meirui Jiang Xiaofei Zhang Michael Kamp Qi Dou OOD FedML 168 790 0 15 Feb 2021
A New Look and Convergence Rate of Federated Multi-Task Learning with Laplacian Regularization Canh T. Dinh Thanh Tung Vu N. H. Tran Minh N. Dao Hongyu Zhang FedML 65 40 0 14 Feb 2021
Exploiting Shared Representations for Personalized Federated Learning Liam Collins Hamed Hassani Aryan Mokhtari Sanjay Shakkottai FedML OOD 40 693 0 14 Feb 2021
The Distributed Discrete Gaussian Mechanism for Federated Learning with Secure Aggregation Peter Kairouz Ziyu Liu Thomas Steinke FedML 44 232 0 12 Feb 2021
Coordinating Momenta for Cross-silo Federated Learning An Xu Heng-Chiao Huang FedML 15 19 0 08 Feb 2021
Federated Reconstruction: Partially Local Federated Learning K. Singhal Hakim Sidahmed Zachary Garrett Shanshan Wu Keith Rush Sushant Prakash FedML 24 138 0 05 Feb 2021
Semi-Synchronous Federated Learning for Energy-Efficient Training and Accelerated Convergence in Cross-Silo Settings Dimitris Stripelis J. Ambite FedML 16 38 0 04 Feb 2021
FedAUX: Leveraging Unlabeled Auxiliary Data in Federated Learning Felix Sattler Tim Korjakow R. Rischke Wojciech Samek FedML 19 115 0 04 Feb 2021
Federated Learning on Non-IID Data Silos: An Experimental Study Yue Liu Yiqun Diao Quan Chen Bingsheng He FedML OOD 101 955 0 03 Feb 2021
Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learning Haibo Yang Minghong Fang Jia Liu FedML 28 251 0 27 Jan 2021
Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration Congliang Chen Li Shen Fangyu Zou Wei Liu 46 29 0 14 Jan 2021
Federated Nonconvex Sparse Learning Qianqian Tong Guannan Liang Tan Zhu J. Bi FedML 24 14 0 31 Dec 2020
CADA: Communication-Adaptive Distributed Adam Tianyi Chen Ziye Guo Yuejiao Sun W. Yin ODL 14 24 0 31 Dec 2020
Straggler-Resilient Federated Learning: Leveraging the Interplay Between Statistical Accuracy and System Heterogeneity Amirhossein Reisizadeh Isidoros Tziotis Hamed Hassani Aryan Mokhtari Ramtin Pedarsani FedML 172 99 0 28 Dec 2020
FedADC: Accelerated Federated Learning with Drift Control Emre Ozfatura Kerem Ozfatura Deniz Gunduz FedML 45 37 0 16 Dec 2020
CosSGD: Communication-Efficient Federated Learning with a Simple Cosine-Based Quantization Yang He Hui-Po Wang M. Zenk Mario Fritz FedML MQ 22 8 0 15 Dec 2020
Faster Non-Convex Federated Learning via Global and Local Momentum Rudrajit Das Anish Acharya Abolfazl Hashemi Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu FedML 40 82 0 07 Dec 2020
Design and Analysis of Uplink and Downlink Communications for Federated Learning Sihui Zheng Cong Shen Xiang Chen 39 140 0 07 Dec 2020
FedEval: A Holistic Evaluation Framework for Federated Learning Di Chai Leye Wang Liu Yang Junxue Zhang Kai Chen Qian Yang FedML 30 8 0 19 Nov 2020
Federated Composite Optimization Honglin Yuan Manzil Zaheer Sashank J. Reddi FedML 32 58 0 17 Nov 2020
Training Speech Recognition Models with Federated Learning: A Quality/Cost Framework Dhruv Guliani F. Beaufays Giovanni Motta FedML 13 80 0 29 Oct 2020
Demystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD Jiayi Wang Shiqiang Wang Rong-Rong Chen Mingyue Ji FedML 36 51 0 24 Oct 2020
A Federated Learning Approach to Anomaly Detection in Smart Buildings Raed Abdel Sater A. Ben Hamza 17 121 0 20 Oct 2020