The Non-IID Data Quagmire of Decentralized Machine Learning

1 October 2019

Papers citing "The Non-IID Data Quagmire of Decentralized Machine Learning"

41 / 291 papers shown

Title
Convergence and Accuracy Trade-Offs in Federated Learning and Meta-Learning Zachary B. Charles Jakub Konecný FedML 41 63 0 08 Mar 2021
FedDis: Disentangled Federated Learning for Unsupervised Brain Pathology Segmentation Cosmin I. Bercea Benedikt Wiestler Daniel Rueckert Shadi Albarqouni FedML OOD 28 38 0 05 Mar 2021
Cross-Gradient Aggregation for Decentralized Learning from Non-IID data Yasaman Esfandiari Sin Yong Tan Zhanhong Jiang Aditya Balu Ethan Herron Chinmay Hegde Soumik Sarkar OOD 25 50 0 02 Mar 2021
FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropout Samuel Horváth Stefanos Laskaridis Mario Almeida Ilias Leondiadis Stylianos I. Venieris Nicholas D. Lane 191 268 0 26 Feb 2021
DESED-FL and URBAN-FL: Federated Learning Datasets for Sound Event Detection David S. Johnson Wolfgang Lorenz Michael Taenzer S. I. Mimilakis S. Grollmisch J. Abeßer Hanna M. Lukashevich FedML 37 13 0 17 Feb 2021
FedBN: Federated Learning on Non-IID Features via Local Batch Normalization Xiaoxiao Li Meirui Jiang Xiaofei Zhang Michael Kamp Qi Dou OOD FedML 173 793 0 15 Feb 2021
Sparse-Push: Communication- & Energy-Efficient Decentralized Distributed Learning over Directed & Time-Varying Graphs with non-IID Datasets Sai Aparna Aketi Amandeep Singh J. Rabaey 29 10 0 10 Feb 2021
Consensus Control for Decentralized Deep Learning Lingjing Kong Tao R. Lin Anastasia Koloskova Martin Jaggi Sebastian U. Stich 19 76 0 09 Feb 2021
Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data Tao R. Lin Sai Praneeth Karimireddy Sebastian U. Stich Martin Jaggi FedML 33 101 0 09 Feb 2021
Coordinating Momenta for Cross-silo Federated Learning An Xu Heng-Chiao Huang FedML 15 19 0 08 Feb 2021
FedADC: Accelerated Federated Learning with Drift Control Emre Ozfatura Kerem Ozfatura Deniz Gunduz FedML 53 38 0 16 Dec 2020
Personalized Federated Learning with First Order Model Optimization Michael Zhang Karan Sapra Sanja Fidler Serena Yeung J. Álvarez FedML 38 290 0 15 Dec 2020
Federated Multi-Mini-Batch: An Efficient Training Approach to Federated Learning in Non-IID Environments Reza Nasirigerdeh Mohammad Bakhtiari Reihaneh Torkzadehmahani Amirhossein Bayat M. List David B. Blumenthal Jan Baumbach FedML 34 8 0 13 Nov 2020
Training Speech Recognition Models with Federated Learning: A Quality/Cost Framework Dhruv Guliani F. Beaufays Giovanni Motta FedML 13 80 0 29 Oct 2020
An Algorithm for Learning Smaller Representations of Models With Scarce Data Adrian de Wynter 46 2 0 15 Oct 2020
Improving Accuracy of Federated Learning in Non-IID Settings Mustafa Safa Ozdayi Murat Kantarcioglu Rishabh K. Iyer FedML 22 7 0 14 Oct 2020
Can Federated Learning Save The Planet? Xinchi Qiu Titouan Parcollet Daniel J. Beutel Taner Topal Akhil Mathur Nicholas D. Lane 28 80 0 13 Oct 2020
Oort: Efficient Federated Learning via Guided Participant Selection Fan Lai Xiangfeng Zhu H. Madhyastha Mosharaf Chowdhury FedML OODD 29 226 0 12 Oct 2020
Federated Learning via Posterior Averaging: A New Perspective and Practical Algorithms Maruan Al-Shedivat Jennifer Gillenwater Eric Xing Afshin Rostamizadeh FedML 30 109 0 11 Oct 2020
On Communication Compression for Distributed Optimization on Heterogeneous Data Sebastian U. Stich 53 23 0 04 Sep 2020
FedBE: Making Bayesian Model Ensemble Applicable to Federated Learning Hong-You Chen Wei-Lun Chao FedML 25 258 0 04 Sep 2020
Improving Semi-supervised Federated Learning by Reducing the Gradient Diversity of Models Zhengming Zhang Yaoqing Yang Z. Yao Yujun Yan Joseph E. Gonzalez Michael W. Mahoney FedML 64 36 0 26 Aug 2020
Inverse Distance Aggregation for Federated Learning with Non-IID Data Yousef Yeganeh Azade Farshad Nassir Navab Shadi Albarqouni OOD 22 82 0 17 Aug 2020
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning Sai Praneeth Karimireddy Martin Jaggi Satyen Kale M. Mohri Sashank J. Reddi Sebastian U. Stich A. Suresh FedML 37 215 0 08 Aug 2020
Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge Chaoyang He M. Annavaram A. Avestimehr FedML 35 23 0 28 Jul 2020
FedML: A Research Library and Benchmark for Federated Machine Learning Chaoyang He Songze Li Jinhyun So Xiao Zeng Mi Zhang ... Yang Liu Ramesh Raskar Qiang Yang M. Annavaram Salman Avestimehr FedML 168 566 0 27 Jul 2020
Attack of the Tails: Yes, You Really Can Backdoor Federated Learning Hongyi Wang Kartik K. Sreenivasan Shashank Rajput Harit Vishwakarma Saurabh Agarwal Jy-yong Sohn Kangwook Lee Dimitris Papailiopoulos FedML 32 592 0 09 Jul 2020
Federated Learning of User Authentication Models H. Hosseini Sungrack Yun Hyunsin Park Christos Louizos Joseph B. Soriaga Max Welling FedML 20 12 0 09 Jul 2020
On the Outsized Importance of Learning Rates in Local Update Methods Zachary B. Charles Jakub Konecný FedML 24 54 0 02 Jul 2020
Federated Learning With Quantized Global Model Updates M. Amiri Deniz Gunduz Sanjeev R. Kulkarni H. Vincent Poor FedML 24 131 0 18 Jun 2020
Ensemble Distillation for Robust Model Fusion in Federated Learning Tao R. Lin Lingjing Kong Sebastian U. Stich Martin Jaggi FedML 19 1,017 0 12 Jun 2020
Federated learning with hierarchical clustering of local updates to improve training on non-IID data Christopher Briggs Zhong Fan Péter András FedML 39 557 0 24 Apr 2020
Federated Visual Classification with Real-World Data Distribution T. Hsu Qi Matthew Brown FedML 25 199 0 18 Mar 2020
Marketplace for AI Models Abhishek Kumar Benjamin Finley Tristan Braud Sasu Tarkoma Pan Hui DiffM 25 14 0 03 Mar 2020
Adaptive Federated Optimization Sashank J. Reddi Zachary B. Charles Manzil Zaheer Zachary Garrett Keith Rush Jakub Konecný Sanjiv Kumar H. B. McMahan FedML 63 1,397 0 29 Feb 2020
Distributed Optimization over Block-Cyclic Data Yucheng Ding Chaoyue Niu Yikai Yan Zhenzhe Zheng Fan Wu Guihai Chen Shaojie Tang Rongfei Jia FedML 76 15 0 18 Feb 2020
Distributed Non-Convex Optimization with Sublinear Speedup under Intermittent Client Availability Yikai Yan Chaoyue Niu Yucheng Ding Zhenzhe Zheng Fan Wu Guihai Chen Shaojie Tang Zhihua Wu FedML 52 37 0 18 Feb 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 84 6,119 0 10 Dec 2019
Machine Learning Systems for Highly-Distributed and Rapidly-Growing Data Kevin Hsieh SyDa OOD 18 4 0 18 Oct 2019
Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms Xiangyi Chen Tiancong Chen Haoran Sun Zhiwei Steven Wu Mingyi Hong FedML 24 73 0 04 Jun 2019
Global Momentum Compression for Sparse Communication in Distributed Learning Chang-Wei Shi Shen-Yi Zhao Yin-Peng Xie Hao Gao Wu-Jun Li 52 1 0 30 May 2019