Communication-Efficient Learning of Deep Networks from Decentralized Data

17 February 2016

Blaise Agüera y Arcas

FedML

ArXiv PDF HTML

Papers citing "Communication-Efficient Learning of Deep Networks from Decentralized Data"

50 / 2,521 papers shown

Title
Federated Learning via Over-the-Air Computation Kai Yang Tao Jiang Yuanming Shi Z. Ding FedML 31 873 0 31 Dec 2018
Broadband Analog Aggregation for Low-Latency Federated Edge Learning (Extended Version) Guangxu Zhu Yong Wang Kaibin Huang FedML 41 638 0 30 Dec 2018
Entropy-Constrained Training of Deep Neural Networks Simon Wiedemann Arturo Marbán K. Müller Wojciech Samek 27 27 0 18 Dec 2018
Learning Private Neural Language Modeling with Attentive Aggregation Shaoxiong Ji Shirui Pan Guodong Long Xue Li Jing Jiang Zi Huang FedML MoMe 16 136 0 17 Dec 2018
Stochastic Distributed Optimization for Machine Learning from Decentralized Features Yaochen Hu Di Niu Jianming Yang Shengping Zhou 11 5 0 16 Dec 2018
No Peek: A Survey of private distributed deep learning Praneeth Vepakomma Tristan Swedish Ramesh Raskar O. Gupta Abhimanyu Dubey SyDa FedML 30 100 0 08 Dec 2018
Communication-Efficient Policy Gradient Methods for Distributed Reinforcement Learning Tianyi Chen Kaipeng Zhang G. Giannakis Tamer Basar OffRL 29 41 0 07 Dec 2018
A Hybrid Approach to Privacy-Preserving Federated Learning Stacey Truex Nathalie Baracaldo Ali Anwar Thomas Steinke Heiko Ludwig Rui Zhang Yi Zhou FedML 31 884 0 07 Dec 2018
Wireless Network Intelligence at the Edge Jihong Park S. Samarakoon M. Bennis Mérouane Debbah 21 518 0 07 Dec 2018
Wireless Data Acquisition for Edge Learning: Data-Importance Aware Retransmission Dongzhu Liu Guangxu Zhu Jun Zhang Kaibin Huang 14 41 0 05 Dec 2018
LEAF: A Benchmark for Federated Settings S. Caldas Sai Meher Karthik Duddu Peter Wu Tian Li Jakub Konecný H. B. McMahan Virginia Smith Ameet Talwalkar FedML 59 1,397 0 03 Dec 2018
Protection Against Reconstruction and Its Applications in Private Federated Learning Abhishek Bhowmick John C. Duchi Julien Freudiger Gaurav Kapoor Ryan M. Rogers FedML 27 357 0 03 Dec 2018
Comprehensive Privacy Analysis of Deep Learning: Passive and Active White-box Inference Attacks against Centralized and Federated Learning Milad Nasr Reza Shokri Amir Houmansadr FedML MIACV AAML 13 244 0 03 Dec 2018
Split learning for health: Distributed deep learning without sharing raw patient data Praneeth Vepakomma O. Gupta Tristan Swedish Ramesh Raskar FedML 63 692 0 03 Dec 2018
Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learning Peng Kuang Mengkai Song Zhifei Zhang Yang Song Qian Wang Hairong Qi FedML 28 776 0 03 Dec 2018
Analyzing Federated Learning through an Adversarial Lens A. Bhagoji Supriyo Chakraborty Prateek Mittal S. Calo FedML 191 1,033 0 29 Nov 2018
Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data Eunjeong Jeong Seungeun Oh Hyesung Kim Jihong Park M. Bennis Seong-Lyun Kim FedML 28 594 0 28 Nov 2018
Partitioned Variational Inference: A unified framework encompassing federated and continual learning T. Bui Cuong V Nguyen S. Swaroop Richard Turner FedML 27 55 0 27 Nov 2018
An overview of deep learning in medical imaging focusing on MRI A. Lundervold A. Lundervold OOD 22 1,608 0 25 Nov 2018
Federated Learning for Mobile Keyboard Prediction Andrew Straiton Hard Kanishka Rao Zhifeng Lin Swaroop Indra Ramaswamy Youjie Li S. Augenstein Alex Schwing M. Annavaram A. Avestimehr FedML 74 1,513 0 08 Nov 2018
Adaptive Communication Strategies to Achieve the Best Error-Runtime Trade-off in Local-Update SGD Jianyu Wang Gauri Joshi FedML 33 232 0 19 Oct 2018
Collaborative Deep Learning Across Multiple Data Centers Kele Xu Haibo Mi Dawei Feng Huaimin Wang Chuan Chen Zibin Zheng Xu Lan FedML 140 18 0 16 Oct 2018
Distributed learning of deep neural network over multiple agents O. Gupta Ramesh Raskar FedML OOD 19 598 0 14 Oct 2018
Multi-Institutional Deep Learning Modeling Without Sharing Patient Data: A Feasibility Study on Brain Tumor Segmentation Micah J. Sheller G. A. Reina Brandon Edwards Jason Martin Spyridon Bakas FedML 24 457 0 10 Oct 2018
Effective Parallelisation for Machine Learning Michael Kamp Mario Boley Olana Missura Thomas Gärtner 11 12 0 08 Oct 2018
In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning Xiaofei Wang Yiwen Han Chenyang Wang Qiyang Zhao Xu Chen Min Chen 11 798 0 19 Sep 2018
Deep Learning Towards Mobile Applications Ji Wang Bokai Cao Philip S. Yu Lichao Sun Weidong Bao Xiaomin Zhu HAI 32 98 0 10 Sep 2018
Towards an Intelligent Edge: Wireless Communication Meets Machine Learning Guangxu Zhu Dongzhu Liu Yuqing Du Changsheng You Jun Zhang Kaibin Huang 9 505 0 02 Sep 2018
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms Jianyu Wang Gauri Joshi 33 348 0 22 Aug 2018
Don't Use Large Mini-Batches, Use Local SGD Tao R. Lin Sebastian U. Stich Kumar Kshitij Patel Martin Jaggi 57 429 0 22 Aug 2018
Privacy Amplification by Iteration Vitaly Feldman Ilya Mironov Kunal Talwar Abhradeep Thakurta FedML 26 170 0 20 Aug 2018
Mitigating Sybils in Federated Learning Poisoning Clement Fung Chris J. M. Yoon Ivan Beschastnikh AAML 15 497 0 14 Aug 2018
COLA: Decentralized Linear Learning Lie He An Bian Martin Jaggi 24 117 0 13 Aug 2018
Quantized Densely Connected U-Nets for Efficient Landmark Localization Zhiqiang Tang Xi Peng Shijie Geng Lingfei Wu Shaoting Zhang Dimitris N. Metaxas 3DV 19 143 0 07 Aug 2018
Differentially-Private "Draw and Discard" Machine Learning Vasyl Pihur Aleksandra Korolova Frederick Liu Subhash Sankuratripati M. Yung Dachuan Huang Ruogu Zeng FedML 33 39 0 11 Jul 2018
Efficient Decentralized Deep Learning by Dynamic Model Averaging Michael Kamp Linara Adilova Joachim Sicking Fabian Hüger Peter Schlicht Tim Wirtz Stefan Wrobel 32 129 0 09 Jul 2018
Blockchain as a Service: A Decentralized and Secure Computing Paradigm G. Mendis Yifu Wu Jin Wei Moein Sabounchi Rigoberto Roche' 27 21 0 05 Jul 2018
Confidential Inference via Ternary Model Partitioning Zhongshu Gu Heqing Huang Jialong Zhang D. Su Hani Jamjoom Ankita Lamba Dimitrios E. Pendarakis Ian Molloy 21 53 0 03 Jul 2018
Compact and Computationally Efficient Representation of Deep Neural Networks Simon Wiedemann K. Müller Wojciech Samek MQ 42 66 0 27 May 2018
cpSGD: Communication-efficient and differentially-private distributed SGD Naman Agarwal A. Suresh Felix X. Yu Sanjiv Kumar H. B. McMahan FedML 28 486 0 27 May 2018
Graph Oracle Models, Lower Bounds, and Gaps for Parallel Stochastic Optimization Blake E. Woodworth Jialei Wang Adam D. Smith H. B. McMahan Nathan Srebro 14 123 0 25 May 2018
LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning Tianyi Chen G. Giannakis Tao Sun W. Yin 34 297 0 25 May 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 82 1,047 0 24 May 2018
Sparse Binary Compression: Towards Distributed Deep Learning with minimal Communication Felix Sattler Simon Wiedemann K. Müller Wojciech Samek MQ 36 212 0 22 May 2018
Gradient-Leaks: Understanding and Controlling Deanonymization in Federated Learning Tribhuvanesh Orekondy Seong Joon Oh Yang Zhang Bernt Schiele Mario Fritz PICV FedML 359 37 0 15 May 2018
Exploiting Unintended Feature Leakage in Collaborative Learning Luca Melis Congzheng Song Emiliano De Cristofaro Vitaly Shmatikov FedML 87 1,455 0 10 May 2018
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge Takayuki Nishio Ryo Yonetani FedML 49 1,376 0 23 Apr 2018
Adaptive Federated Learning in Resource Constrained Edge Computing Systems Shiqiang Wang Tiffany Tuor Theodoros Salonidis K. Leung C. Makaya T. He Kevin S. Chan 144 1,688 0 14 Apr 2018
Deep Learning in Mobile and Wireless Networking: A Survey Chaoyun Zhang P. Patras Hamed Haddadi 47 1,306 0 12 Mar 2018
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 31 194 0 03 Mar 2018