Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning

10 June 2021

Papers citing "Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning"

50 / 61 papers shown

Title
Accurate Forgetting for Heterogeneous Federated Continual Learning Abudukelimu Wuerkaixi Sen Cui J.N. Zhang Kunda Yan Bo Han Gang Niu Lei Fang Changshui Zhang Masashi Sugiyama 215 10 0 20 Feb 2025
A Unified Solution to Diverse Heterogeneities in One-shot Federated Learning Jun Bai Yiliao Song Di Wu Atul Sajjanhar Yong Xiang Wei Zhou Xiaohui Tao Yan Li Yuante Li FedML 74 1 0 28 Oct 2024
Selective Aggregation for Low-Rank Adaptation in Federated Learning Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 87 15 0 02 Oct 2024
OnDev-LCT: On-Device Lightweight Convolutional Transformers towards federated learning Chu Myaet Thwal Minh N. H. Nguyen Ye Lin Tun Seongjin Kim My T. Thai Choong Seon Hong 92 5 0 22 Jan 2024
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 451 7,739 0 11 Nov 2021
Collaborative Unsupervised Visual Representation Learning from Decentralized Data Weiming Zhuang Xin Gan Yonggang Wen Shuai Zhang Shuai Yi FedML 102 99 0 14 Aug 2021
SplitAVG: A heterogeneity-aware federated deep learning method for medical imaging Miao Zhang Liangqiong Qu Praveer Singh Jayashree Kalpathy-Cramer D. Rubin OOD FedML 55 62 0 06 Jul 2021
Handling Data Heterogeneity with Generative Replay in Collaborative Learning for Medical Imaging Liangqiong Qu N. Balachandar Miao Zhang D. Rubin MedIm 55 20 0 24 Jun 2021
Intriguing Properties of Vision Transformers Muzammal Naseer Kanchana Ranasinghe Salman Khan Munawar Hayat Fahad Shahbaz Khan Ming-Hsuan Yang ViT 313 647 0 21 May 2021
Vision Transformers are Robust Learners Sayak Paul Pin-Yu Chen ViT 59 311 0 17 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 668 6,066 0 29 Apr 2021
On the Robustness of Vision Transformers to Adversarial Examples Kaleel Mahmood Rigel Mahmood Marten van Dijk ViT 111 224 0 31 Mar 2021
Model-Contrastive Federated Learning Qinbin Li Bingsheng He D. Song FedML 79 1,037 0 30 Mar 2021
Understanding Robustness of Transformers for Image Classification Srinadh Bhojanapalli Ayan Chakrabarti Daniel Glasner Daliang Li Thomas Unterthiner Andreas Veit ViT 85 385 0 26 Mar 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 441 21,418 0 25 Mar 2021
Addressing catastrophic forgetting for medical domain expansion Sharut Gupta Praveer Singh Ken Chang Liangqiong Qu M. Aggarwal ... J. Patel Charles Lu Christopher P. Bridge D. Rubin Jayashree Kalpathy-Cramer OOD 64 16 0 24 Mar 2021
FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Space Quande Liu Cheng Chen J. Qin Qi Dou Pheng-Ann Heng OOD FedML 147 438 0 10 Mar 2021
Pretrained Transformers as Universal Computation Engines Kevin Lu Aditya Grover Pieter Abbeel Igor Mordatch 50 221 0 09 Mar 2021
Multi-institutional Collaborations for Improving Deep Learning-based Magnetic Resonance Image Reconstruction Using Federated Learning Pengfei Guo Puyang Wang Jinyuan Zhou Shanshan Jiang Vishal M. Patel FedML OOD 70 145 0 03 Mar 2021
Personalized Federated Learning with First Order Model Optimization Michael Zhang Karan Sapra Sanja Fidler Serena Yeung J. Álvarez FedML 62 298 0 15 Dec 2020
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 486 1,917 0 14 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 634 41,003 0 22 Oct 2020
Federated Learning for Breast Density Classification: A Real-World Implementation H. Roth Ken Chang Praveer Singh N. Neumark Wenqi Li ... I. Dayan R. Naidu Mona G. Flores D. Rubin Jayashree Kalpathy-Cramer OOD FedML AI4CE 55 164 0 03 Sep 2020
Ensemble Distillation for Robust Model Fusion in Federated Learning Tao R. Lin Lingjing Kong Sebastian U. Stich Martin Jaggi FedML 97 1,039 0 12 Jun 2020
Inverting Gradients -- How easy is it to break privacy in federated learning? Jonas Geiping Hartmut Bauermeister Hannah Dröge Michael Moeller FedML 100 1,223 0 31 Mar 2020
The Future of Digital Health with Federated Learning Nicola Rieke Jonny Hancox Wenqi Li Fausto Milletari H. Roth ... Ronald M. Summers Andrew Trask Daguang Xu Maximilian Baust M. Jorge Cardoso OOD 259 1,770 0 18 Mar 2020
Federated Learning with Matched Averaging Hongyi Wang Mikhail Yurochkin Yuekai Sun Dimitris Papailiopoulos Y. Khazaeni FedML 121 1,122 0 15 Feb 2020
Think Locally, Act Globally: Federated Learning with Local and Global Representations Paul Pu Liang Terrance Liu Liu Ziyin Nicholas B. Allen Randy P. Auerbach David Brent Ruslan Salakhutdinov Louis-Philippe Morency FedML 110 562 0 06 Jan 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 234 6,252 0 10 Dec 2019
Federated Learning with Personalization Layers Manoj Ghuhan Arivazhagan V. Aggarwal Aaditya Kumar Singh Sunav Choudhary FedML 87 840 0 02 Dec 2019
Differential Privacy-enabled Federated Learning for Sensitive Health Data Olivia Choudhury A. Gkoulalas-Divanis Theodoros Salonidis I. Sylla Yoonyoung Park Grace Hsu Amar K. Das FedML OOD 49 176 0 07 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 146 568 0 01 Oct 2019
Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classification T. Hsu Qi Matthew Brown FedML 138 1,148 0 13 Sep 2019
Federated Learning: Challenges, Methods, and Future Directions Tian Li Anit Kumar Sahu Ameet Talwalkar Virginia Smith FedML 121 4,514 0 21 Aug 2019
Federated Learning for Wireless Communications: Motivation, Opportunities and Challenges Solmaz Niknam Harpreet S. Dhillon J. H. Reed 58 604 0 30 Jul 2019
Stand-Alone Self-Attention in Vision Models Prajit Ramachandran Niki Parmar Ashish Vaswani Irwan Bello Anselm Levskaya Jonathon Shlens VLM SLR ViT 89 1,214 0 13 Jun 2019
Multimodal Transformer for Unaligned Multimodal Language Sequences Yao-Hung Hubert Tsai Shaojie Bai Paul Pu Liang J. Zico Kolter Louis-Philippe Morency Ruslan Salakhutdinov 76 1,301 0 01 Jun 2019
Learning Robust Global Representations by Penalizing Local Predictive Power Haohan Wang Songwei Ge Eric Xing Zachary Chase Lipton OOD 117 959 0 29 May 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 137 18,115 0 28 May 2019
Generating Long Sequences with Sparse Transformers R. Child Scott Gray Alec Radford Ilya Sutskever 115 1,896 0 23 Apr 2019
Robust and Communication-Efficient Federated Learning from Non-IID Data Felix Sattler Simon Wiedemann K. Müller Wojciech Samek FedML 69 1,356 0 07 Mar 2019
An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models Alexandra Chronopoulou Christos Baziotis Alexandros Potamianos CLL 60 131 0 27 Feb 2019
Federated Optimization in Heterogeneous Networks Tian Li Anit Kumar Sahu Manzil Zaheer Maziar Sanjabi Ameet Talwalkar Virginia Smith FedML 180 5,176 0 14 Dec 2018
LEAF: A Benchmark for Federated Settings S. Caldas Sai Meher Karthik Duddu Peter Wu Tian Li Jakub Konecný H. B. McMahan Virginia Smith Ameet Talwalkar FedML 137 1,419 0 03 Dec 2018
Split learning for health: Distributed deep learning without sharing raw patient data Praneeth Vepakomma O. Gupta Tristan Swedish Ramesh Raskar FedML 118 707 0 03 Dec 2018
ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness Robert Geirhos Patricia Rubisch Claudio Michaelis Matthias Bethge Felix Wichmann Wieland Brendel 100 2,668 0 29 Nov 2018
Federated Learning for Mobile Keyboard Prediction Andrew Straiton Hard Kanishka Rao Zhifeng Lin Swaroop Indra Ramaswamy Youjie Li S. Augenstein Alex Schwing M. Annavaram A. Avestimehr FedML 131 1,536 0 08 Nov 2018
Re-evaluating Continual Learning Scenarios: A Categorization and Case for Strong Baselines Yen-Chang Hsu Yen-Cheng Liu Anita Ramasamy Z. Kira CLL ELM 80 357 0 30 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.7K 94,770 0 11 Oct 2018
Federated Learning with Non-IID Data Yue Zhao Meng Li Liangzhen Lai Naveen Suda Damon Civin Vikas Chandra FedML 152 2,568 0 02 Jun 2018