FedMCSA: Personalized Federated Learning via Model Components Self-Attention

23 August 2022

Yong Qi

Papers citing "FedMCSA: Personalized Federated Learning via Model Components Self-Attention"

32 / 32 papers shown

Title
Mitigating Biases in Student Performance Prediction via Attention-Based Personalized Federated Learning Yun-Wei Chu Seyyedali Hosseinalipour Elizabeth Tenorio Laura Cruz K. Douglas Andrew Lan Christopher G. Brinton FedML AI4Ed 51 21 0 02 Aug 2022
Homogeneous Learning: Self-Attention Decentralized Deep Learning Yuwei Sun H. Ochiai FedML 26 9 0 11 Oct 2021
Attention, please! A survey of Neural Attention Models in Deep Learning Alana de Santana Correia Esther Luna Colombini HAI 48 178 0 31 Mar 2021
Personalized Federated Learning using Hypernetworks Aviv Shamsian Aviv Navon Ethan Fetaya Gal Chechik FedML 86 328 0 08 Mar 2021
Exploiting Shared Representations for Personalized Federated Learning Liam Collins Hamed Hassani Aryan Mokhtari Sanjay Shakkottai FedML OOD 73 706 0 14 Feb 2021
Federated Block Coordinate Descent Scheme for Learning Global and Personalized Models Ruiyuan Wu Anna Scaglione Hoi-To Wai Nurullah Karakoç Kari Hreinsson Wing-Kin Ma FedML 16 19 0 27 Dec 2020
Personalized Federated Learning with First Order Model Optimization Michael Zhang Karan Sapra Sanja Fidler Serena Yeung J. Álvarez FedML 42 290 0 15 Dec 2020
A Scalable Approach for Privacy-Preserving Collaborative Machine Learning Jinhyun So Başak Güler A. Avestimehr FedML 42 51 0 03 Nov 2020
Lower Bounds and Optimal Algorithms for Personalized Federated Learning Filip Hanzely Slavomír Hanzely Samuel Horváth Peter Richtárik FedML 98 189 0 05 Oct 2020
Group Equivariant Stand-Alone Self-Attention For Vision David W. Romero Jean-Baptiste Cordonnier MDE 65 58 0 02 Oct 2020
FetchSGD: Communication-Efficient Federated Learning with Sketching D. Rothchild Ashwinee Panda Enayat Ullah Nikita Ivkin Ion Stoica Vladimir Braverman Joseph E. Gonzalez Raman Arora FedML 43 361 0 15 Jul 2020
Personalized Cross-Silo Federated Learning on Non-IID Data Yutao Huang Lingyang Chu Zirui Zhou Lanjun Wang Jiangchuan Liu J. Pei Yong Zhang FedML 58 601 0 07 Jul 2020
Personalized Federated Learning with Moreau Envelopes Canh T. Dinh N. H. Tran Tuan Dung Nguyen FedML 48 982 0 16 Jun 2020
Self-Attention Attribution: Interpreting Information Interactions Inside Transformer Y. Hao Li Dong Furu Wei Ke Xu ViT 41 219 0 23 Apr 2020
From Local SGD to Local Fixed-Point Methods for Federated Learning Grigory Malinovsky D. Kovalev Elnur Gasanov Laurent Condat Peter Richtárik FedML 97 115 0 03 Apr 2020
Adaptive Personalized Federated Learning Yuyang Deng Mohammad Mahdi Kamani M. Mahdavi FedML 275 549 0 30 Mar 2020
Survey of Personalization Techniques for Federated Learning V. Kulkarni Milind Kulkarni Aniruddha Pant FedML 208 328 0 19 Mar 2020
Three Approaches for Personalization with Applications to Federated Learning Yishay Mansour M. Mohri Jae Hun Ro A. Suresh FedML 84 569 0 25 Feb 2020
Federated Learning of a Mixture of Global and Local Models Filip Hanzely Peter Richtárik FedML 23 380 0 10 Feb 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 94 6,177 0 10 Dec 2019
Federated Learning with Bayesian Differential Privacy Aleksei Triastcyn Boi Faltings FedML 26 175 0 22 Nov 2019
Federated Evaluation of On-device Personalization Kangkang Wang Rajiv Mathews Chloé Kiddon Hubert Eichner F. Beaufays Daniel Ramage FedML 29 283 0 22 Oct 2019
Federated Learning: Challenges, Methods, and Future Directions Tian Li Anit Kumar Sahu Ameet Talwalkar Virginia Smith FedML 79 4,470 0 21 Aug 2019
Deep Leakage from Gradients Ligeng Zhu Zhijian Liu Song Han FedML 52 2,185 0 21 Jun 2019
Federated Machine Learning: Concept and Applications Qiang Yang Yang Liu Tianjian Chen Yongxin Tong FedML 45 2,297 0 13 Feb 2019
Federated Optimization in Heterogeneous Networks Tian Li Anit Kumar Sahu Manzil Zaheer Maziar Sanjabi Ameet Talwalkar Virginia Smith FedML 76 5,105 0 14 Dec 2018
A Hybrid Approach to Privacy-Preserving Federated Learning Stacey Truex Nathalie Baracaldo Ali Anwar Thomas Steinke Heiko Ludwig Rui Zhang Yi Zhou FedML 42 889 0 07 Dec 2018
Federated Learning for Mobile Keyboard Prediction Andrew Straiton Hard Kanishka Rao Zhifeng Lin Swaroop Indra Ramaswamy Youjie Li S. Augenstein Alex Schwing M. Annavaram A. Avestimehr FedML 96 1,525 0 08 Nov 2018
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 86 8,807 0 25 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 278 129,831 0 12 Jun 2017
Federated Multi-Task Learning Virginia Smith Chao-Kai Chiang Maziar Sanjabi Ameet Talwalkar FedML 73 1,791 0 30 May 2017
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 196 17,235 0 17 Feb 2016