v1v2v3v4v5 (latest)

Adaptive Federated Optimization

29 February 2020

Sanjiv Kumar

Papers citing "Adaptive Federated Optimization"

50 / 815 papers shown

Title
A Quadratic Synchronization Rule for Distributed Deep Learning Xinran Gu Kaifeng Lyu Sanjeev Arora Jingzhao Zhang Longbo Huang 92 1 0 22 Oct 2023
Over-the-Air Federated Learning and Optimization Jingyang Zhu Yuanming Shi Yong Zhou Chunxiao Jiang Wei Chen Khaled B. Letaief FedML 105 13 0 16 Oct 2023
User Inference Attacks on Large Language Models Nikhil Kandpal Krishna Pillutla Alina Oprea Peter Kairouz Christopher A. Choquette-Choo Zheng Xu SILM AAML 132 20 0 13 Oct 2023
FedSym: Unleashing the Power of Entropy for Benchmarking the Algorithms for Federated Learning Ensiye Kiyamousavi Boris Kraychev Ivan Koychev FedML 53 0 0 11 Oct 2023
Fed-GraB: Federated Long-tailed Learning with Self-Adjusting Gradient Balancer Zikai Xiao Zihan Chen Songshan Liu Hualiang Wang Yang Feng Jinxiang Hao Qiufeng Wang Jian Wu Howard H. Yang Zuo-Qiang Liu FedML 96 13 0 11 Oct 2023
Correlated Noise Provably Beats Independent Noise for Differentially Private Learning Christopher A. Choquette-Choo Krishnamurthy Dvijotham Krishna Pillutla Arun Ganesh Thomas Steinke Abhradeep Thakurta 86 17 0 10 Oct 2023
Federated Learning with Reduced Information Leakage and Computation Tongxin Yin Xueru Zhang Mohammad Mahdi Khalili Mingyan Liu FedML 59 3 0 10 Oct 2023
Federated Learning: A Cutting-Edge Survey of the Latest Advancements and Applications Azim Akhtarshenas Mohammad Ali Vahedifar Navid Ayoobi B. Maham Tohid Alizadeh Sina Ebrahimi David López-Pérez FedML 74 7 0 08 Oct 2023
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning Liam Collins Shanshan Wu Sewoong Oh K. Sim FedML 94 10 0 06 Oct 2023
Utilizing Free Clients in Federated Learning for Focused Model Enhancement Aditya Narayan Ravi Ilan Shomorony FedML 81 0 0 06 Oct 2023
FedConv: Enhancing Convolutional Neural Networks for Handling Data Heterogeneity in Federated Learning Peiran Xu Zeyu Wang Jieru Mei Liangqiong Qu Alan Yuille Cihang Xie Yuyin Zhou FedML 60 1 0 06 Oct 2023
Solving a Class of Non-Convex Minimax Optimization in Federated Learning Xidong Wu Jianhui Sun Zhengmian Hu Aidong Zhang Heng-Chiao Huang FedML 158 13 0 05 Oct 2023
PrIeD-KIE: Towards Privacy Preserved Document Key Information Extraction S. Saifullah S. Agne Andreas Dengel Sheraz Ahmed 78 0 0 05 Oct 2023
FedNAR: Federated Optimization with Normalized Annealing Regularization Junbo Li Ang Li Chong Tian Qirong Ho Eric Xing Hongyi Wang FedML 65 5 0 04 Oct 2023
FedHyper: A Universal and Robust Learning Rate Scheduler for Federated Learning with Hypergradient Descent Ziyao Wang Jianyu Wang Ang Li FedML 73 3 0 04 Oct 2023
Federated Fine-Tuning of LLMs on the Very Edge: The Good, the Bad, the Ugly Herbert Woisetschläger Alexander Erben Shiqiang Wang R. Mayer Hans-Arno Jacobsen FedML 91 21 0 04 Oct 2023
Enhanced Federated Optimization: Adaptive Unbiased Sampling with Reduced Variance Dun Zeng Zenglin Xu Yu Pan Xu Luo Qifan Wang Xiaoying Tang FedML 74 1 0 04 Oct 2023
Heterogeneous Federated Learning Using Knowledge Codistillation Jared Lichtarge Ehsan Amid Shankar Kumar Tien-Ju Yang Rohan Anil Rajiv Mathews FedML 89 0 0 04 Oct 2023
Federated Conditional Stochastic Optimization Xidong Wu Jianhui Sun Zhengmian Hu Junyi Li Aidong Zhang Heng-Chiao Huang FedML 155 4 0 04 Oct 2023
Window-based Model Averaging Improves Generalization in Heterogeneous Federated Learning Debora Caldarola Barbara Caputo Marco Ciccone FedML 84 7 0 02 Oct 2023
FedAIoT: A Federated Learning Benchmark for Artificial Intelligence of Things Samiul Alam Tuo Zhang Tiantian Feng Hui Shen Zhichao Cao ... JeongGil Ko Kiran Somasundaram Shrikanth S. Narayanan Salman Avestimehr Mi Zhang 129 11 0 29 Sep 2023
Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers and Gradient Clipping Martin Pelikan Sheikh Shams Azam Vitaly Feldman Jan Honza Silovsky Kunal Talwar Christopher G. Brinton Tatiana Likhomanenko 113 8 0 29 Sep 2023
A Comprehensive View of Personalized Federated Learning on Heterogeneous Clinical Datasets Fatemeh Tavakoli D. B. Emerson Sana Ayromlou John Jewell Amrit Krishnan Yuchong Zhang A. Verma Fahad Razak FedML 89 1 0 28 Sep 2023
Deep Model Fusion: A Survey Weishi Li Yong Peng Miao Zhang Liang Ding Han Hu Li Shen FedML MoMe 117 62 0 27 Sep 2023
FedCompass: Efficient Cross-Silo Federated Learning on Heterogeneous Client Devices using a Computing Power Aware Scheduler Zilinghan Li Pranshu Chaturvedi Shilan He Han-qiu Chen Gagandeep Singh Volodymyr V. Kindratenko Eliu A. Huerta Kibaek Kim Ravi K. Madduri FedML 86 12 0 26 Sep 2023
Importance of Smoothness Induced by Optimizers in FL4ASR: Towards Understanding Federated Learning for End-to-End ASR Sheikh Shams Azam Tatiana Likhomanenko Martin Pelikan Jan Honza Silovsky 70 7 0 22 Sep 2023
Preconditioned Federated Learning Zeyi Tao Jindi Wu Qun Li FedML 21 0 0 20 Sep 2023
FedLALR: Client-Specific Adaptive Learning Rates Achieve Linear Speedup for Non-IID Data Hao Sun Li Shen Shi-Yong Chen Jingwei Sun Jing Li Guangzhong Sun Dacheng Tao FedML 90 2 0 18 Sep 2023
Tackling the Non-IID Issue in Heterogeneous Federated Learning by Gradient Harmonization Xinyu Zhang Weiyu Sun Ying-Cong Chen FedML 118 6 0 13 Sep 2023
Byzantine-Robust Federated Learning with Variance Reduction and Differential Privacy Zikai Zhang Rui Hu 78 12 0 07 Sep 2023
Federated Learning Over Images: Vertical Decompositions and Pre-Trained Backbones Are Difficult to Beat Erdong Hu Yu-Shuen Tang Anastasios Kyrillidis C. Jermaine FedML 115 11 0 06 Sep 2023
Bias Propagation in Federated Learning Hong Chang Reza Shokri FedML 71 13 0 05 Sep 2023
DRAG: Divergence-based Adaptive Aggregation in Federated learning on Non-IID Data Feng Zhu Jingjing Zhang Shengyun Liu Xin Eric Wang FedML 79 1 0 04 Sep 2023
Federated Learning in IoT: a Survey from a Resource-Constrained Perspective Ishmeet Kaur 83 3 0 25 Aug 2023
PFL-GAN: When Client Heterogeneity Meets Generative Models in Personalized Federated Learning Achintha Wijesinghe Songyang Zhang Zhi Ding 74 2 0 23 Aug 2023
ULDP-FL: Federated Learning with Across Silo User-Level Differential Privacy Fumiyuki Kato Li Xiong Shun Takagi Yang Cao Masatoshi Yoshikawa FedML 92 4 0 23 Aug 2023
Trustworthy Representation Learning Across Domains Ronghang Zhu Dongliang Guo Daiqing Qi Zhixuan Chu Xiang Yu Sheng Li FaML AI4TS 102 2 0 23 Aug 2023
A Survey for Federated Learning Evaluations: Goals and Measures Di Chai Leye Wang Liu Yang Junxue Zhang Kai Chen Qian Yang ELM FedML 96 21 0 23 Aug 2023
Federated Learning on Patient Data for Privacy-Protecting Polycystic Ovary Syndrome Treatment Lucía Morris Tori Qiu Nikhil Raghuraman 57 0 0 22 Aug 2023
ALI-DPFL: Differentially Private Federated Learning with Adaptive Local Iterations Xinpeng Ling Jie Fu Kuncan Wang Haitao Liu Zhili Chen FedML 117 2 0 21 Aug 2023
Federated Learning for Connected and Automated Vehicles: A Survey of Existing Approaches and Challenges Vishnu Pandi Chellapandi Liangqi Yuan Christopher G. Brinton Stanislaw H. .Zak Ziran Wang FedML 125 88 0 21 Aug 2023
Understanding the Role of Layer Normalization in Label-Skewed Federated Learning Guojun Zhang Mahdi Beitollahi Alex Bie Xi Chen FedML MLT AI4CE 69 3 0 18 Aug 2023
APPFLx: Providing Privacy-Preserving Cross-Silo Federated Learning as a Service Zilinghan Li Shilan He Pranshu Chaturvedi Trung-Hieu Hoang Minseok Ryu ... Jordan D. Fuhrman Maryellen L. Giger Ryan Chard Kibaek Kim Ravi K. Madduri 101 9 0 17 Aug 2023
FedPop: Federated Population-based Hyperparameter Tuning Haokun Chen Denis Krompass Jindong Gu Volker Tresp FedML 103 0 0 16 Aug 2023
Stochastic Controlled Averaging for Federated Learning with Communication Compression Xinmeng Huang Ping Li Xiaoyun Li 117 211 0 16 Aug 2023
SLoRA: Federated Parameter Efficient Fine-Tuning of Language Models Sara Babakniya A. Elkordy Yahya H. Ezzeldin Qingfeng Liu Kee-Bong Song Mostafa El-Khamy Salman Avestimehr 76 73 0 12 Aug 2023
Federated Zeroth-Order Optimization using Trajectory-Informed Surrogate Gradients Yao Shu Xiaoqiang Lin Zhongxiang Dai Bryan Kian Hsiang Low FedML 96 7 0 08 Aug 2023
FLIPS: Federated Learning using Intelligent Participant Selection R. Bhope K.R. Jayaram N. Venkatasubramanian Ashish Verma Gegi Thomas FedML 82 3 0 07 Aug 2023
Adapter-based Selective Knowledge Distillation for Federated Multi-domain Meeting Summarization Xiachong Feng Xiaocheng Feng Xiyuan Du MingSung Kan Bing Qin FedML 77 5 0 07 Aug 2023
Scaling Survival Analysis in Healthcare with Federated Survival Forests: A Comparative Study on Heart Failure and Breast Cancer Genomics Alberto Archetti F. Ieva Matteo Matteucci FedML 65 13 0 04 Aug 2023