Federated Zeroth-Order Optimization using Trajectory-Informed Surrogate Gradients

8 August 2023

Papers citing "Federated Zeroth-Order Optimization using Trajectory-Informed Surrogate Gradients"

7 / 7 papers shown

Title
A Historical Trajectory Assisted Optimization Method for Zeroth-Order Federated Learning Chenlin Wu Xiaoyu He Zike Li Zibin Zheng Zibin Zheng FedML 26 0 0 24 Sep 2024
Localized Zeroth-Order Prompt Optimization Wenyang Hu Yao Shu Zongmin Yu Zhaoxuan Wu Xiangqiang Lin Zhongxiang Dai See-Kiong Ng Bryan Kian Hsiang Low 35 6 0 05 Mar 2024
OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations Yao Shu Jiongfeng Fang Y. He Fei Richard Yu 21 0 0 18 Feb 2024
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes Zhen Qin Daoyuan Chen Bingchen Qian Bolin Ding Yaliang Li Shuiguang Deng FedML 37 32 0 11 Dec 2023
Communication-Efficient Stochastic Zeroth-Order Optimization for Federated Learning Wenzhi Fang Ziyi Yu Yuning Jiang Yuanming Shi Colin N. Jones Yong Zhou FedML 78 56 0 24 Jan 2022
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 187 412 0 14 Jul 2021
MetricOpt: Learning to Optimize Black-Box Evaluation Metrics Chen Huang Shuangfei Zhai Pengsheng Guo J. Susskind 44 11 0 21 Apr 2021