Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimization

25 May 2018

Papers citing "Zeroth-Order Stochastic Variance Reduction for Nonconvex Optimization"

37 / 37 papers shown

Title
Minimisation of Quasar-Convex Functions Using Random Zeroth-Order Oracles Amir Ali Farzin Yuen-Man Pun Iman Shames 31 0 0 04 May 2025
Perturbation-efficient Zeroth-order Optimization for Hardware-friendly On-device Training Qitao Tan Sung-En Chang Rui Xia Huidong Ji Chence Yang ... Zheng Zhan Zhou Zou Yufei Wang Jin Lu Geng Yuan 41 0 0 28 Apr 2025
Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks Yequan Zhao Xinling Yu Xian Xiao Zhengzhang Chen Zhengwu Liu G. Kurczveil R. Beausoleil Shixuan Liu Z. Zhang 56 0 0 17 Feb 2025
An Enhanced Zeroth-Order Stochastic Frank-Wolfe Framework for Constrained Finite-Sum Optimization Haishan Ye Yinghui Huang Hao Di Xiangyu Chang 43 0 0 13 Jan 2025
Obtaining Lower Query Complexities through Lightweight Zeroth-Order Proximal Gradient Algorithms Bin Gu Xiyuan Wei Hualin Zhang Yi Chang Heng-Chiao Huang FedML 23 0 0 03 Oct 2024
Zeroth-Order Policy Gradient for Reinforcement Learning from Human Feedback without Reward Inference Qining Zhang Lei Ying OffRL 37 2 0 25 Sep 2024
Gradient-Free Method for Heavily Constrained Nonconvex Optimization Wanli Shi Hongchang Gao Bin Gu 21 5 0 31 Aug 2024
Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization Zhe Li Bicheng Ying Zidong Liu Haibo Yang Haibo Yang FedML 59 3 0 24 May 2024
Dynamic Anisotropic Smoothing for Noisy Derivative-Free Optimization S. Reifenstein T. Leleu Yoshihisa Yamamoto 48 1 0 02 May 2024
End-to-End Mesh Optimization of a Hybrid Deep Learning Black-Box PDE Solver Shaocong Ma James Diffenderfer B. Kailkhura Yi Zhou AI4CE 46 0 0 17 Apr 2024
Private Fine-tuning of Large Language Models with Zeroth-order Optimization Xinyu Tang Ashwinee Panda Milad Nasr Saeed Mahloujifar Prateek Mittal 47 18 0 09 Jan 2024
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes Zhen Qin Daoyuan Chen Bingchen Qian Bolin Ding Yaliang Li Shuiguang Deng FedML 42 32 0 11 Dec 2023
Oracle Complexity Reduction for Model-free LQR: A Stochastic Variance-Reduced Policy Gradient Approach Leonardo F. Toso Han Wang James Anderson 37 2 0 19 Sep 2023
Certified Zeroth-order Black-Box Defense with Robust UNet Denoiser Astha Verma A. Subramanyam Siddhesh Bangar Naman Lal R. Shah Shiníchi Satoh 42 4 0 13 Apr 2023
Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic Optimization Le‐Yu Chen Jing Xu Luo Luo 31 15 0 16 Jan 2023
PyPop7: A Pure-Python Library for Population-Based Black-Box Optimization Qiqi Duan Guochen Zhou Chang Shao Zhuowei Wang Mingyang Feng Yuwei Huang Yajing Tan Yijun Yang Qi Zhao Yuhui Shi 34 5 0 12 Dec 2022
Adaptive Stochastic Optimisation of Nonconvex Composite Objectives Weijia Shao F. Sivrikaya S. Albayrak 21 0 0 21 Nov 2022
Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization Tianyi Lin Zeyu Zheng Michael I. Jordan 59 52 0 12 Sep 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization Quan-Wu Xiao Qing Ling Tianyi Chen 41 0 0 14 Jun 2022
How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspective Yimeng Zhang Yuguang Yao Jinghan Jia Jinfeng Yi Min-Fong Hong Shiyu Chang Sijia Liu AAML 26 33 0 27 Mar 2022
Communication-Efficient Stochastic Zeroth-Order Optimization for Federated Learning Wenzhi Fang Ziyi Yu Yuning Jiang Yuanming Shi Colin N. Jones Yong Zhou FedML 78 57 0 24 Jan 2022
Decentralized Multi-Task Stochastic Optimization With Compressed Communications Navjot Singh Xuanyu Cao Suhas Diggavi Tamer Basar 18 9 0 23 Dec 2021
On the Convergence Theory for Hessian-Free Bilevel Algorithms Daouda Sow Kaiyi Ji Yingbin Liang 28 28 0 13 Oct 2021
Curvature-Aware Derivative-Free Optimization Bumsu Kim HanQin Cai Daniel McKenzie W. Yin ODL 35 10 0 27 Sep 2021
Adaptive Sampling Quasi-Newton Methods for Zeroth-Order Stochastic Optimization Raghu Bollapragada Stefan M. Wild 35 11 0 24 Sep 2021
A Hard Label Black-box Adversarial Attack Against Graph Neural Networks Jiaming Mu Binghui Wang Qi Li Kun Sun Mingwei Xu Zhuotao Liu AAML 23 34 0 21 Aug 2021
Zeroth and First Order Stochastic Frank-Wolfe Algorithms for Constrained Optimization Zeeshan Akhtar K. Rajawat 37 6 0 14 Jul 2021
Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order Optimization Jiaqi Gu Chenghao Feng Zheng Zhao Zhoufeng Ying Ray T. Chen David Z. Pan 27 28 0 21 Dec 2020
On the Convergence of SGD with Biased Gradients Ahmad Ajalloeian Sebastian U. Stich 6 84 0 31 Jul 2020
A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning Sijia Liu Pin-Yu Chen B. Kailkhura Gaoyuan Zhang A. Hero III P. Varshney 24 224 0 11 Jun 2020
Boolean learning under noise-perturbations in hardware neural networks Louis Andréoli X. Porte Stéphane Chrétien M. Jacquot L. Larger Daniel Brunner 21 12 0 27 Mar 2020
Learning to Learn by Zeroth-Order Oracle Yangjun Ruan Yuanhao Xiong Sashank J. Reddi Sanjiv Kumar Cho-Jui Hsieh 22 17 0 21 Oct 2019
Sign-OPT: A Query-Efficient Hard-label Adversarial Attack Minhao Cheng Simranjit Singh Patrick H. Chen Pin-Yu Chen Sijia Liu Cho-Jui Hsieh AAML 126 219 0 24 Sep 2019
Model Agnostic Contrastive Explanations for Structured Data Amit Dhurandhar Tejaswini Pedapati Avinash Balakrishnan Pin-Yu Chen Karthikeyan Shanmugam Ruchi Puri FAtt 20 82 0 31 May 2019
Faster Gradient-Free Proximal Stochastic Methods for Nonconvex Nonsmooth Optimization Feihu Huang Bin Gu Zhouyuan Huo Songcan Chen Heng-Chiao Huang 14 26 0 16 Feb 2019
Daedalus: Breaking Non-Maximum Suppression in Object Detection via Adversarial Examples Derui Wang Chaoran Li S. Wen Qing-Long Han Surya Nepal Xiangyu Zhang Yang Xiang AAML 30 40 0 06 Feb 2019
Hessian-Aware Zeroth-Order Optimization for Black-Box Adversarial Attack Haishan Ye Zhichao Huang Cong Fang C. J. Li Tong Zhang AAML 18 41 0 29 Dec 2018