Stochastic Zeroth-order Optimization in High Dimensions

29 October 2017

Yining Wang

S. Du

Sivaraman Balakrishnan

Aarti Singh

ArXiv PDF HTML

Papers citing "Stochastic Zeroth-order Optimization in High Dimensions"

23 / 23 papers shown

Title
Gradient-Free Method for Heavily Constrained Nonconvex Optimization Wanli Shi Hongchang Gao Bin Gu 21 5 0 31 Aug 2024
CONGO: Compressive Online Gradient Optimization Jeremy Carleton Prathik Vijaykumar Divyanshu Saxena D. Narasimha Srinivas Shakkottai Aditya Akella 49 0 0 08 Jul 2024
Gradient Compressed Sensing: A Query-Efficient Gradient Estimator for High-Dimensional Zeroth-Order Optimization Ruizhong Qiu Hanghang Tong 44 3 0 27 May 2024
Fine-Tuning Language Models with Just Forward Passes Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 43 180 0 27 May 2023
Gradient-Free Textual Inversion Zhengcong Fei Mingyuan Fan Junshi Huang DiffM 38 31 0 12 Apr 2023
Reward Learning as Doubly Nonparametric Bandits: Optimal Design and Scaling Laws Kush S. Bhatia Wenshuo Guo Jacob Steinhardt 27 0 0 23 Feb 2023
Step by Step Loss Goes Very Far: Multi-Step Quantization for Adversarial Text Attacks Piotr Gaiñski Klaudia Bałazy 27 6 0 10 Feb 2023
Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic Optimization Le‐Yu Chen Jing Xu Luo Luo 33 15 0 16 Jan 2023
Adaptive Stochastic Optimisation of Nonconvex Composite Objectives Weijia Shao F. Sivrikaya S. Albayrak 21 0 0 21 Nov 2022
Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization Tianyi Lin Zeyu Zheng Michael I. Jordan 62 52 0 12 Sep 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization Quan-Wu Xiao Qing Ling Tianyi Chen 46 0 0 14 Jun 2022
Curvature-Aware Derivative-Free Optimization Bumsu Kim HanQin Cai Daniel McKenzie W. Yin ODL 35 10 0 27 Sep 2021
A Zeroth-Order Block Coordinate Descent Algorithm for Huge-Scale Black-Box Optimization HanQin Cai Y. Lou Daniel McKenzie W. Yin 34 41 0 21 Feb 2021
Data-Free Model Extraction Jean-Baptiste Truong Pratyush Maini R. Walls Nicolas Papernot MIACV 15 181 0 30 Nov 2020
Gradient-Based Empirical Risk Minimization using Local Polynomial Regression Ali Jadbabaie A. Makur Devavrat Shah 33 6 0 04 Nov 2020
A One-bit, Comparison-Based Gradient Estimator HanQin Cai Daniel McKenzie W. Yin Zhenliang Zhang 38 17 0 06 Oct 2020
A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning Sijia Liu Pin-Yu Chen B. Kailkhura Gaoyuan Zhang A. Hero III P. Varshney 26 224 0 11 Jun 2020
Spanning Attack: Reinforce Black-box Attacks with Unlabeled Data Lu Wang Huan Zhang Jinfeng Yi Cho-Jui Hsieh Yuan Jiang AAML 35 12 0 11 May 2020
Zeroth-Order Regularized Optimization (ZORO): Approximately Sparse Gradients and Adaptive Sampling HanQin Cai Daniel McKenzie W. Yin Zhenliang Zhang 63 49 0 29 Mar 2020
Zeroth-order Nonconvex Stochastic Optimization: Handling Constraints, High-Dimensionality and Saddle-Points Krishnakumar Balasubramanian Saeed Ghadimi ODL 22 100 0 17 Sep 2018
Stochastic Zeroth-order Optimization via Variance Reduction method L. Liu Minhao Cheng Cho-Jui Hsieh Dacheng Tao 24 19 0 30 May 2018
AutoZOOM: Autoencoder-based Zeroth Order Optimization Method for Attacking Black-box Neural Networks Chun-Chen Tu Pai-Shun Ting Pin-Yu Chen Sijia Liu Huan Zhang Jinfeng Yi Cho-Jui Hsieh Shin-Ming Cheng MLAU AAML 26 395 0 30 May 2018
Kernel-based methods for bandit convex optimization Sébastien Bubeck Ronen Eldan Y. Lee 84 164 0 11 Jul 2016