Query Complexity of Derivative-Free Optimization

11 September 2012

Benjamin Recht

Papers citing "Query Complexity of Derivative-Free Optimization"

31 / 31 papers shown

Title
Review, Refine, Repeat: Understanding Iterative Decoding of AI Agents with Dynamic Evaluation and Selection Souradip Chakraborty Mohammadreza Pourreza Ruoxi Sun Yiwen Song Nino Scherrer ... Furong Huang Amrit Singh Bedi Ahmad Beirami Hamid Palangi Tomas Pfister 60 0 0 02 Apr 2025
Gradient-free stochastic optimization for additive models A. Akhavan Alexandre B. Tsybakov 46 0 0 03 Mar 2025
Comparisons Are All You Need for Optimizing Smooth Functions Chenyi Zhang Tongyang Li AAML 42 2 0 19 May 2024
Dynamic Anisotropic Smoothing for Noisy Derivative-Free Optimization S. Reifenstein T. Leleu Yoshihisa Yamamoto 55 1 0 02 May 2024
Test-Time Model Adaptation with Only Forward Passes Shuaicheng Niu Chunyan Miao Guohao Chen Pengcheng Wu Peilin Zhao TTA 53 20 0 02 Apr 2024
Second-Order Fine-Tuning without Pain for LLMs:A Hessian Informed Zeroth-Order Optimizer Yanjun Zhao Sizhe Dang Haishan Ye Guang Dai Yi Qian Ivor W.Tsang 73 8 0 23 Feb 2024
Fine-Tuning Language Models with Just Forward Passes Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 48 180 0 27 May 2023
Adaptive Stochastic Optimisation of Nonconvex Composite Objectives Weijia Shao F. Sivrikaya S. Albayrak 21 0 0 21 Nov 2022
Zero-Order One-Point Estimate with Distributed Stochastic Gradient-Tracking Technique Elissa Mhanna Mohamad Assaad 38 4 0 11 Oct 2022
Dueling Convex Optimization with General Preferences Aadirupa Saha Tomer Koren Yishay Mansour 35 3 0 27 Sep 2022
Best Arm Identification with Safety Constraints Zhenlin Wang Andrew Wagenmaker Kevin G. Jamieson 27 21 0 23 Nov 2021
Curvature-Aware Derivative-Free Optimization Bumsu Kim HanQin Cai Daniel McKenzie W. Yin ODL 40 10 0 27 Sep 2021
Optimal Query Complexity of Secure Stochastic Convex Optimization Wei Tang Chien-Ju Ho Yang Liu 30 4 0 05 Apr 2021
A Zeroth-Order Block Coordinate Descent Algorithm for Huge-Scale Black-Box Optimization HanQin Cai Y. Lou Daniel McKenzie W. Yin 36 41 0 21 Feb 2021
A One-bit, Comparison-Based Gradient Estimator HanQin Cai Daniel McKenzie W. Yin Zhenliang Zhang 42 17 0 06 Oct 2020
Zeroth-Order Regularized Optimization (ZORO): Approximately Sparse Gradients and Adaptive Sampling HanQin Cai Daniel McKenzie W. Yin Zhenliang Zhang 68 49 0 29 Mar 2020
The Gap Between Model-Based and Model-Free Methods on the Linear Quadratic Regulator: An Asymptotic Viewpoint Stephen Tu Benjamin Recht OffRL 33 150 0 09 Dec 2018
Zeroth-order Nonconvex Stochastic Optimization: Handling Constraints, High-Dimensionality and Saddle-Points Krishnakumar Balasubramanian Saeed Ghadimi ODL 24 100 0 17 Sep 2018
Structured Evolution with Compact Architectures for Scalable Policy Optimization K. Choromanski Mark Rowland Vikas Sindhwani Richard Turner Adrian Weller 27 147 0 06 Apr 2018
Tight Query Complexity Lower Bounds for PCA via Finite Sample Deformed Wigner Law Max Simchowitz A. Alaoui Benjamin Recht 35 39 0 04 Apr 2018
Regret Analysis for Continuous Dueling Bandit Wataru Kumagai 34 27 0 21 Nov 2017
Stochastic Zeroth-order Optimization in High Dimensions Yining Wang S. Du Sivaraman Balakrishnan Aarti Singh 29 105 0 29 Oct 2017
$Non-stationary Stochastic Optimization under $L_{p,q}$-Variation Measures$ Non-stationary Stochastic Optimization under $L_{p,q}$ -Variation Measures Xi Chen Yining Wang Yu Wang 24 12 0 09 Aug 2017
On the Gap Between Strict-Saddles and True Convexity: An Omega(log d) Lower Bound for Eigenvector Approximation Max Simchowitz A. Alaoui Benjamin Recht 23 13 0 14 Apr 2017
Fast Rates for Bandit Optimization with Upper-Confidence Frank-Wolfe Quentin Berthet Vianney Perchet 40 31 0 22 Feb 2017
Risk minimization by median-of-means tournaments Gabor Lugosi S. Mendelson 27 130 0 02 Aug 2016
Highly-Smooth Zero-th Order Online Optimization Vianney Perchet Francis R. Bach Vianney Perchet 22 83 0 26 May 2016
Unimodal Bandits without Smoothness Richard Combes Alexandre Proutiere 41 18 0 28 Jun 2014
On Zeroth-Order Stochastic Convex Optimization via Random Walks Tengyuan Liang Hariharan Narayanan Alexander Rakhlin 39 24 0 11 Feb 2014
Relative Upper Confidence Bound for the K-Armed Dueling Bandit Problem M. Zoghi Shimon Whiteson Rémi Munos Maarten de Rijke 49 140 0 12 Dec 2013
On the Complexity of Bandit and Derivative-Free Stochastic Convex Optimization Ohad Shamir 49 190 0 11 Sep 2012