A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning

11 June 2020

Papers citing "A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning"

34 / 34 papers shown

Title
Stochastic Subspace Descent Accelerated via Bi-fidelity Line Search Nuojin Cheng Alireza Doostan Stephen Becker 39 0 0 30 Apr 2025
Computational Safety for Generative AI: A Signal Processing Perspective Pin-Yu Chen 76 1 0 18 Feb 2025
MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models Zhen Zhang Y. Yang Kai Zhen Nathan Susanj Athanasios Mouchtaris Siegfried Kunzmann Zheng Zhang 54 0 0 17 Feb 2025
Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks Yequan Zhao Xinling Yu Xian Xiao Zhengzhang Chen Z. Liu G. Kurczveil R. Beausoleil S. Liu Z. Zhang 56 0 0 17 Feb 2025
Explainable and Class-Revealing Signal Feature Extraction via Scattering Transform and Constrained Zeroth-Order Optimization N. Saito David S. Weber 47 0 0 08 Feb 2025
Single Point-Based Distributed Zeroth-Order Optimization with a Non-Convex Stochastic Objective Function Elissa Mhanna Mohamad Assaad 51 4 0 08 Oct 2024
Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization Zhe Li Bicheng Ying Zidong Liu Haibo Yang Haibo Yang FedML 59 3 0 24 May 2024
End-to-End Mesh Optimization of a Hybrid Deep Learning Black-Box PDE Solver Shaocong Ma James Diffenderfer B. Kailkhura Yi Zhou AI4CE 40 0 0 17 Apr 2024
Private Fine-tuning of Large Language Models with Zeroth-order Optimization Xinyu Tang Ashwinee Panda Milad Nasr Saeed Mahloujifar Prateek Mittal 44 18 0 09 Jan 2024
Decentralized Gradient-Free Methods for Stochastic Non-Smooth Non-Convex Optimization Zhenwei Lin Jingfan Xia Qi Deng Luo Luo 31 3 0 18 Oct 2023
Learning to Learn from APIs: Black-Box Data-Free Meta-Learning Zixuan Hu Li Shen Zhenyi Wang Baoyuan Wu Chun Yuan Dacheng Tao 47 7 0 28 May 2023
Certified Zeroth-order Black-Box Defense with Robust UNet Denoiser Astha Verma A. Subramanyam Siddhesh Bangar Naman Lal R. Shah Shiníchi Satoh 34 4 0 13 Apr 2023
Overload: Latency Attacks on Object Detection for Edge Devices Erh-Chung Chen Pin-Yu Chen I-Hsin Chung Che-Rung Lee AAML 36 12 0 11 Apr 2023
Step by Step Loss Goes Very Far: Multi-Step Quantization for Adversarial Text Attacks Piotr Gaiñski Klaudia Bałazy 19 6 0 10 Feb 2023
Energy Efficient Training of SNN using Local Zeroth Order Method B. Mukhoty V. Bojkovic William de Vazelhes Giulia De Masi Huan Xiong Bin Gu 24 0 0 02 Feb 2023
Does Federated Learning Really Need Backpropagation? H. Feng Tianyu Pang Chao Du Wei Chen Shuicheng Yan Min-Bin Lin FedML 34 10 0 28 Jan 2023
Distributed Optimization Methods for Multi-Robot Systems: Part II -- A Survey O. Shorinwa Trevor Halsted Javier Yu Mac Schwager 16 18 0 26 Jan 2023
A survey and taxonomy of loss functions in machine learning Lorenzo Ciampiconi A. Elwood Marco Leonardi A. Mohamed A. Rozza MU FaML 9 25 0 13 Jan 2023
Learning-Assisted Algorithm Unrolling for Online Optimization with Budget Constraints Jianyi Yang Shaolei Ren 20 2 0 03 Dec 2022
A Hypergraph-Based Machine Learning Ensemble Network Intrusion Detection System Zongming Lin Thomas Pike Mark M. Bailey Nathaniel D. Bastian OOD 13 2 0 08 Nov 2022
An Empirical Evaluation of Zeroth-Order Optimization Methods on AI-driven Molecule Optimization Elvin Lo Pin-Yu Chen 34 0 0 27 Oct 2022
Learning with Local Gradients at the Edge M. Lomnitz Z. Daniels David C. Zhang M. Piacentino 28 1 0 17 Aug 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization Quan-Wu Xiao Qing Ling Tianyi Chen 35 0 0 14 Jun 2022
Expert-Calibrated Learning for Online Optimization with Switching Costs Pengfei Li Jianyi Yang Shaolei Ren 24 11 0 18 Apr 2022
How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspective Yimeng Zhang Yuguang Yao Jinghan Jia Jinfeng Yi Min-Fong Hong Shiyu Chang Sijia Liu AAML 18 33 0 27 Mar 2022
Communication-Efficient Stochastic Zeroth-Order Optimization for Federated Learning Wenzhi Fang Ziyi Yu Yuning Jiang Yuanming Shi Colin N. Jones Yong Zhou FedML 78 56 0 24 Jan 2022
Gradient and Projection Free Distributed Online Min-Max Resource Optimization Jingrong Wang Ben Liang 18 3 0 07 Dec 2021
Link Scheduling using Graph Neural Networks Zhongyuan Zhao Gunjan Verma Chirag R. Rao A. Swami Santiago Segarra GNN 24 33 0 12 Sep 2021
Voice2Series: Reprogramming Acoustic Models for Time Series Classification Chao-Han Huck Yang Yun-Yun Tsai Pin-Yu Chen AI4TS 26 122 0 17 Jun 2021
Data-Free Model Extraction Jean-Baptiste Truong Pratyush Maini R. Walls Nicolas Papernot MIACV 15 181 0 30 Nov 2020
Optimizing Molecules using Efficient Queries from Property Evaluations Samuel C. Hoffman Vijil Chenthamarakshan Kahini Wadhawan Pin-Yu Chen Payel Das 37 68 0 03 Nov 2020
A One-bit, Comparison-Based Gradient Estimator HanQin Cai Daniel McKenzie W. Yin Zhenliang Zhang 17 17 0 06 Oct 2020
Sign-OPT: A Query-Efficient Hard-label Adversarial Attack Minhao Cheng Simranjit Singh Patrick H. Chen Pin-Yu Chen Sijia Liu Cho-Jui Hsieh AAML 124 219 0 24 Sep 2019
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 332 11,684 0 09 Mar 2017