Low-Variance Gradient Estimation in Unrolled Computation Graphs with
ES-Single

Low-Variance Gradient Estimation in Unrolled Computation Graphs with ES-Single

21 April 2023

Paul Vicol

Papers citing "Low-Variance Gradient Estimation in Unrolled Computation Graphs with ES-Single"

9 / 9 papers shown

Title
$μ$ LO: Compute-Efficient Meta-Generalization of Learned Optimizers Benjamin Thérien Charles-Étienne Joseph Boris Knyazev Edouard Oyallon Irina Rish Eugene Belilovsky AI4CE 40 1 0 31 May 2024
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark Yihua Zhang Pingzhi Li Junyuan Hong Jiaxiang Li Yimeng Zhang ... Wotao Yin Mingyi Hong Zhangyang Wang Sijia Liu Tianlong Chen 28 45 0 18 Feb 2024
Moco: A Learnable Meta Optimizer for Combinatorial Optimization Tim Dernedde Daniela Thyssens Soren Dittrich Maximilan Stubbemann Lars Schmidt-Thieme 59 5 0 07 Feb 2024
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training Aochuan Chen Yimeng Zhang Jinghan Jia James Diffenderfer Jiancheng Liu Konstantinos Parasyris Yihua Zhang Zheng-Wei Zhang B. Kailkhura Sijia Liu 30 43 0 03 Oct 2023
Variance-Reduced Gradient Estimation via Noise-Reuse in Online Evolution Strategies Oscar Li James Harrison Jascha Narain Sohl-Dickstein Virginia Smith Luke Metz 51 5 0 21 Apr 2023
PyPop7: A Pure-Python Library for Population-Based Black-Box Optimization Qiqi Duan Guochen Zhou Chang Shao Zhuowei Wang Mingyang Feng Yuwei Huang Yajing Tan Yijun Yang Qi Zhao Yuhui Shi 34 5 0 12 Dec 2022
Probabilistic Model-Agnostic Meta-Learning Chelsea Finn Kelvin Xu Sergey Levine BDL 176 666 0 07 Jun 2018
Forward and Reverse Gradient-Based Hyperparameter Optimization Luca Franceschi Michele Donini P. Frasconi Massimiliano Pontil 133 409 0 06 Mar 2017
Variational Optimization J. Staines David Barber DRL 65 4 0 18 Dec 2012