Prodigy: An Expeditiously Adaptive Parameter-Free Learner

v1v2v3v4 (latest)

Prodigy: An Expeditiously Adaptive Parameter-Free Learner

9 June 2023

Konstantin Mishchenko

ArXiv (abs)PDF HTML

Papers citing "Prodigy: An Expeditiously Adaptive Parameter-Free Learner"

18 / 18 papers shown

Title
A Hessian-informed hyperparameter optimization for differential learning rate Shiyun Xu Zhiqi Bu Yiliang Zhang Ian Barnett 108 1 0 12 Jan 2025
MC-VTON: Minimal Control Virtual Try-On Diffusion Transformer Junsheng Luan Guangyuan Li Lei Zhao Wei Xing DiffM 85 3 0 07 Jan 2025
Unlearning as multi-task optimization: A normalized gradient difference approach with an adaptive learning rate Zhiqi Bu Xiaomeng Jin Bhanukiran Vinzamuri Anil Ramakrishna Kai-Wei Chang Volkan Cevher Mingyi Hong MU 155 14 0 29 Oct 2024
Remove that Square Root: A New Efficient Scale-Invariant Version of AdaGrad Sayantan Choudhury N. Tupitsa Nicolas Loizou Samuel Horváth Martin Takáč Eduard A. Gorbunov 105 1 0 05 Mar 2024
DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule Maor Ivgi Oliver Hinder Y. Carmon ODL 120 66 0 08 Feb 2023
Making SGD Parameter-Free Y. Carmon Oliver Hinder 94 47 0 04 May 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 301 30,152 0 01 Mar 2022
Stochastic Polyak Stepsize with a Moving Target Robert Mansel Gower Aaron Defazio Michael G. Rabbat 73 17 0 22 Jun 2021
Adaptivity without Compromise: A Momentumized, Adaptive, Dual Averaged Gradient Method for Stochastic Optimization Aaron Defazio Samy Jelassi ODL 51 68 0 26 Jan 2021
Stochastic Polyak Step-size for SGD: An Adaptive Learning Rate for Fast Convergence Nicolas Loizou Sharan Vaswani I. Laradji Simon Lacoste-Julien 88 188 0 24 Feb 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 283 6,307 0 10 Dec 2019
UniXGrad: A Universal, Adaptive Algorithm with Optimal Guarantees for Constrained Optimization Ali Kavis Kfir Y. Levy Francis R. Bach Volkan Cevher ODL 90 60 0 30 Oct 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 703 24,572 0 26 Jul 2019
Deep Learning Recommendation Model for Personalization and Recommendation Systems Maxim Naumov Dheevatsa Mudigere Hao-Jun Michael Shi Jianyu Huang Narayanan Sundaraman ... Wenlin Chen Vijay Rao Bill Jia Liang Xiong M. Smelyanskiy 93 741 0 31 May 2019
fastMRI: An Open Dataset and Benchmarks for Accelerated MRI Jure Zbontar Florian Knoll Anuroop Sriram Tullie Murrell Zhengnan Huang ... Erich Owens C. L. Zitnick M. Recht D. Sodickson Yvonne W. Lui OOD 75 850 0 21 Nov 2018
Online Adaptive Methods, Universality and Acceleration Kfir Y. Levy A. Yurtsever Volkan Cevher ODL 73 93 0 08 Sep 2018
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 492 5,385 0 05 Nov 2016
Less Regret via Online Conditioning Matthew J. Streeter H. B. McMahan ODL 101 66 0 25 Feb 2010

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.