NAG-GS: Semi-Implicit, Accelerated and Robust Stochastic Optimizer

NAG-GS: Semi-Implicit, Accelerated and Robust Stochastic Optimizer

29 September 2022

Valentin Leplat

Aleksandr Katrutsa

Daniel Bershatsky

Papers citing "NAG-GS: Semi-Implicit, Accelerated and Robust Stochastic Optimizer"

11 / 11 papers shown

Title
AdaFisher: Adaptive Second Order Optimization via Fisher Information Damien Martins Gomes Yanlei Zhang Eugene Belilovsky Guy Wolf Mahdi S. Hosseini ODL 134 2 0 26 May 2024
Visual Transformers: Token-based Image Representation and Processing for Computer Vision Bichen Wu Chenfeng Xu Xiaoliang Dai Alvin Wan Peizhao Zhang Zhicheng Yan Masayoshi Tomizuka Joseph E. Gonzalez Kurt Keutzer Peter Vajda ViT 94 558 0 05 Jun 2020
SVGD as a kernelized Wasserstein gradient flow of the chi-squared divergence Sinho Chewi Thibaut Le Gouic Chen Lu Tyler Maunu Philippe Rigollet 83 69 0 03 Jun 2020
Analysis of Stochastic Gradient Descent in Continuous Time J. Latz 51 39 0 15 Apr 2020
Optuna: A Next-generation Hyperparameter Optimization Framework Takuya Akiba Shotaro Sano Toshihiko Yanase Takeru Ohta Masanori Koyama 602 5,769 0 25 Jul 2019
A Dynamical Systems Perspective on Nesterov Acceleration Michael Muehlebach Michael I. Jordan 61 121 0 17 May 2019
Acceleration via Symplectic Discretization of High-Resolution Differential Equations Bin Shi S. Du Weijie J. Su Michael I. Jordan 43 121 0 11 Feb 2019
Understanding the Acceleration Phenomenon via High-Resolution Differential Equations Bin Shi S. Du Michael I. Jordan Weijie J. Su 51 259 0 21 Oct 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 989 7,152 0 20 Apr 2018
Practical Gauss-Newton Optimisation for Deep Learning Aleksandar Botev H. Ritter David Barber ODL 49 231 0 12 Jun 2017
ADADELTA: An Adaptive Learning Rate Method Matthew D. Zeiler ODL 132 6,623 0 22 Dec 2012