A Robust Adaptive Stochastic Gradient Method for Deep Learning

A Robust Adaptive Stochastic Gradient Method for Deep Learning

2 March 2017

Çağlar Gülçehre

Jose M. R. Sotelo

Marcin Moczulski

ArXiv (abs)PDF HTML

Papers citing "A Robust Adaptive Stochastic Gradient Method for Deep Learning"

10 / 10 papers shown

Title
Beyond adaptive gradient: Fast-Controlled Minibatch Algorithm for large-scale optimization Corrado Coppola Lorenzo Papa Irene Amerini L. Palagi ODL 111 0 0 24 Nov 2024
On Unsupervised Image-to-image translation and GAN stability BahaaEddin AlAila Zahra Jandaghi Abolfazl Farahani M. Al-Saad GAN 43 1 0 18 Oct 2023
Impact of Learning Rate on Noise Resistant Property of Deep Learning Models Omobayode Fagbohungbe Lijun Qian 45 3 0 08 May 2022
AdaTerm: Adaptive T-Distribution Estimated Robust Moments for Noise-Robust Stochastic Gradient Optimization Wendyam Eric Lionel Ilboudo Taisuke Kobayashi Takamitsu Matsubara 85 13 0 18 Jan 2022
AWEU-Net: An Attention-Aware Weight Excitation U-Net for Lung Nodule Segmentation Syeda Furruka Banu Md. Mostafa Kamal Sarker M. Abdel-Nasser D. Puig Hatem A. Rashwan 46 23 0 11 Oct 2021
TAdam: A Robust Stochastic Gradient Optimizer Wendyam Eric Lionel Ilboudo Taisuke Kobayashi Kenji Sugimoto ODL 66 12 0 29 Feb 2020
Empirical study towards understanding line search approximations for training neural networks Younghwan Chae D. Wilke 105 11 0 15 Sep 2019
MACNet: Multi-scale Atrous Convolution Networks for Food Places Classification in Egocentric Photo-streams Md. Mostafa Kamal Sarker Hatem A. Rashwan Estefanía Talavera Syeda Furruka Banu Petia Radeva D. Puig EgoV 98 12 0 29 Aug 2018
Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates L. Smith Nicholay Topin AI4CE 106 520 0 23 Aug 2017
Curriculum Dropout Pietro Morerio Jacopo Cavazza Riccardo Volpi René Vidal Vittorio Murino ODL 140 105 0 18 Mar 2017