SGDR: Stochastic Gradient Descent with Warm Restarts

13 August 2016

Papers citing "SGDR: Stochastic Gradient Descent with Warm Restarts"

30 / 4,280 papers shown

Title
Don't Decay the Learning Rate, Increase the Batch Size Samuel L. Smith Pieter-Jan Kindermans Chris Ying Quoc V. Le ODL 36 982 0 01 Nov 2017
Learning to solve inverse problems using Wasserstein loss J. Adler Axel Ringh Ozan Oktem Johan Karlsson 28 37 0 30 Oct 2017
Multi-level Residual Networks from Dynamical Systems View B. Chang Lili Meng E. Haber Frederick Tung David Begert 43 170 0 27 Oct 2017
End-to-End Optimized Speech Coding with Deep Neural Networks Srihari Kankanahalli MQ 18 67 0 25 Oct 2017
On the Capacity of Face Representation Sixue Gong Vishnu Boddeti Anil K. Jain CVBM 18 14 0 29 Sep 2017
Neural Optimizer Search with Reinforcement Learning Irwan Bello Barret Zoph Vijay Vasudevan Quoc V. Le ODL 29 383 0 21 Sep 2017
Online Learning of a Memory for Learning Rates Franziska Meier Daniel Kappler S. Schaal 19 21 0 20 Sep 2017
Coupled Ensembles of Neural Networks Anuvabh Dutt D. Pellerin Georges Quénot OOD 13 35 0 18 Sep 2017
Super-Convergence: Very Fast Training of Neural Networks Using Large Learning Rates L. Smith Nicholay Topin AI4CE 48 519 0 23 Aug 2017
SMASH: One-Shot Model Architecture Search through HyperNetworks Andrew Brock Theodore Lim J. Ritchie Nick Weston 34 761 0 17 Aug 2017
On the convergence properties of a $K$ -step averaging stochastic gradient descent algorithm for nonconvex optimization Fan Zhou Guojing Cong 46 233 0 03 Aug 2017
Analysis and Optimization of Convolutional Neural Network Architectures Martin Thoma 30 72 0 31 Jul 2017
A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets P. Chrabaszcz I. Loshchilov Frank Hutter SSeg OOD 53 635 0 27 Jul 2017
Learning Transferable Architectures for Scalable Image Recognition Barret Zoph Vijay Vasudevan Jonathon Shlens Quoc V. Le 98 5,557 0 21 Jul 2017
Learned Primal-dual Reconstruction J. Adler Ozan Oktem MedIm 26 747 0 20 Jul 2017
Optimization Beyond the Convolution: Generalizing Spatial Relations with End-to-End Metric Learning P. Jund Andreas Eitel N. Abdo Wolfram Burgard 3DPC 24 19 0 04 Jul 2017
Parle: parallelizing stochastic gradient descent Pratik Chaudhari Carlo Baldassi R. Zecchina Stefano Soatto Ameet Talwalkar Adam M. Oberman ODL FedML 37 21 0 03 Jul 2017
FreezeOut: Accelerate Training by Progressively Freezing Layers Andrew Brock Theodore Lim J. Ritchie Nick Weston 25 123 0 15 Jun 2017
Shake-Shake regularization Xavier Gastaldi 3DPC BDL OOD 36 380 0 21 May 2017
Building effective deep neural network architectures one feature at a time Martin Mundt Tobias Weis K. Konda Visvanathan Ramesh 27 1 0 18 May 2017
Snapshot Ensembles: Train 1, get M for free Gao Huang Yixuan Li Geoff Pleiss Zhuang Liu J. Hopcroft Kilian Q. Weinberger OOD FedML UQCV 68 935 0 01 Apr 2017
Building a Regular Decision Boundary with Deep Networks Edouard Oyallon 16 29 0 06 Mar 2017
An Empirical Study of Language CNN for Image Captioning Jiuxiang Gu G. Wang Jianfei Cai Tsuhan Chen 31 132 0 21 Dec 2016
Deep Convolutional Neural Networks with Merge-and-Run Mappings Liming Zhao Jingdong Wang Xi Li Zhuowen Tu Yueting Zhuang MoMe 38 68 0 23 Nov 2016
A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks Dan Hendrycks Kevin Gimpel UQCV 23 3,382 0 07 Oct 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 108 4,890 0 27 Jun 2016
Deep Q-Networks for Accelerating the Training of Deep Neural Networks Jie Fu AI4CE 46 11 0 05 Jun 2016
Recent Advances in Convolutional Neural Networks Jiuxiang Gu Zhenhua Wang Jason Kuen Lianyang Ma Amir Shahroudy ... Xingxing Wang Li Wang Gang Wang Jianfei Cai Tsuhan Chen 37 5,150 0 22 Dec 2015
Cyclical Learning Rates for Training Neural Networks L. Smith ODL 41 2,502 0 03 Jun 2015
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 186 1,186 0 30 Nov 2014