MLR-SNet: Transferable LR Schedules for Heterogeneous Tasks

29 July 2020

Papers citing "MLR-SNet: Transferable LR Schedules for Heterogeneous Tasks"

29 / 29 papers shown

Title
CMW-Net: Learning a Class-Aware Sample Weighting Mapping for Robust Deep Learning Jun Shu Xiang Yuan Deyu Meng Zongben Xu NoLa 55 34 0 11 Feb 2022
Learning Adaptive Loss for Robust Learning with Noisy Labels Jun Shu Qian Zhao Keyu Chen Zongben Xu Deyu Meng NoLa OOD 42 23 0 16 Feb 2020
Painless Stochastic Gradient: Interpolation, Line-Search, and Convergence Rates Sharan Vaswani Aaron Mishkin I. Laradji Mark Schmidt Gauthier Gidel Simon Lacoste-Julien ODL 79 209 0 24 May 2019
The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares Rong Ge Sham Kakade Rahul Kidambi Praneeth Netrapalli 85 154 0 29 Apr 2019
An Ensemble of Epoch-wise Empirical Bayes for Few-shot Learning Yaoyao Liu Bernt Schiele Qianru Sun BDL 94 128 0 17 Apr 2019
Adaptive Gradient Methods with Dynamic Bound of Learning Rate Liangchen Luo Yuanhao Xiong Yan Liu Xu Sun ODL 74 602 0 26 Feb 2019
Meta-Curvature Eunbyung Park Junier B. Oliva BDL 52 124 0 09 Feb 2019
Deep Frank-Wolfe For Neural Network Optimization Leonard Berrada Andrew Zisserman M. P. Kumar ODL 30 40 0 19 Nov 2018
Fast and Faster Convergence of SGD for Over-Parameterized Models and an Accelerated Perceptron Sharan Vaswani Francis R. Bach Mark Schmidt 75 298 0 16 Oct 2018
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design Ningning Ma Xiangyu Zhang Haitao Zheng Jian Sun 171 4,983 0 30 Jul 2018
Evolved Policy Gradients Rein Houthooft Richard Y. Chen Phillip Isola Bradly C. Stadie Filip Wolski Jonathan Ho Pieter Abbeel 88 227 0 13 Feb 2018
Three Factors Influencing Minima in SGD Stanislaw Jastrzebski Zachary Kenton Devansh Arpit Nicolas Ballas Asja Fischer Yoshua Bengio Amos Storkey 76 463 0 13 Nov 2017
Building machines that adapt and compute like brains Brenden M. Lake J. Tenenbaum AI4CE FedML NAI AILaw 317 887 0 11 Nov 2017
Meta-SGD: Learning to Learn Quickly for Few-Shot Learning Zhenguo Li Fengwei Zhou Fei Chen Hang Li 94 1,119 0 31 Jul 2017
Learning Transferable Architectures for Scalable Image Recognition Barret Zoph Vijay Vasudevan Jonathon Shlens Quoc V. Le 172 5,596 0 21 Jul 2017
The Marginal Value of Adaptive Gradient Methods in Machine Learning Ashia Wilson Rebecca Roelofs Mitchell Stern Nathan Srebro Benjamin Recht ODL 58 1,029 0 23 May 2017
Learned Optimizers that Scale and Generalize Olga Wichrowska Niru Maheswaranathan Matthew W. Hoffman Sergio Gomez Colmenarejo Misha Denil Nando de Freitas Jascha Narain Sohl-Dickstein AI4CE 54 283 0 14 Mar 2017
Online Learning Rate Adaptation with Hypergradient Descent A. G. Baydin R. Cornish David Martínez-Rubio Mark Schmidt Frank Wood ODL 71 247 0 14 Mar 2017
Learning Gradient Descent: Better Generalization and Longer Horizons Kaifeng Lyu Shunhua Jiang Jian Li 71 113 0 10 Mar 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 818 11,894 0 09 Mar 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 336 4,625 0 10 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 421 2,936 0 15 Sep 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 319 8,114 0 13 Aug 2016
Learning to learn by gradient descent by gradient descent Marcin Andrychowicz Misha Denil Sergio Gomez Colmenarejo Matthew W. Hoffman David Pfau Tom Schaul Brendan Shillingford Nando de Freitas 103 2,006 0 14 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 332 7,980 0 23 May 2016
ADADELTA: An Adaptive Learning Rate Method Matthew D. Zeiler ODL 143 6,626 0 22 Dec 2012
Practical recommendations for gradient-based training of deep architectures Yoshua Bengio 3DH ODL 191 2,197 0 24 Jun 2012
Practical Bayesian Optimization of Machine Learning Algorithms Jasper Snoek Hugo Larochelle Ryan P. Adams 351 7,934 0 13 Jun 2012
No More Pesky Learning Rates Tom Schaul Sixin Zhang Yann LeCun 135 478 0 06 Jun 2012