Snapshot Ensembles: Train 1, get M for free

1 April 2017

Gao Huang

Papers citing "Snapshot Ensembles: Train 1, get M for free"

45 / 445 papers shown

Title
Don't Use Large Mini-Batches, Use Local SGD Tao R. Lin Sebastian U. Stich Kumar Kshitij Patel Martin Jaggi 133 432 0 22 Aug 2018
Testing the Efficient Network TRaining (ENTR) Hypothesis: initially reducing training image size makes Convolutional Neural Network training for image recognition tasks more efficient T. Wanger Peter Frohn 25 3 0 30 Jul 2018
A Deep Learning Driven Active Framework for Segmentation of Large 3D Shape Collections D. George Xianghua Xie Yu-kun Lai G. Tam 3DV 3DPC 39 7 0 17 Jul 2018
TherML: Thermodynamics of Machine Learning Alexander A. Alemi Ian S. Fischer DRL AI4CE 58 29 0 11 Jul 2018
Big-Little Net: An Efficient Multi-Scale Feature Representation for Visual and Speech Recognition Chun-Fu Chen Quanfu Fan Neil Rohit Mallinar Tom Sercu Rogerio Feris 78 98 0 10 Jul 2018
Using Mode Connectivity for Loss Landscape Analysis Akhilesh Deepak Gotmare N. Keskar Caiming Xiong R. Socher 71 28 0 18 Jun 2018
Learning Visual Knowledge Memory Networks for Visual Question Answering Zhou Su Chen Zhu Yinpeng Dong Dongqi Cai Yurong Chen Jianguo Li 96 62 0 13 Jun 2018
Knowledge Distillation by On-the-Fly Native Ensemble Xu Lan Xiatian Zhu S. Gong 306 483 0 12 Jun 2018
Stochastic Gradient Descent with Hyperbolic-Tangent Decay on Classification B. Hsueh Wei Li I-Chen Wu 37 23 0 05 Jun 2018
Short-term Load Forecasting with Deep Residual Networks Kunjin Chen Kunlong Chen Qin Wang Ziyu He Jun Hu Jinliang He 73 474 0 30 May 2018
Bias-Reduced Uncertainty Estimation for Deep Neural Classifiers Yonatan Geifman Guy Uziel Ran El-Yaniv UQCV 73 142 0 21 May 2018
Knowledge Distillation in Generations: More Tolerant Teachers Educate Better Students Chenglin Yang Lingxi Xie Siyuan Qiao Alan Yuille 88 137 0 15 May 2018
Born Again Neural Networks Tommaso Furlanello Zachary Chase Lipton Michael Tschannen Laurent Itti Anima Anandkumar 140 1,038 0 12 May 2018
Strong Baselines for Neural Semi-supervised Learning under Domain Shift Sebastian Ruder Barbara Plank 66 172 0 25 Apr 2018
Recognizing Birds from Sound - The 2018 BirdCLEF Baseline System Stefan Kahl Thomas Wilhelm-Stein Holger Klinck Danny Kowerko Maximilian Eibl 37 28 0 19 Apr 2018
IGCV $2$ : Interleaved Structured Sparse Convolutional Neural Networks Guotian Xie Jingdong Wang Ting Zhang Jianhuang Lai Richang Hong Guo-Jun Qi 120 106 0 17 Apr 2018
Multi-Scale Spatially-Asymmetric Recalibration for Image Classification Yan Wang Lingxi Xie Siyuan Qiao Ya Zhang Wenjun Zhang Alan Yuille 77 13 0 03 Apr 2018
Parallel Grid Pooling for Data Augmentation Akito Takeki Daiki Ikami Go Irie Kiyoharu Aizawa 66 7 0 30 Mar 2018
Fusion of an Ensemble of Augmented Image Detectors for Robust Object Detection Pan Wei J. Ball Derek T. Anderson 52 28 0 17 Mar 2018
Learning Sparse Structured Ensembles with SG-MCMC and Network Pruning Yichi Zhang Zhijian Ou 64 0 0 01 Mar 2018
Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs T. Garipov Pavel Izmailov Dmitrii Podoprikhin Dmitry Vetrov A. Wilson UQCV 172 759 0 27 Feb 2018
Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flow Eddy Ilg Özgün Çiçek Silvio Galesso Aaron Klein Osama Makansi Frank Hutter Thomas Brox UQCV 106 223 0 20 Feb 2018
An Alternative View: When Does SGD Escape Local Minima? Robert D. Kleinberg Yuanzhi Li Yang Yuan MLT 103 317 0 17 Feb 2018
ViZDoom: DRQN with Prioritized Experience Replay, Double-Q Learning, & Snapshot Ensembling Christopher Schulze Marcus Schulze 115 32 0 03 Jan 2018
The Effectiveness of Data Augmentation for Detection of Gastrointestinal Diseases from Endoscopical Images Andrea Asperti Claudio Mastronardo 69 70 0 11 Dec 2017
Neural Text Generation: A Practical Guide Ziang Xie 62 46 0 27 Nov 2017
Gradually Updated Neural Networks for Large-Scale Image Recognition Siyuan Qiao Zhishuai Zhang Wei Shen Bo Wang Alan Yuille 92 4 0 25 Nov 2017
CondenseNet: An Efficient DenseNet using Learned Group Convolutions Gao Huang Shichen Liu Laurens van der Maaten Kilian Q. Weinberger 146 800 0 25 Nov 2017
Decoupled Weight Decay Regularization I. Loshchilov Frank Hutter OffRL 175 2,166 0 14 Nov 2017
Simple And Efficient Architecture Search for Convolutional Neural Networks T. Elsken J. H. Metzen Frank Hutter 95 232 0 13 Nov 2017
Scale out for large minibatch SGD: Residual network training on ImageNet-1K with improved accuracy and reduced time to train V. Codreanu Damian Podareanu V. Saletore 72 55 0 12 Nov 2017
AdaDNNs: Adaptive Ensemble of Deep Neural Networks for Scene Text Recognition Chun Yang Xu-Cheng Yin Zejun Li Jianwei Wu Chunchao Guo Hongfa Wang Lei Xiao 44 10 0 10 Oct 2017
Coupled Ensembles of Neural Networks Anuvabh Dutt D. Pellerin Georges Quénot OOD 74 35 0 18 Sep 2017
Wide and deep volumetric residual networks for volumetric image classification Varun Arvind A. Costa Marcus A. Badgeley Samuel K. Cho Eric Oermann 3DPC MedIm 69 15 0 18 Sep 2017
LSTM Fully Convolutional Networks for Time Series Classification Fazle Karim Somshubra Majumdar H. Darabi Shun Chen AIMat AI4TS 130 1,115 0 08 Sep 2017
Improved ArtGAN for Conditional Synthesis of Natural Image and Artwork W. Tan Chee Seng Chan H. Aguirre Kiyoshi Tanaka GAN 23 2 0 31 Aug 2017
Automatic Segmentation and Disease Classification Using Cardiac Cine MR Images J. Wolterink T. Leiner M. Viergever Ivana Isgum 84 112 0 03 Aug 2017
Mini-batch Tempered MCMC Dangna Li W. Wong 113 6 0 31 Jul 2017
Memory-Efficient Implementation of DenseNets Geoff Pleiss Danlu Chen Gao Huang Tongcheng Li Laurens van der Maaten Kilian Q. Weinberger 105 159 0 21 Jul 2017
Parle: parallelizing stochastic gradient descent Pratik Chaudhari Carlo Baldassi R. Zecchina Stefano Soatto Ameet Talwalkar Adam M. Oberman ODL FedML 85 21 0 03 Jul 2017
Efficient variational Bayesian neural network ensembles for outlier detection Nick Pawlowski Miguel Jaques Ben Glocker BDL UQCV 57 13 0 20 Mar 2017
Stability of Topic Modeling via Matrix Factorization Mark Belford Brian Mac Namee Derek Greene 71 86 0 23 Feb 2017
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 1.1K 5,863 0 05 Dec 2016
Temporal Ensembling for Semi-Supervised Learning S. Laine Timo Aila UQCV 255 2,572 0 07 Oct 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 388 8,216 0 13 Aug 2016