Drop-Activation: Implicit Parameter Reduction and Harmonic
Regularization

v1v2v3v4v5 (latest)

Drop-Activation: Implicit Parameter Reduction and Harmonic Regularization

14 November 2018

ArXiv (abs)PDF HTML Github (10★)

Papers citing "Drop-Activation: Implicit Parameter Reduction and Harmonic Regularization"

12 / 12 papers shown

Title
AutoAugment: Learning Augmentation Policies from Data E. D. Cubuk Barret Zoph Dandelion Mané Vijay Vasudevan Quoc V. Le 135 1,775 0 24 May 2018
Understanding the Disharmony between Dropout and Batch Normalization by Variance Shift Xiang Li Shuo Chen Xiaolin Hu Jian Yang 72 309 0 16 Jan 2018
Improved Regularization of Convolutional Neural Networks with Cutout Terrance Devries Graham W. Taylor 129 3,774 0 15 Aug 2017
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 522 10,347 0 16 Nov 2016
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations David M. Krueger Tegan Maharaj János Kramár Mohammad Pezeshki Nicolas Ballas Nan Rosemary Ke Anirudh Goyal Yoshua Bengio Aaron Courville C. Pal 84 317 0 03 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 353 8,000 0 23 May 2016
Deep Networks with Stochastic Depth Gao Huang Yu Sun Zhuang Liu Daniel Sedra Kilian Q. Weinberger 215 2,361 0 30 Mar 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 354 10,196 0 16 Mar 2016
Empirical Evaluation of Rectified Activations in Convolutional Network Bing Xu Naiyan Wang Tianqi Chen Mu Li 142 2,913 0 05 May 2015
Visualizing and Understanding Convolutional Networks Matthew D. Zeiler Rob Fergus FAtt SSL 595 15,902 0 12 Nov 2013
Dropout Training as Adaptive Regularization Stefan Wager Sida I. Wang Percy Liang 129 600 0 04 Jul 2013
Stochastic Pooling for Regularization of Deep Convolutional Neural Networks Matthew D. Zeiler Rob Fergus 193 989 0 16 Jan 2013