Approximated Orthonormal Normalisation in Training Neural Networks

21 November 2019

Papers citing "Approximated Orthonormal Normalisation in Training Neural Networks"

23 / 23 papers shown

Title
Orthogonal Deep Neural Networks Kui Jia Shuai Li Yuxin Wen Tongliang Liu Dacheng Tao 59 132 0 15 May 2019
On the Convergence of Adam and Beyond Sashank J. Reddi Satyen Kale Surinder Kumar 39 2,482 0 19 Apr 2019
Iterative Normalization: Beyond Standardization towards Efficient Whitening Lei Huang Yi Zhou Fan Zhu Li Liu Ling Shao 38 142 0 06 Apr 2019
Can We Gain More from Orthogonality Regularizations in Training Deep CNNs? Nitin Bansal Xiaohan Chen Zhangyang Wang OOD 56 188 0 22 Oct 2018
Decorrelated Batch Normalization Lei Huang Dawei Yang B. Lang Jia Deng 31 192 0 23 Apr 2018
Group Normalization Yuxin Wu Kaiming He 124 3,626 0 22 Mar 2018
Norm matters: efficient and accurate normalization schemes in deep networks Elad Hoffer Ron Banner Itay Golan Daniel Soudry OffRL 35 179 0 05 Mar 2018
Spectral Normalization for Generative Adversarial Networks Takeru Miyato Toshiki Kataoka Masanori Koyama Yuichi Yoshida ODL 127 4,421 0 16 Feb 2018
Self-Normalizing Neural Networks Günter Klambauer Thomas Unterthiner Andreas Mayr Sepp Hochreiter 207 2,496 0 08 Jun 2017
Spectral Norm Regularization for Improving the Generalizability of Deep Learning Yuichi Yoshida Takeru Miyato 71 328 0 31 May 2017
Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models Sergey Ioffe BDL 39 538 0 10 Feb 2017
Neural Photo Editing with Introspective Adversarial Networks Andrew Brock Theodore Lim J. Ritchie Nick Weston GAN 59 457 0 22 Sep 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 600 36,599 0 25 Aug 2016
Instance Normalization: The Missing Ingredient for Fast Stylization Dmitry Ulyanov Andrea Vedaldi Victor Lempitsky OOD 113 3,689 0 27 Jul 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 219 10,412 0 21 Jul 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 231 7,951 0 23 May 2016
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks Tim Salimans Diederik P. Kingma ODL 134 1,933 0 25 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.2K 192,638 0 10 Dec 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 989 76,547 0 18 May 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 260 43,154 0 11 Feb 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 144 18,534 0 06 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 632 149,474 0 22 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 761 99,991 0 04 Sep 2014