Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks

25 February 2016

Papers citing "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

50 / 957 papers shown

Title
Unsupervised domain adaptation for medical imaging segmentation with self-ensembling C. Perone P. Ballester Rodrigo C. Barros Julien Cohen-Adad OOD 33 207 0 14 Nov 2018
Benchmarking Deep Sequential Models on Volatility Predictions for Financial Time Series Qiang Zhang Kyle Birkeland Yaodong Yang Y. Liu 22 9 0 08 Nov 2018
PILAE: A Non-gradient Descent Learning Scheme for Deep Feedforward Neural Networks Ping Guo Ke Wang Xiuling Zhou 20 18 0 05 Nov 2018
Minimax Estimation of Neural Net Distance Kaiyi Ji Yingbin Liang GAN 17 8 0 02 Nov 2018
Abstractive Summarization of Reddit Posts with Multi-level Memory Networks Byeongchang Kim Hyunwoo J. Kim Gunhee Kim 12 181 0 02 Nov 2018
Stochastic Normalizations as Bayesian Learning Alexander Shekhovtsov B. Flach UQCV BDL 15 15 0 01 Nov 2018
Balanced Sparsity for Efficient DNN Inference on GPU Zhuliang Yao Shijie Cao Wencong Xiao Chen Zhang Lanshun Nie 25 90 0 01 Nov 2018
WaveGlow: A Flow-based Generative Network for Speech Synthesis R. Prenger Rafael Valle Bryan Catanzaro 17 1,023 0 31 Oct 2018
Few-shot 3D Multi-modal Medical Image Segmentation using Generative Adversarial Learning Arnab Kumar Mondal Jose Dolz Christian Desrosiers GAN MedIm 37 118 0 29 Oct 2018
Can We Gain More from Orthogonality Regularizations in Training Deep CNNs? Nitin Bansal Xiaohan Chen Zhangyang Wang OOD 22 189 0 22 Oct 2018
Learning Inward Scaled Hypersphere Embedding: Exploring Projections in Higher Dimensions Muhammad Kamran Janjua Shah Nawaz Alessandro Calefati I. Gallo 16 0 0 16 Oct 2018
Fine-tuning on Clean Data for End-to-End Speech Translation: FBK @ IWSLT 2018 Mattia Antonino Di Gangi Roberto Dessì R. Cattoni Matteo Negri Marco Turchi 18 10 0 16 Oct 2018
Trellis Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun 25 145 0 15 Oct 2018
Revisit Batch Normalization: New Understanding from an Optimization View and a Refinement via Composition Optimization Xiangru Lian Ji Liu 11 6 0 15 Oct 2018
A Survey and Critique of Multiagent Deep Reinforcement Learning Pablo Hernandez-Leal Bilal Kartal Matthew E. Taylor OffRL 32 550 0 12 Oct 2018
Information Geometry of Orthogonal Initializations and Training Piotr A. Sokól Il-Su Park AI4CE 72 16 0 09 Oct 2018
Understanding Weight Normalized Deep Neural Networks with Rectified Linear Units Yixi Xu Tianlin Li MQ 31 12 0 03 Oct 2018
CEM-RL: Combining evolutionary and gradient-based methods for policy search Aloïs Pourchot Olivier Sigaud 32 159 0 02 Oct 2018
A Quantitative Analysis of the Effect of Batch Normalization on Gradient Descent Yongqiang Cai Qianxiao Li Zuowei Shen 14 3 0 29 Sep 2018
Large Scale GAN Training for High Fidelity Natural Image Synthesis Andrew Brock Jeff Donahue Karen Simonyan 54 5,322 0 28 Sep 2018
Batch-normalized Recurrent Highway Networks Chi Zhang Thang Nguyen Shagan Sah R. Ptucha A. Loui C. Salvaggio 9 8 0 26 Sep 2018
Utilizing Class Information for Deep Network Representation Shaping Daeyoung Choi Wonjong Rhee 8 2 0 25 Sep 2018
Model-Based Reinforcement Learning via Meta-Policy Optimization I. Clavera Jonas Rothfuss John Schulman Yasuhiro Fujita Tamim Asfour Pieter Abbeel 19 224 0 14 Sep 2018
Normalization in Training U-Net for 2D Biomedical Semantic Segmentation Xiao-Yun Zhou Guang-Zhong Yang 18 77 0 11 Sep 2018
Logographic Subword Model for Neural Machine Translation Yihao Fang Ronghuo Zheng Xiao-Dan Zhu 22 0 0 07 Sep 2018
Improving Explorability in Variational Inference with Annealed Variational Objectives Chin-Wei Huang Shawn Tan Alexandre Lacoste Aaron Courville DRL 14 47 0 06 Sep 2018
Retinal Vessel Segmentation under Extreme Low Annotation: A Generative Adversarial Network Approach A. Lahiri V. Jain Arnab Kumar Mondal P. Biswas GAN MedIm 36 12 0 05 Sep 2018
Towards Understanding Regularization in Batch Normalization Ping Luo Xinjiang Wang Wenqi Shao Zhanglin Peng MLT AI4CE 23 179 0 04 Sep 2018
Semi-supervised Learning on Graphs with Generative Adversarial Nets Ming Ding Jie Tang Jie Zhang GNN GAN 6 116 0 01 Sep 2018
Wide Activation for Efficient and Accurate Image Super-Resolution Jiahui Yu Yuchen Fan Jianchao Yang N. Xu Zhaowen Wang Xinchao Wang Thomas Huang SupR 14 355 0 27 Aug 2018
Importance mixing: Improving sample reuse in evolutionary policy search methods Aloïs Pourchot Nicolas Perrin Olivier Sigaud 7 14 0 17 Aug 2018
Collapse of Deep and Narrow Neural Nets Lu Lu Yanhui Su George Karniadakis ODL 11 153 0 15 Aug 2018
Question-Guided Hybrid Convolution for Visual Question Answering Peng Gao Pan Lu Hongsheng Li Shuang Li Yikang Li Guosheng Lin Xiaogang Wang 26 68 0 08 Aug 2018
A Review of Learning with Deep Generative Models from Perspective of Graphical Modeling Zhijian Ou 31 16 0 05 Aug 2018
Large Scale Language Modeling: Converging on 40GB of Text in Four Hours Raul Puri Robert M. Kirby Nikolai Yakovenko Bryan Catanzaro 14 29 0 03 Aug 2018
Improved Deep Spectral Convolution Network For Hyperspectral Unmixing With Multinomial Mixture Kernel and Endmember Uncertainty Savas Ozkan G. Akar UQCV 14 13 0 03 Aug 2018
Deep Appearance Models for Face Rendering Stephen Lombardi Jason M. Saragih Tomas Simon Yaser Sheikh CVBM 3DH 15 280 0 01 Aug 2018
Improving Electron Micrograph Signal-to-Noise with an Atrous Convolutional Encoder-Decoder Jeffrey M. Ede 28 1 0 30 Jul 2018
Effectiveness of Scaled Exponentially-Regularized Linear Units (SERLUs) Guoqiang Zhang Hao Li 11 10 0 26 Jul 2018
Pythia v0.1: the Winning Entry to the VQA Challenge 2018 Yu Jiang Vivek Natarajan Xinlei Chen Marcus Rohrbach Dhruv Batra Devi Parikh VLM 15 202 0 26 Jul 2018
Convolutional Sparse Kernel Network for Unsupervised Medical Image Analysis Euijoon Ahn Jinman Kim Ashnil Kumar M. Fulham Da-wei Feng 12 2 0 16 Jul 2018
Manifold regularization with GANs for semi-supervised learning Bruno Lecouat Chuan-Sheng Foo Houssam Zenati V. Chandrasekhar GAN 16 14 0 11 Jul 2018
Glow: Generative Flow with Invertible 1x1 Convolutions Diederik P. Kingma Prafulla Dhariwal BDL DRL 19 3,081 0 09 Jul 2018
Denoising Auto-encoder with Recurrent Skip Connections and Residual Regression for Music Source Separation Jen-Yu Liu Yi-Hsuan Yang 30 38 0 05 Jul 2018
Product-based Neural Networks for User Response Prediction over Multi-field Categorical Data Yanru Qu Bohui Fang Weinan Zhang Ruiming Tang Minzhe Niu Huifeng Guo Yong Yu Xiuqiang He 11 179 0 01 Jul 2018
Theory IIIb: Generalization in Deep Networks T. Poggio Q. Liao Brando Miranda Andrzej Banburski Xavier Boix Jack Hidary ODL AI4CE 27 26 0 29 Jun 2018
High Diversity Attribute Guided Face Generation with GANs Evgeny Izutov CVBM GAN 21 0 0 28 Jun 2018
Differentiable Learning-to-Normalize via Switchable Normalization Ping Luo Jiamin Ren Zhanglin Peng Ruimao Zhang Jingyu Li 11 176 0 28 Jun 2018
Tensor Monte Carlo: particle methods for the GPU era Laurence Aitchison BDL DRL 22 13 0 22 Jun 2018
Deep Global-Connected Net With The Generalized Multi-Piecewise ReLU Activation in Deep Learning Zhi Chen P. Ho 12 3 0 19 Jun 2018