Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks

25 February 2016

Papers citing "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

50 / 957 papers shown

Title
Switchable Normalization for Learning-to-Normalize Deep Representation Ping Luo Ruimao Zhang Jiamin Ren Zhanglin Peng Jingyu Li 30 73 0 22 Jul 2019
Single-bit-per-weight deep convolutional neural networks without batch-normalization layers for embedded systems Mark D Mcdonnell Hesham Mostafa Runchun Wang Andre van Schaik MQ 28 2 0 16 Jul 2019
Meta-Learning for Black-box Optimization T. Vishnu Pankaj Malhotra Jyoti Narwariya L. Vig Gautam M. Shroff 16 18 0 16 Jul 2019
Order and Chaos: NTK views on DNN Normalization, Checkerboard and Boundary Artifacts Arthur Jacot Franck Gabriel François Ged Clément Hongler 19 23 0 11 Jul 2019
Positional Normalization Boyi Li Felix Wu Kilian Q. Weinberger Serge J. Belongie 24 91 0 09 Jul 2019
Learning to Optimize Domain Specific Normalization for Domain Generalization Seonguk Seo Yumin Suh Dongwan Kim Geeho Kim Jongwoo Han Bohyung Han AI4CE 36 243 0 09 Jul 2019
Mean Spectral Normalization of Deep Neural Networks for Embedded Automation Anand Subramanian N. Chong 12 2 0 09 Jul 2019
QUOTIENT: Two-Party Secure Neural Network Training and Prediction Nitin Agrawal Ali Shahin Shamsabadi Matt J. Kusner Adria Gascon 30 212 0 08 Jul 2019
ACNe: Attentive Context Normalization for Robust Permutation-Equivariant Learning Weiwei Sun Wei Jiang Eduard Trulls Andrea Tagliasacchi K. M. Yi 3DPC 19 20 0 04 Jul 2019
Rare Disease Detection by Sequence Modeling with Generative Adversarial Networks Kezi Yu Yunlong Wang Yong Cai Cao Xiao E. Zhao Lucas Glass Jimeng Sun 16 14 0 01 Jul 2019
Random Vector Functional Link Neural Network based Ensemble Deep Learning Rakesh Katuwal Ponnuthurai Nagaratnam Suganthan M. Tanveer 24 156 0 30 Jun 2019
Adaptive Learning Rate Clipping Stabilizes Learning Jeffrey M. Ede R. Beanland 11 39 0 21 Jun 2019
Parametric Resynthesis with neural vocoders Soumi Maiti Michael I. Mandel 9 19 0 16 Jun 2019
Regularizing Neural Networks via Minimizing Hyperspherical Energy Rongmei Lin Weiyang Liu Zhen Liu Chen Feng Zhiding Yu James M. Rehg Li Xiong Le Song 24 35 0 12 Jun 2019
Table-Based Neural Units: Fully Quantizing Networks for Multiply-Free Inference Michele Covell David Marwood S. Baluja Nick Johnston MQ 19 7 0 11 Jun 2019
Making CNNs for Video Parsing Accessible Zijin Luo Matthew J. Guzdial Mark O. Riedl 22 9 0 10 Jun 2019
Four Things Everyone Should Know to Improve Batch Normalization Cecilia Summers M. Dinneen 30 52 0 09 Jun 2019
How to Initialize your Network? Robust Initialization for WeightNorm & ResNets Devansh Arpit Victor Campos Yoshua Bengio 13 56 0 05 Jun 2019
Dilated Convolution with Dilated GRU for Music Source Separation Jen-Yu Liu Yi-Hsuan Yang 15 41 0 04 Jun 2019
NodeDrop: A Condition for Reducing Network Size without Effect on Output Louis Jensen Jacob A. Harer S. Chin 8 0 0 03 Jun 2019
Fashion Editing with Adversarial Parsing Learning Haoye Dong Xiaodan Liang Yixuan Zhang Xujie Zhang Zhenyu Xie Bowen Wu Ziqi Zhang Xiaohui Shen Jian Yin GAN 20 11 0 03 Jun 2019
Why Not to Use Zero Imputation? Correcting Sparsity Bias in Training Neural Networks Joonyoung Yi Juhyuk Lee Kwang Joon Kim Sung Ju Hwang Eunho Yang VLM 14 24 0 01 Jun 2019
Partial Scanning Transmission Electron Microscopy with Deep Learning Jeffrey M. Ede R. Beanland MedIm 13 22 0 31 May 2019
One-element Batch Training by Moving Window Przemysław Spurek Szymon Knop Jacek Tabor Igor T. Podolak B. Wójcik VLM 24 0 0 30 May 2019
AlignFlow: Cycle Consistent Learning from Multiple Domains via Normalizing Flows Aditya Grover Christopher Chute Rui Shu Zhangjie Cao Stefano Ermon OOD DRL 11 65 0 30 May 2019
Instant Quantization of Neural Networks using Monte Carlo Methods Gonçalo Mordido Matthijs Van Keirsbilck A. Keller MQ 27 9 0 29 May 2019
Network Deconvolution Chengxi Ye Matthew Evanusa Hua He A. Mitrokhin Tom Goldstein J. Yorke Cornelia Fermuller Yiannis Aloimonos 11 35 0 28 May 2019
Implicit Rugosity Regularization via Data Augmentation Daniel LeJeune Randall Balestriero Hamid Javadi Richard G. Baraniuk 10 4 0 28 May 2019
On approximating dropout noise injection Natalie Schluter 8 1 0 27 May 2019
DIVA: Domain Invariant Variational Autoencoders Maximilian Ilse Jakub M. Tomczak Christos Louizos Max Welling DRL OOD 28 198 0 24 May 2019
Fine-grained Optimization of Deep Neural Networks Mete Ozay ODL 14 1 0 22 May 2019
Bit-Swap: Recursive Bits-Back Coding for Lossless Compression with Hierarchical Latent Variables F. Kingma Pieter Abbeel Jonathan Ho 6 96 0 16 May 2019
ROI Regularization for Semi-supervised and Supervised Learning H. Kaizuka Yasuhiro Nagasaki R. Sako 21 1 0 15 May 2019
LGM-Net: Learning to Generate Matching Networks for Few-Shot Learning Huaiyu Li Weiming Dong Xing Mei Chongyang Ma Feiyue Huang Bao-Gang Hu OffRL 32 98 0 15 May 2019
Online Normalization for Training Neural Networks Vitaliy Chiley I. Sharapov Atli Kosson Urs Koster R. Reece S. D. L. Fuente Vishal Subbiah Michael James OnRL 26 54 0 15 May 2019
Static Activation Function Normalization Pierre Harvey Richemond Yike Guo 13 0 0 03 May 2019
Deep Multi-View Learning using Neuron-Wise Correlation-Maximizing Regularizers Kui Jia Jiehong Lin Mingkui Tan Dacheng Tao 3DV 25 32 0 25 Apr 2019
Adversarial Dropout for Recurrent Neural Networks Sungrae Park Kyungwoo Song Mingi Ji Wonsung Lee Il-Chul Moon 6 6 0 22 Apr 2019
Modulating Image Restoration with Continual Levels via Adaptive Feature Modification Layers Jingwen He Chao Dong Yu Qiao SupR 27 91 0 17 Apr 2019
Super Resolution Convolutional Neural Network Models for Enhancing Resolution of Rock Micro-CT Images Ying Da Wang R. Armstrong P. Mostaghimi 4 88 0 16 Apr 2019
Copula-like Variational Inference Marcel Hirt P. Dellaportas Alain Durmus 9 5 0 15 Apr 2019
The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent Karthik A. Sankararaman Soham De Zheng Xu Yifan Jiang Tom Goldstein ODL 24 103 0 15 Apr 2019
EvalNorm: Estimating Batch Normalization Statistics for Evaluation Saurabh Singh Abhinav Shrivastava 26 51 0 12 Apr 2019
Block Neural Autoregressive Flow Nicola De Cao Ivan Titov Wilker Aziz DRL 9 121 0 09 Apr 2019
Who Needs Words? Lexicon-Free Speech Recognition Tatiana Likhomanenko Gabriel Synnaeve R. Collobert 6 27 0 09 Apr 2019
Hierarchical Temporal Convolutional Networks for Dynamic Recommender Systems Jiaxuan You Yichen Wang Aditya Pal Pong Eksombatchai C. Rosenberg J. Leskovec 22 124 0 08 Apr 2019
Instance-Level Meta Normalization Songhao Jia Ding-Jie Chen Hwann-Tzong Chen 16 20 0 06 Apr 2019
Iterative Normalization: Beyond Standardization towards Efficient Whitening Lei Huang Yi Zhou Fan Zhu Li Liu Ling Shao 26 140 0 06 Apr 2019
Jasper: An End-to-End Convolutional Neural Acoustic Model Jason Chun Lok Li Vitaly Lavrukhin Boris Ginsburg Ryan Leary Oleksii Kuchaiev Jonathan M. Cohen Huyen Nguyen R. Gadde DRL VLM AuLLM 6 263 0 05 Apr 2019
Regularizing Activation Distribution for Training Binarized Deep Networks Ruizhou Ding Ting-Wu Chin Z. Liu Diana Marculescu MQ 16 145 0 04 Apr 2019