Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks

25 February 2016

Papers citing "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

50 / 957 papers shown

Title
Exposing GAN-synthesized Faces Using Landmark Locations Xin Yang Yuezun Li H. Qi Siwei Lyu GAN CVBM 24 107 0 30 Mar 2019
Micro-Batch Training with Batch-Channel Normalization and Weight Standardization Siyuan Qiao Huiyu Wang Chenxi Liu Wei Shen Alan Yuille MQ 32 144 0 25 Mar 2019
Semantic Image Synthesis with Spatially-Adaptive Normalization Taesung Park Ming-Yu Liu Ting-Chun Wang Jun-Yan Zhu 18 2,661 0 18 Mar 2019
Recurrence is required to capture the representational dynamics of the human visual system Tim C Kietzmann Courtney J. Spoerer Lynn K. A. Sörensen Radoslaw Martin Cichy O. Hauk N. Kriegeskorte 13 333 0 14 Mar 2019
Universally Slimmable Networks and Improved Training Techniques Jiahui Yu Thomas Huang 16 379 0 12 Mar 2019
Theory III: Dynamics and Generalization in Deep Networks Andrzej Banburski Q. Liao Brando Miranda Lorenzo Rosasco Fernanda De La Torre Jack Hidary T. Poggio AI4CE 32 3 0 12 Mar 2019
Learning to Paint With Model-based Deep Reinforcement Learning Zhewei Huang Wen Heng Shuchang Zhou GAN 21 16 0 11 Mar 2019
SSN: Learning Sparse Switchable Normalization via SparsestMax Wenqi Shao Jiamin Ren Jingyu Li Ruimao Zhang Yudian Li Xiaogang Wang Ping Luo 26 56 0 09 Mar 2019
A Deep Generative Model of Speech Complex Spectrograms Aditya Arie Nugraha Kouhei Sekiguchi Kazuyoshi Yoshii 18 19 0 08 Mar 2019
Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examples Eleni Triantafillou Tyler Lixuan Zhu Vincent Dumoulin Pascal Lamblin Utku Evci ... Ross Goroshin Carles Gelada Kevin Swersky Pierre-Antoine Manzagol Hugo Larochelle 51 612 0 07 Mar 2019
Conditional Density Estimation with Neural Networks: Best Practices and Benchmarks Jonas Rothfuss Fabio Ferreira Simon Walther Maxim Ulrich TPM 24 73 0 03 Mar 2019
Accelerating Training of Deep Neural Networks with a Standardization Loss Jasmine Collins Johannes Ballé Jonathon Shlens 21 3 0 03 Mar 2019
Regularity Normalization: Neuroscience-Inspired Unsupervised Attention across Neural Network Layers Baihan Lin 16 2 0 27 Feb 2019
Equi-normalization of Neural Networks Pierre Stock Benjamin Graham Rémi Gribonval Hervé Jégou ODL 8 16 0 27 Feb 2019
A Mean Field Theory of Batch Normalization Greg Yang Jeffrey Pennington Vinay Rao Jascha Narain Sohl-Dickstein S. Schoenholz 16 177 0 21 Feb 2019
A Fully Differentiable Beam Search Decoder R. Collobert Awni Y. Hannun Gabriel Synnaeve 17 40 0 16 Feb 2019
Parameter Efficient Training of Deep Convolutional Neural Networks by Dynamic Sparse Reparameterization Hesham Mostafa Xin Wang 37 307 0 15 Feb 2019
A Scale Invariant Flatness Measure for Deep Network Minima Akshay Rangamani Nam H. Nguyen Abhishek Kumar Dzung Phan Sang H. Chin T. Tran ODL 28 31 0 06 Feb 2019
BIVA: A Very Deep Hierarchy of Latent Variables for Generative Modeling Lars Maaløe Marco Fraccaro Valentin Liévin Ole Winther BDL DRL 16 213 0 06 Feb 2019
Early Recognition of Sepsis with Gaussian Process Temporal Convolutional Networks and Dynamic Time Warping Michael Moor Max Horn Bastian Alexander Rieck D. Roqueiro Karsten M. Borgwardt 11 14 0 05 Feb 2019
Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Design Jonathan Ho Xi Chen A. Srinivas Yan Duan Pieter Abbeel DRL 6 442 0 01 Feb 2019
Diversity Regularized Adversarial Learning B. Ayinde Keishin Nishihama J. Zurada GAN 14 1 0 30 Jan 2019
Unsupervised Scalable Representation Learning for Multivariate Time Series Jean-Yves Franceschi Aymeric Dieuleveut Martin Jaggi SSL AI4TS 25 440 0 30 Jan 2019
Fixup Initialization: Residual Learning Without Normalization Hongyi Zhang Yann N. Dauphin Tengyu Ma ODL AI4CE 23 347 0 27 Jan 2019
The Assistive Multi-Armed Bandit Lawrence Chan Dylan Hadfield-Menell S. Srinivasa Anca Dragan 14 36 0 24 Jan 2019
Trajectory Normalized Gradients for Distributed Optimization Jianqiao Wangni Ke Li Jianbo Shi Jitendra Malik 16 2 0 24 Jan 2019
DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation Jeong Joon Park Peter R. Florence Julian Straub Richard Newcombe S. Lovegrove 3DV 35 3,616 0 16 Jan 2019
Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks using PAC-Bayesian Analysis Yusuke Tsuzuku Issei Sato Masashi Sugiyama 22 74 0 15 Jan 2019
The Benefits of Over-parameterization at Initialization in Deep ReLU Networks Devansh Arpit Yoshua Bengio 11 22 0 11 Jan 2019
Intelligent Intersection: Two-Stream Convolutional Networks for Real-time Near Accident Detection in Traffic Video Xiaohui Huang Pan He Anand Rangarajan Sanjay Ranka 11 54 0 04 Jan 2019
Adaptive Density Estimation for Generative Models Thomas Lucas K. Shmelkov Alahari Karteek Cordelia Schmid Jakob Verbeek GAN DRL 24 32 0 04 Jan 2019
On Computation and Generalization of GANs with Spectrum Control Haoming Jiang Zhehui Chen Minshuo Chen Feng Liu Dingding Wang T. Zhao 16 6 0 28 Dec 2018
Efficient Super Resolution For Large-Scale Images Using Attentional GAN Harsh Nilesh Pathak Xinxin Li Shervin Minaee Brooke Cowan GAN 4 24 0 12 Dec 2018
Deep Anomaly Detection with Outlier Exposure Dan Hendrycks Mantas Mazeika Thomas G. Dietterich OODD 31 1,452 0 11 Dec 2018
Controlling Covariate Shift using Balanced Normalization of Weights Aaron Defazio Léon Bottou 16 0 0 11 Dec 2018
Theoretical Analysis of Auto Rate-Tuning by Batch Normalization Sanjeev Arora Zhiyuan Li Kaifeng Lyu 34 130 0 10 Dec 2018
To Reverse the Gradient or Not: An Empirical Comparison of Adversarial and Multi-task Learning in Speech Recognition Yossi Adi Neil Zeghidour R. Collobert Nicolas Usunier Vitaliy Liptchinsky Gabriel Synnaeve 29 39 0 09 Dec 2018
Generalized Batch Normalization: Towards Accelerating Deep Neural Networks Xiaoyong Yuan Zheng Feng Matthew Norton Xiaolin Li 8 24 0 08 Dec 2018
On Batch Orthogonalization Layers J. Blanchette R. Laganière BDL OOD 12 1 0 07 Dec 2018
A Spectral Regularizer for Unsupervised Disentanglement Aditya A. Ramesh Youngduck Choi Yann LeCun DRL 24 42 0 04 Dec 2018
Semi-supervised Rare Disease Detection Using Generative Adversarial Network Wenyuan Li Yunlong Wang Yong Cai C. Arnold E. Zhao Yilian Yuan MedIm GAN 17 22 0 03 Dec 2018
Deep Cosine Metric Learning for Person Re-Identification N. Wojke Alex Bewley 33 352 0 02 Dec 2018
Measure, Manifold, Learning, and Optimization: A Theory Of Neural Networks Shuai Li 15 2 0 30 Nov 2018
LP-WaveNet: Linear Prediction-based WaveNet Speech Synthesis Min-Jae Hwang Frank Soong Fenglong Xie Xi Wang Hyeonjoo Kang Hong-Goo Kang 14 21 0 29 Nov 2018
Few-Shot Generalization Across Dialogue Tasks Vladimir Vlasov Akela Drissner-Schmid Alan Nichol 19 33 0 28 Nov 2018
Regularizing by the Variance of the Activations' Sample-Variances Etai Littwin Lior Wolf VLM 20 12 0 21 Nov 2018
Gradient-Coherent Strong Regularization for Deep Neural Networks Dae Hoon Park C. Ho Yi Chang Huaqing Zhang ODL 13 1 0 20 Nov 2018
Neural Lander: Stable Drone Landing Control using Learned Dynamics Guanya Shi Xichen Shi Michael O'Connell Rose Yu Kamyar Azizzadenesheli Anima Anandkumar Yisong Yue Soon-Jo Chung 27 271 0 19 Nov 2018
Do Normalization Layers in a Deep ConvNet Really Need to Be Distinct? Ping Luo Zhanglin Peng Jiamin Ren Ruimao Zhang FAtt OOD 6 7 0 19 Nov 2018
Effect of data reduction on sequence-to-sequence neural TTS Javier Latorre Jakub Lachowicz Jaime Lorenzo-Trueba Thomas Merritt Thomas Drugman S. Ronanki Klimkov Viacheslav 33 59 0 15 Nov 2018