Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks

25 February 2016

Papers citing "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

50 / 957 papers shown

Title
RotationOut as a Regularization Method for Neural Network Kaiqin Hu Barnabás Póczós 28 1 0 18 Nov 2019
Comparison of Deep learning models on time series forecasting : a case study of Dissolved Oxygen Prediction Hongqian Qin AI4TS 27 16 0 17 Nov 2019
Understanding the Disharmony between Weight Normalization Family and Weight Decay: $ε-$ shifted $L_2$ Regularizer Li Xiang Chen Shuo Xia Yan Yang Jian 34 2 0 14 Nov 2019
Streaming convolutional neural networks for end-to-end learning with multi-megapixel images H. Pinckaers Bram van Ginneken G. Litjens MedIm 27 94 0 11 Nov 2019
The Speed Submission to DIHARD II: Contributions & Lessons Learned Md. Sahidullah J. Patino Samuele Cornell Ruiqing Yin S. Sivasankaran ... Emmanuel Vincent Nicholas W. D. Evans S´ebastien Marcel S. Squartini C. Barras VLM 14 16 0 06 Nov 2019
Quinoa: a Q-function You Infer Normalized Over Actions Jonas Degrave A. Abdolmaleki Jost Tobias Springenberg N. Heess Martin Riedmiller 13 5 0 05 Nov 2019
A Near-Optimal Gradient Flow for Learning Neural Energy-Based Models Yang Wu Pengxu Wei Liang Lin 14 0 0 31 Oct 2019
Inherent Weight Normalization in Stochastic Neural Networks Georgios Detorakis S. Dutta A. Khanna M. Jerry S. Datta Emre Neftci OOD 19 6 0 27 Oct 2019
Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogram Ryuichi Yamamoto Eunwoo Song Jae-Min Kim 17 809 0 25 Oct 2019
Deep Learning Supersampled Scanning Transmission Electron Microscopy Jeffrey M. Ede MedIm 15 7 0 23 Oct 2019
Kernelized Wasserstein Natural Gradient Michael Arbel Arthur Gretton Wuchen Li Guido Montúfar 18 22 0 21 Oct 2019
Deep Reinforcement Learning Control of Quantum Cartpoles Zhikang T. Wang Yuto Ashida Masahito Ueda 14 40 0 21 Oct 2019
Machine Learning Systems for Highly-Distributed and Rapidly-Growing Data Kevin Hsieh SyDa OOD 14 4 0 18 Oct 2019
Root Mean Square Layer Normalization Biao Zhang Rico Sennrich 16 665 0 16 Oct 2019
Lead2Gold: Towards exploiting the full potential of noisy transcriptions for speech recognition Adrien Dufraux Emmanuel Vincent Awni Y. Hannun Armelle Brun Matthijs Douze 6 9 0 16 Oct 2019
Effects of Depth, Width, and Initialization: A Convergence Analysis of Layer-wise Training for Deep Linear Neural Networks Yeonjong Shin 19 12 0 14 Oct 2019
MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis Kundan Kumar Rithesh Kumar T. Boissière L. Gestin Wei Zhen Teoh Jose M. R. Sotelo A. D. Brébisson Yoshua Bengio Aaron Courville GAN 13 938 0 08 Oct 2019
Dilated Convolutional Neural Networks for Sequential Manifold-valued Data Xingjian Zhen Rudrasis Chakraborty Nicholas M. Vogt B. Bendlin Vikas Singh MedIm 30 35 0 05 Oct 2019
SNDCNN: Self-normalizing deep CNNs with scaled exponential linear units for speech recognition Atanas G. Atanasov Tim Ng Leo Liu Henry Mason Xiaodan Zhuang Daben Liu 21 40 0 04 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 13 558 0 01 Oct 2019
AdaptivFloat: A Floating-point based Data Type for Resilient Deep Learning Inference Thierry Tambe En-Yu Yang Zishen Wan Yuntian Deng Vijay Janapa Reddi Alexander M. Rush David Brooks Gu-Yeon Wei MQ 11 21 0 29 Sep 2019
Additive Powers-of-Two Quantization: An Efficient Non-uniform Discretization for Neural Networks Yuhang Li Xin Dong Wei Wang MQ 31 254 0 28 Sep 2019
PairNorm: Tackling Oversmoothing in GNNs Lingxiao Zhao Leman Akoglu 16 503 0 26 Sep 2019
Conditional Transferring Features: Scaling GANs to Thousands of Classes with 30% Less High-quality Data for Training Chunpeng Wu W. Wen Yiran Chen H. Li GAN 30 2 0 25 Sep 2019
From feature selection to continuous optimization H. Rakhshani L. Idoumghar Julien Lepagnot Mathieu Brévilliers 9 1 0 20 Sep 2019
GAN-Leaks: A Taxonomy of Membership Inference Attacks against Generative Models Dingfan Chen Ning Yu Yang Zhang Mario Fritz 23 52 0 09 Sep 2019
Linear Context Transform Block D. Ruan Jun Wen Nenggan Zheng Min Zheng ViT 19 22 0 06 Sep 2019
No Press Diplomacy: Modeling Multi-Agent Gameplay Philip Paquette Yuchen Lu Steven Bocco Max O. Smith Satya Ortiz-Gagné Jonathan K. Kummerfeld Satinder Singh Joelle Pineau Aaron Courville 33 57 0 04 Sep 2019
Decoupled Box Proposal and Featurization with Ultrafine-Grained Semantic Labels Improve Image Captioning and Visual Question Answering Soravit Changpinyo Bo Pang Piyush Sharma Radu Soricut ObjD 17 20 0 04 Sep 2019
Deep Convolutional Networks in System Identification Carl R. Andersson Antônio H. Ribeiro K. Tiels Niklas Wahlström Thomas B. Schon 16 48 0 04 Sep 2019
Deep Equilibrium Models Shaojie Bai J. Zico Kolter V. Koltun 14 657 0 03 Sep 2019
Spectral Regularization for Combating Mode Collapse in GANs Kanglin Liu Wenming Tang Fei Zhou Guoping Qiu GAN DRL 33 81 0 29 Aug 2019
PixelVAE++: Improved PixelVAE with Discrete Prior Hossein Sadeghi Evgeny Andriyash W. Vinci L. Buffoni Mohammad H. Amin BDL DRL 21 33 0 26 Aug 2019
Theoretical Issues in Deep Networks: Approximation, Optimization and Generalization T. Poggio Andrzej Banburski Q. Liao ODL 31 161 0 25 Aug 2019
Generalization in Generative Adversarial Networks: A Novel Perspective from Privacy Protection Bingzhe Wu Shiwan Zhao Chaochao Chen Haoyang Xu Li Wang Xiaolu Zhang Guangyu Sun Jun Zhou 30 45 0 21 Aug 2019
U-Net Training with Instance-Layer Normalization Xiao-Yun Zhou Peichao Li Zhao-Yang Wang Guang-Zhong Yang 26 9 0 21 Aug 2019
Make a Face: Towards Arbitrary High Fidelity Face Manipulation Shengju Qian Kwan-Yee Lin Wayne Wu Yangxiaokang Liu Quan Wang Fumin Shen Chao Qian Ran He CVBM 24 71 0 20 Aug 2019
Neural Architecture Search by Estimation of Network Structure Distributions A. Muravev Jenni Raitoharju Moncef Gabbouj OOD 16 1 0 19 Aug 2019
Attentional Feature-Pair Relation Networks for Accurate Face Recognition Bong-Nam Kang Yonghyun Kim Bongjin Jun Daijin Kim CVBM 24 37 0 17 Aug 2019
Instance Enhancement Batch Normalization: an Adaptive Regulator of Batch Noise Senwei Liang Zhongzhan Huang Mingfu Liang Haizhao Yang 30 57 0 12 Aug 2019
Bayesian Inference for Large Scale Image Classification Jonathan Heek Nal Kalchbrenner UQCV BDL 17 33 0 09 Aug 2019
NeuPDE: Neural Network Based Ordinary and Partial Differential Equations for Modeling Time-Dependent Data Yifan Sun Linan Zhang Hayden Schaeffer AI4TS 22 91 0 08 Aug 2019
Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning Eric Arazo Diego Ortego Paul Albert Noel E. O'Connor Kevin McGuinness 34 818 0 08 Aug 2019
Softmax Dissection: Towards Understanding Intra- and Inter-class Objective for Embedding Learning Lanqing He Zhongdao Wang Yali Li Shengjin Wang 23 32 0 04 Aug 2019
Attentive Normalization Xilai Li Wei Sun Tianfu Wu OOD ViT 28 31 0 04 Aug 2019
Simple and Effective Text Matching with Richer Alignment Features Runqi Yang Jianhai Zhang Xing Gao Feng Ji Haiqing Chen 3DV 21 153 0 01 Aug 2019
Uncertainty in Model-Agnostic Meta-Learning using Variational Inference Cuong C. Nguyen Thanh-Toan Do G. Carneiro OOD BDL UQCV 19 54 0 27 Jul 2019
Bilinear Graph Networks for Visual Question Answering Dalu Guo Chang Xu Dacheng Tao GNN 27 50 0 23 Jul 2019
Trainability of ReLU networks and Data-dependent Initialization Yeonjong Shin George Karniadakis 8 8 0 23 Jul 2019
Channel Normalization in Convolutional Neural Network avoids Vanishing Gradients Zhenwei Dai Reinhard Heckel 7 24 0 22 Jul 2019