Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks

25 February 2016

Papers citing "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

50 / 957 papers shown

Title
Unsupervised Cross-Domain Singing Voice Conversion Adam Polyak Lior Wolf Yossi Adi Yaniv Taigman 20 44 0 06 Aug 2020
Learning to Denoise Historical Music Yunpeng Li Beat Gfeller Marco Tagliasacchi Dominik Roblek 27 17 0 05 Aug 2020
PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations E. Tretschk A. Tewari Vladislav Golyanik Michael Zollhöfer Carsten Stoll Christian Theobalt 3DPC 3DH 3DV 19 107 0 04 Aug 2020
VocGAN: A High-Fidelity Real-time Vocoder with a Hierarchically-nested Adversarial Network Jinhyeok Yang Junmo Lee Young-Ik Kim Hoonyoung Cho Injung Kim 16 72 0 30 Jul 2020
Reparameterizing Convolutions for Incremental Multi-Task Learning without Task Interference Menelaos Kanakis David Brüggemann Suman Saha Stamatios Georgoulis Anton Obukhov Luc Van Gool CLL 30 72 0 24 Jul 2020
Neural Mesh Flow: 3D Manifold Mesh Generation via Diffeomorphic Flows Kunal Gupta Manmohan Chandraker AI4CE 54 77 0 21 Jul 2020
Inductive Link Prediction for Nodes Having Only Attribute Information Yu Hao Xin Cao Yixiang Fang Xike Xie Sibo Wang 22 76 0 16 Jul 2020
Lessons Learned from the Training of GANs on Artificial Datasets Shichang Tang 22 18 0 13 Jul 2020
Quaternion Capsule Networks B. Özcan Furkan Kinli Mustafa Furkan Kıraç 3DPC 20 6 0 08 Jul 2020
NVAE: A Deep Hierarchical Variational Autoencoder Arash Vahdat Jan Kautz BDL 35 895 0 08 Jul 2020
A Chain Graph Interpretation of Real-World Neural Networks Yuesong Shen Daniel Cremers GNN AI4CE 6 0 0 30 Jun 2020
Gradient-only line searches to automatically determine learning rates for a variety of stochastic training algorithms D. Kafka D. Wilke ODL 27 0 0 29 Jun 2020
Spherical Perspective on Learning with Normalization Layers Simon Roburin Yann de Mont-Marin Andrei Bursuc Renaud Marlet P. Pérez Mathieu Aubry 8 6 0 23 Jun 2020
Auxiliary Learning by Implicit Differentiation Aviv Navon Idan Achituve Haggai Maron Gal Chechik Ethan Fetaya 33 59 0 22 Jun 2020
Bidirectionally Self-Normalizing Neural Networks Yao Lu Stephen Gould Thalaiyasingam Ajanthan ODL 17 9 0 22 Jun 2020
DO-Conv: Depthwise Over-parameterized Convolutional Layer Jinming Cao Yangyan Li Mingchao Sun Ying-Cong Chen Dani Lischinski Daniel Cohen-Or Baoquan Chen Changhe Tu OOD 33 166 0 22 Jun 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 118 17,154 0 19 Jun 2020
Towards an Adversarially Robust Normalization Approach Muhammad Awais Fahad Shamshad Sung-Ho Bae AAML OOD 52 19 0 19 Jun 2020
New Interpretations of Normalization Methods in Deep Learning Jiacheng Sun Xiangyong Cao Hanwen Liang Weiran Huang Zewei Chen Zhenguo Li 21 35 0 16 Jun 2020
Channel Relationship Prediction with Forget-Update Module for Few-shot Classification Minglei Yuan Cunhao Cai Tong Lu ViT 8 0 0 16 Jun 2020
Multiscale Deep Equilibrium Models Shaojie Bai V. Koltun J. Zico Kolter BDL 38 211 0 15 Jun 2020
Globally Injective ReLU Networks Michael Puthawala K. Kothari Matti Lassas Ivan Dokmanić Maarten V. de Hoop 29 26 0 15 Jun 2020
Entropic gradient descent algorithms and wide flat minima Fabrizio Pittorino C. Lucibello Christoph Feinauer Gabriele Perugini Carlo Baldassi Elizaveta Demyanenko R. Zecchina ODL MLT 35 33 0 14 Jun 2020
Move-to-Data: A new Continual Learning approach with Deep CNNs, Application for image-class recognition Miltiadis Poursanidis J. Benois-Pineau A. Zemmari Boris Mansencal A. Rugy CLL 13 6 0 12 Jun 2020
Non-convergence of stochastic gradient descent in the training of deep neural networks Patrick Cheridito Arnulf Jentzen Florian Rossmannek 19 37 0 12 Jun 2020
Optimization Theory for ReLU Neural Networks Trained with Normalization Layers Yonatan Dukler Quanquan Gu Guido Montúfar 19 30 0 11 Jun 2020
Achieving robustness in classification using optimal transport with hinge regularization M. Serrurier Franck Mamalet Alberto González Sanz Thibaut Boissin Jean-Michel Loubes E. del Barrio AAML 28 39 0 11 Jun 2020
Super-resolution Variational Auto-Encoders Ioannis Gatopoulos M. Stol Jakub M. Tomczak SupR DiffM 20 15 0 09 Jun 2020
A Survey on Generative Adversarial Networks: Variants, Applications, and Training Abdul Jabbar Xi Li Bourahla Omar 25 266 0 09 Jun 2020
C-SL: Contrastive Sound Localization with Inertial-Acoustic Sensors Majid Mirbagheri Bardia Doosti 33 2 0 09 Jun 2020
Passive Batch Injection Training Technique: Boosting Network Performance by Injecting Mini-Batches from a different Data Distribution Pravendra Singh Pratik Mazumder Vinay P. Namboodiri 17 0 0 08 Jun 2020
Cross-Domain Segmentation with Adversarial Loss and Covariate Shift for Biomedical Imaging Bora Baydar Savas Ozkan A. Emre Kavur N. Gezer M. Alper Selver G. Akar OOD 21 0 0 08 Jun 2020
Refined Continuous Control of DDPG Actors via Parametrised Activation M. Hossny Julie Iskander Mohammed Attia Khaled Saleh 17 7 0 04 Jun 2020
An Informal Introduction to Multiplet Neural Networks Nathan E. Frick 9 0 0 02 Jun 2020
Neural Networks with Small Weights and Depth-Separation Barriers Gal Vardi Ohad Shamir 16 18 0 31 May 2020
Sequence to Point Learning Based on Bidirectional Dilated Residual Network for Non Intrusive Load Monitoring Ziyue Jia Linfeng Yang Zhenrong Zhang Hui Liu Fannie Kong 17 60 0 30 May 2020
A comparison of Vietnamese Statistical Parametric Speech Synthesis Systems Phan Huy Kinh V. Phung Anh-Tuan Dinh Quoc Bao Nguyen 22 1 0 26 May 2020
Iterative Network for Image Super-Resolution Yuqing Liu Shiqi Wang Jian Zhang Shanshe Wang Siwei Ma Wen Gao SupR 21 28 0 20 May 2020
Normalized Attention Without Probability Cage Oliver Richter Roger Wattenhofer 14 21 0 19 May 2020
Regularization Methods for Generative Adversarial Networks: An Overview of Recent Studies Minhyeok Lee Junhee Seok GAN 27 25 0 19 May 2020
Many-to-Many Voice Transformer Network Hirokazu Kameoka Wen-Chin Huang Kou Tanaka Takuhiro Kaneko Nobukatsu Hojo T. Toda ViT 30 30 0 18 May 2020
Finet: Using Fine-grained Batch Normalization to Train Light-weight Neural Networks Chunjie Luo Jianfeng Zhan Lei Wang Wanling Gao 9 1 0 14 May 2020
Discriminative Multi-modality Speech Recognition Bo Xu Cheng Lu Yandong Guo Jacob Wang 26 98 0 12 May 2020
Transforming task representations to perform novel tasks Andrew Kyle Lampinen James L. McClelland 19 5 0 08 May 2020
Visual Question Answering with Prior Class Semantics Violetta Shevchenko Damien Teney A. Dick Anton Van Den Hengel BDL 20 7 0 04 May 2020
Generative Adversarial Networks (GANs Survey): Challenges, Solutions, and Future Directions Divya Saxena Jiannong Cao AAML AI4CE 26 287 0 30 Apr 2020
Data Processing for Optimizing Naturalness of Vietnamese Text-to-speech System V. Phung Phan Huy Kinh Anh-Tuan Dinh Quoc Bao Nguyen 28 5 0 20 Apr 2020
Towards Understanding Normalization in Neural ODEs Julia Gusak L. Markeeva Talgat Daulbaev A. Katrutsa A. Cichocki Ivan Oseledets 19 19 0 20 Apr 2020
Gradient Centralization: A New Optimization Technique for Deep Neural Networks Hongwei Yong Jianqiang Huang Xiansheng Hua Lei Zhang ODL 27 184 0 03 Apr 2020
Controllable Orthogonalization in Training DNNs Lei Huang Li Liu Fan Zhu Diwen Wan Zehuan Yuan Bo Li Ling Shao 26 43 0 02 Apr 2020