Layer Normalization

21 July 2016

Jimmy Lei Ba

Papers citing "Layer Normalization"

50 / 5,502 papers shown

Title
Learning a bidirectional mapping between human whole-body motion and natural language using deep recurrent neural networks Matthias Plappert Christian Mandery Tamim Asfour 3DH 27 129 0 18 May 2017
Reducing Bias in Production Speech Models Eric Battenberg R. Child Adam Coates Christopher Fougner Yashesh Gaur ... Vinay Rao S. Satheesh David Seetapun Anuroop Sriram Zhenyao Zhu 38 10 0 11 May 2017
Convolutional Sequence to Sequence Learning Jonas Gehring Michael Auli David Grangier Denis Yarats Yann N. Dauphin AIMat 37 3,263 0 08 May 2017
Supervised Learning of Universal Sentence Representations from Natural Language Inference Data Alexis Conneau Douwe Kiela Holger Schwenk Loïc Barrault Antoine Bordes AI4TS SSL 25 2,093 0 05 May 2017
NormFace: L2 Hypersphere Embedding for Face Verification Feng Wang Xiang Xiang Jian Cheng Alan Yuille 3DH CVBM 15 739 0 21 Apr 2017
Sparse Communication for Distributed Gradient Descent Alham Fikri Aji Kenneth Heafield 13 731 0 17 Apr 2017
TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering Y. Jang Yale Song Youngjae Yu Youngjin Kim Gunhee Kim 32 546 0 14 Apr 2017
A Neural Representation of Sketch Drawings David R Ha Douglas Eck 20 859 0 11 Apr 2017
Learning Two-Branch Neural Networks for Image-Text Matching Tasks Liwei Wang Yin Li Jing-ling Huang Svetlana Lazebnik VLM 27 494 0 11 Apr 2017
Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs M. Simonovsky N. Komodakis GNN 21 1,221 0 10 Apr 2017
Learning to Generate Reviews and Discovering Sentiment Alec Radford Rafal Jozefowicz Ilya Sutskever 44 504 0 05 Apr 2017
Improved Training of Wasserstein GANs Ishaan Gulrajani Faruk Ahmed Martín Arjovsky Vincent Dumoulin Aaron Courville GAN 16 9,471 0 31 Mar 2017
Learning Simpler Language Models with the Differential State Framework Alexander Ororbia Tomáš Mikolov David Reitter AI4TS 14 65 0 26 Mar 2017
In Defense of the Triplet Loss for Person Re-Identification Alexander Hermans Lucas Beyer Bastian Leibe DML 20 3,182 0 22 Mar 2017
An End-to-End Approach to Natural Language Object Retrieval via Context-Aware Deep Reinforcement Learning Fan Wu Zhongwen Xu Yi Yang ObjD 34 11 0 22 Mar 2017
Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization Xun Huang Serge J. Belongie OOD 18 4,302 0 20 Mar 2017
Learning Robust Visual-Semantic Embeddings Yao-Hung Hubert Tsai Liang-Kang Huang Ruslan Salakhutdinov SSL AI4TS 27 166 0 17 Mar 2017
SyntaxNet Models for the CoNLL 2017 Shared Task Chris Alberti D. Andor Ivan Bogatyy Michael Collins D. Gillick ... Mark Omernick Slav Petrov C. Thanapirom Zora Tung David J. Weiss 3DV 19 33 0 15 Mar 2017
All You Need is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks with Orthonormality and Modulation Di Xie Jiang Xiong Shiliang Pu 19 181 0 06 Mar 2017
Analyzing and Exploiting NARX Recurrent Neural Networks for Long-Term Dependencies R. DiPietro Christian Rupprecht Nassir Navab Gregory Hager 10 26 0 24 Feb 2017
Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks Chunjie Luo Jianfeng Zhan Lei Wang Qiang Yang 24 198 0 20 Feb 2017
Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models Sergey Ioffe BDL 16 537 0 10 Feb 2017
A Hybrid Convolutional Variational Autoencoder for Text Generation Stanislau Semeniuta Aliaksei Severyn Erhardt Barth 23 251 0 08 Feb 2017
Automatic Prediction of Discourse Connectives Eric Malmi Daniele Pighin Sebastian Krause Mikhail Kozhevnikov 21 20 0 03 Feb 2017
Memory Augmented Neural Networks with Wormhole Connections Çağlar Gülçehre A. Chandar Yoshua Bengio 18 63 0 30 Jan 2017
Universal representations:The missing link between faces, text, planktons, and cat breeds Hakan Bilen Andrea Vedaldi 38 147 0 25 Jan 2017
Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis Dmitry Ulyanov Andrea Vedaldi Victor Lempitsky OOD 10 789 0 09 Jan 2017
Continuous multilinguality with language vectors Robert Östling Jörg Tiedemann 14 80 0 22 Dec 2016
Few-Shot Object Recognition from Machine-Labeled Web Images Zhongwen Xu Linchao Zhu Yi Yang VLM 16 66 0 19 Dec 2016
An empirical analysis of the optimization of deep network loss surfaces Daniel Jiwoong Im Michael Tao K. Branson ODL 32 61 0 13 Dec 2016
Piecewise Latent Variables for Neural Variational Text Processing Iulian Serban Alexander Ororbia Joelle Pineau Aaron Courville DRL BDL 19 2 0 01 Dec 2016
Recurrent Memory Addressing for describing videos A. Jain Abhinav Agarwalla Kumar Krishna Agrawal Pabitra Mitra 38 10 0 20 Nov 2016
Normalizing the Normalizers: Comparing and Extending Network Normalization Schemes Mengye Ren Renjie Liao R. Urtasun Fabian H. Sinz R. Zemel 35 81 0 14 Nov 2016
Multi-task learning with deep model based reinforcement learning Asier Mujika 20 9 0 04 Nov 2016
Learning Continuous Semantic Representations of Symbolic Expressions Miltiadis Allamanis Pankajan Chanthirasegaran Pushmeet Kohli Charles Sutton CLL NAI 31 99 0 04 Nov 2016
Deep Convolutional Neural Network Design Patterns L. Smith Nicholay Topin AI4CE OOD 38 59 0 02 Nov 2016
Neural Machine Translation in Linear Time Nal Kalchbrenner L. Espeholt Karen Simonyan Aaron van den Oord Alex Graves Koray Kavukcuoglu AIMat 30 548 0 31 Oct 2016
Surprisal-Driven Zoneout K. Rocki Tomasz Kornuta Tegan Maharaj 21 8 0 24 Oct 2016
Using Fast Weights to Attend to the Recent Past Jimmy Ba Geoffrey E. Hinton Volodymyr Mnih Joel Z Leibo Catalin Ionescu 6 262 0 20 Oct 2016
Streaming Normalization: Towards Simpler and More Biologically-plausible Normalizations for Online and Recurrent Learning Q. Liao Kenji Kawaguchi T. Poggio 21 28 0 19 Oct 2016
End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answering Youngjae Yu Hyungjin Ko Jongwook Choi Gunhee Kim 14 230 0 10 Oct 2016
Deep Visual Foresight for Planning Robot Motion Chelsea Finn Sergey Levine 35 777 0 03 Oct 2016
Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updates S. Gu E. Holly Timothy Lillicrap Sergey Levine OffRL SSL 14 1,472 0 03 Oct 2016
HyperNetworks David R Ha Andrew M. Dai Quoc V. Le 84 1,585 0 27 Sep 2016
Geometry-Based Next Frame Prediction from Monocular Video R. Mahjourian Martin Wicke A. Angelova MDE 11 41 0 20 Sep 2016
Hierarchical Multiscale Recurrent Neural Networks Junyoung Chung Sungjin Ahn Yoshua Bengio BDL 31 534 0 06 Sep 2016
Dynamic Neural Turing Machine with Soft and Hard Addressing Schemes Çağlar Gülçehre A. Chandar Kyunghyun Cho Yoshua Bengio 14 64 0 30 Jun 2016
Tagger: Deep Unsupervised Perceptual Grouping Klaus Greff Antti Rasmus Mathias Berglund T. Hao Jürgen Schmidhuber Harri Valpola OCL 24 161 0 21 Jun 2016
Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations David M. Krueger Tegan Maharaj János Kramár Mohammad Pezeshki Nicolas Ballas Nan Rosemary Ke Anirudh Goyal Yoshua Bengio Aaron Courville C. Pal 10 317 0 03 Jun 2016
Backprop KF: Learning Discriminative Deterministic State Estimators Tuomas Haarnoja Anurag Ajay Sergey Levine Pieter Abbeel 17 201 0 23 May 2016