Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations

3 June 2016

Aaron Courville

Papers citing "Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations"

23 / 73 papers shown

Title
Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batches Yeming Wen Paul Vicol Jimmy Ba Dustin Tran Roger C. Grosse BDL 22 307 0 12 Mar 2018
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 42 4,724 0 04 Mar 2018
Scalable and accurate deep learning for electronic health records A. Rajkomar Eyal Oren Kai Chen Andrew M. Dai Nissan Hajaj ... A. Butte M. Howell Claire Cui Greg S. Corrado Jeffrey Dean OOD BDL 44 2,110 0 24 Jan 2018
Recent Advances in Recurrent Neural Networks Hojjat Salehinejad Sharan Sankar Joseph Barfett E. Colak S. Valaee AI4TS 30 574 0 29 Dec 2017
Neural Language Modeling by Jointly Learning Syntax and Lexicon Songlin Yang Zhouhan Lin Chin-Wei Huang Aaron Courville 43 178 0 02 Nov 2017
Dilated Recurrent Neural Networks Shiyu Chang Yang Zhang Wei Han Mo Yu Xiaoxiao Guo Wei Tan Xiaodong Cui Michael Witbrock M. Hasegawa-Johnson Thomas S. Huang 47 298 0 05 Oct 2017
Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks Victor Campos Brendan Jou Xavier Giró-i-Nieto Jordi Torres Shih-Fu Chang 21 217 0 22 Aug 2017
Regularizing and Optimizing LSTM Language Models Stephen Merity N. Keskar R. Socher 86 1,091 0 07 Aug 2017
Revisiting Activation Regularization for Language RNNs Stephen Merity Bryan McCann R. Socher 33 44 0 03 Aug 2017
Fast-Slow Recurrent Neural Networks Asier Mujika Florian Meier Angelika Steger 22 76 0 24 May 2017
Snapshot Ensembles: Train 1, get M for free Gao Huang Yixuan Li Geoff Pleiss Zhuang Liu J. Hopcroft Kilian Q. Weinberger OOD FedML UQCV 47 935 0 01 Apr 2017
Areas of Attention for Image Captioning M. Pedersoli Thomas Lucas Cordelia Schmid Jakob Verbeek 33 205 0 03 Dec 2016
Quasi-Recurrent Neural Networks James Bradbury Stephen Merity Caiming Xiong R. Socher 44 437 0 05 Nov 2016
Surprisal-Driven Zoneout K. Rocki Tomasz Kornuta Tegan Maharaj 29 8 0 24 Oct 2016
HyperNetworks David R Ha Andrew M. Dai Quoc V. Le 84 1,589 0 27 Sep 2016
Multiplicative LSTM for sequence modelling Ben Krause Liang Lu Iain Murray Steve Renals 35 208 0 26 Sep 2016
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 41 2,730 0 26 Sep 2016
Hierarchical Multiscale Recurrent Neural Networks Junyoung Chung Sungjin Ahn Yoshua Bengio BDL 40 534 0 06 Sep 2016
Dynamic Neural Turing Machine with Soft and Hard Addressing Schemes Çağlar Gülçehre A. Chandar Kyunghyun Cho Yoshua Bengio 20 64 0 30 Jun 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 93 4,885 0 27 Jun 2016
Swapout: Learning an ensemble of deep architectures Saurabh Singh Derek Hoiem David A. Forsyth BDL 3DPC OOD UQCV 21 150 0 20 May 2016
Recurrent Batch Normalization Tim Cooijmans Nicolas Ballas César Laurent Çağlar Gülçehre Aaron Courville ODL 19 410 0 30 Mar 2016
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,639 0 03 Jul 2012