Deep Neural Networks with Short Circuits for Improved Gradient Learning

Deep Neural Networks with Short Circuits for Improved Gradient Learning

23 September 2020

Papers citing "Deep Neural Networks with Short Circuits for Improved Gradient Learning"

11 / 11 papers shown

Title
Gradient Amplification: An efficient way to train deep neural networks S. Basodi Chunyan Ji Haiping Zhang Yi Pan ODL 33 115 0 16 Jun 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 243 1,202 0 24 Dec 2019
MMM: Multi-stage Multi-task Learning for Multi-choice Reading Comprehension Di Jin Shuyang Gao Jiun-Yu Kao Tagyoung Chung Dilek Z. Hakkani-Tür 58 69 0 01 Oct 2019
FreeLB: Enhanced Adversarial Training for Natural Language Understanding Chen Zhu Yu Cheng Zhe Gan S. Sun Tom Goldstein Jingjing Liu AAML 255 441 0 25 Sep 2019
A Co-Matching Model for Multi-choice Reading Comprehension Shuohang Wang Mo Yu Shiyu Chang Jing Jiang 41 92 0 11 Jun 2018
Massive Exploration of Neural Machine Translation Architectures D. Britz Anna Goldie Minh-Thang Luong Quoc V. Le 61 519 0 11 Mar 2017
Gate-Variants of Gated Recurrent Unit (GRU) Neural Networks Rahul Dey F. Salem 91 1,395 0 20 Jan 2017
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 263 5,517 0 23 Nov 2015
Training Very Deep Networks R. Srivastava Klaus Greff Jürgen Schmidhuber 119 1,677 0 22 Jul 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 268 18,583 0 06 Feb 2015
Visualizing and Understanding Convolutional Networks Matthew D. Zeiler Rob Fergus FAtt SSL 436 15,861 0 12 Nov 2013