Residual Networks Behave Like Ensembles of Relatively Shallow Networks

Residual Networks Behave Like Ensembles of Relatively Shallow Networks

20 May 2016

Michael J. Wilber

Serge J. Belongie

Papers citing "Residual Networks Behave Like Ensembles of Relatively Shallow Networks"

18 / 18 papers shown

Title
Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers Jason Phang Haokun Liu Samuel R. Bowman 30 25 0 17 Sep 2021
Fast and Accurate Person Re-Identification with RMNet Evgeny Izutov 3DH 32 6 0 06 Dec 2018
Real-time Semantic Image Segmentation via Spatial Sparsity Zifeng Wu Chunhua Shen Anton Van Den Hengel SSeg 39 64 0 01 Dec 2017
MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Network Zizhao Zhang Yuanpu Xie Fuyong Xing M. McGough L. Yang MedIm 13 301 0 08 Jul 2017
On the Compactness, Efficiency, and Representation of 3D Convolutional Networks: Brain Parcellation as a Pretext Task Wenqi Li Guotai Wang Lucas Fidon Sebastien Ourselin M. Jorge Cardoso Tom Kamiel Magda Vercauteren 3DV 21 337 0 06 Jul 2017
Network Sketching: Exploiting Binary Structure in Deep CNNs Yiwen Guo Anbang Yao Hao Zhao Yurong Chen MQ 29 95 0 07 Jun 2017
DiracNets: Training Very Deep Neural Networks Without Skip-Connections Sergey Zagoruyko N. Komodakis UQCV OOD 11 117 0 01 Jun 2017
Superhuman Accuracy on the SNEMI3D Connectomics Challenge Kisuk Lee J. Zung Peter H. Li Viren Jain H. S. Seung 3DV 17 266 0 31 May 2017
The Relative Performance of Ensemble Methods with Deep Convolutional Neural Networks for Image Classification Cheng Ju Aurélien F. Bibaut Mark van der Laan UQCV 14 356 0 05 Apr 2017
All You Need is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks with Orthonormality and Modulation Di Xie Jiang Xiong Shiliang Pu 19 181 0 06 Mar 2017
Highway and Residual Networks learn Unrolled Iterative Estimation Klaus Greff R. Srivastava Jürgen Schmidhuber AI4TS 23 214 0 22 Dec 2016
The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation S. Jégou M. Drozdzal David Vazquez Adriana Romero Yoshua Bengio SSeg 23 1,573 0 28 Nov 2016
PolyNet: A Pursuit of Structural Diversity in Very Deep Networks Xingcheng Zhang Zhizhong Li Chen Change Loy Dahua Lin MDE 30 259 0 17 Nov 2016
Hard-Aware Deeply Cascaded Embedding Yuhui Yuan Kuiyuan Yang Chao Zhang 30 300 0 17 Nov 2016
Master's Thesis : Deep Learning for Visual Recognition Rémi Cadène Nicolas Thome Matthieu Cord 37 4 0 18 Oct 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 69 4,865 0 27 Jun 2016
Robust Large Margin Deep Neural Networks Jure Sokolić Raja Giryes Guillermo Sapiro M. Rodrigues 26 307 0 26 May 2016
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 266 7,636 0 03 Jul 2012