Beyond Skip Connection: Pooling and Unpooling Design for Elimination Singularities

20 September 2024

Chengkun Sun

Jinqian Pan

Juoli Jin

Russell Stevens Terry

Jiang Bian

Jie Xu

ArXiv (abs)PDF HTML

Papers citing "Beyond Skip Connection: Pooling and Unpooling Design for Elimination Singularities"

26 / 26 papers shown

Title
Learning to Upsample by Learning to Sample Wenze Liu Hao Lu Hongtao Fu Zhiguo Cao SyDa 67 157 0 29 Aug 2023
Escaping the Big Data Paradigm with Compact Transformers Ali Hassani Steven Walton Nikhil Shah Abulikemu Abuduweili Jiachen Li Humphrey Shi 120 463 0 12 Apr 2021
CvT: Introducing Convolutions to Vision Transformers Haiping Wu Bin Xiao Noel Codella Mengchen Liu Xiyang Dai Lu Yuan Lei Zhang ViT 154 1,917 0 29 Mar 2021
Revisiting ResNets: Improved Training and Scaling Strategies Irwan Bello W. Fedus Xianzhi Du E. D. Cubuk A. Srinivas Nayeon Lee Jonathon Shlens Barret Zoph 87 301 0 13 Mar 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 670 41,430 0 22 Oct 2020
Pooling Methods in Deep Neural Networks, a Review Hossein Gholamalinezhad H. Khosravi 200 224 0 16 Sep 2020
Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy Stanislav Nikolov Sam Blackwell Alexei Zverovitch R. Mendes Michelle Livne ... Mustafa Suleyman T. Back Ricky A. Sharma J. Ledsam Olaf Ronneberger 135 298 0 12 Sep 2018
CBAM: Convolutional Block Attention Module Sanghyun Woo Jongchan Park Joon-Young Lee In So Kweon 227 16,598 0 17 Jul 2018
Pooling is neither necessary nor sufficient for appropriate deformation stability in CNNs Avraham Ruderman Neil C. Rabinowitz Ari S. Morcos Daniel Zoran 85 41 0 12 Apr 2018
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation Liang-Chieh Chen Yukun Zhu George Papandreou Florian Schroff Hartwig Adam SSeg 480 13,178 0 07 Feb 2018
MobileNetV2: Inverted Residuals and Linear Bottlenecks Mark Sandler Andrew G. Howard Menglong Zhu A. Zhmoginov Liang-Chieh Chen 204 19,333 0 13 Jan 2018
Improved Regularization of Convolutional Neural Networks with Cutout Terrance Devries Graham W. Taylor 129 3,774 0 15 Aug 2017
Rethinking Atrous Convolution for Semantic Image Segmentation Liang-Chieh Chen George Papandreou Florian Schroff Hartwig Adam SSeg 234 8,488 0 17 Jun 2017
Deep Learning for Medical Image Processing: Overview, Challenges and Future M. I. Razzak S. Naz Ahmad Zaib 54 1,011 0 22 Apr 2017
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 1.2K 20,892 0 17 Apr 2017
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation Fausto Milletari Nassir Navab Seyed-Ahmad Ahmadi 240 8,716 0 15 Jun 2016
The Cityscapes Dataset for Semantic Urban Scene Understanding Marius Cordts Mohamed Omran Sebastian Ramos Timo Rehfeld Markus Enzweiler Rodrigo Benenson Uwe Franke Stefan Roth Bernt Schiele 1.1K 11,644 0 06 Apr 2016
A guide to convolution arithmetic for deep learning Vincent Dumoulin Francesco Visin FAtt 3DH HAI 66 1,544 0 23 Mar 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 354 10,196 0 16 Mar 2016
You Only Look Once: Unified, Real-Time Object Detection Joseph Redmon S. Divvala Ross B. Girshick Ali Farhadi ObjD 721 37,020 0 08 Jun 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.9K 77,378 0 18 May 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 465 43,341 0 11 Feb 2015
Striving for Simplicity: The All Convolutional Net Jost Tobias Springenberg Alexey Dosovitskiy Thomas Brox Martin Riedmiller FAtt 251 4,681 0 21 Dec 2014
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 488 43,694 0 17 Sep 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.7K 100,508 0 04 Sep 2014
Visualizing and Understanding Convolutional Networks Matthew D. Zeiler Rob Fergus FAtt SSL 595 15,904 0 12 Nov 2013