How Much Position Information Do Convolutional Neural Networks Encode?

22 January 2020

Papers citing "How Much Position Information Do Convolutional Neural Networks Encode?"

50 / 51 papers shown

Title
A Comparative Study on Positional Encoding for Time-frequency Domain Dual-path Transformer-based Source Separation Models Kohei Saijo Tetsuji Ogawa 47 1 0 28 Apr 2025
Exploring Position Encoding in Diffusion U-Net for Training-free High-resolution Image Generation Feng Zhou Pu Cao Yiyang Ma Lu Yang Jianqin Yin DiffM 46 0 0 12 Mar 2025
Advancing General Multimodal Capability of Vision-language Models with Pyramid-descent Visual Position Encoding Z. Chen Mingxiao Li Z. Chen Nan Du Xiaolong Li Yuexian Zou 53 0 0 19 Jan 2025
SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers Enze Xie Junsong Chen Junyu Chen Han Cai Haotian Tang ... Zhekai Zhang Muyang Li Ligeng Zhu Y. Lu Song Han VLM 34 49 0 14 Oct 2024
Improving FHB Screening in Wheat Breeding Using an Efficient Transformer Model Babak Azad A. Abdalla Kwanghee Won A. M. Nafchi MedIm 16 2 0 07 Aug 2023
MLIC++: Linear Complexity Multi-Reference Entropy Modeling for Learned Image Compression Wei Jiang Jiayu Yang Yongqi Zhai Feng Gao Ronggang Wang 39 32 0 28 Jul 2023
Inductive biases in deep learning models for weather prediction Jannik Thümmel Matthias Karlbauer S. Otte C. Zarfl Georg Martius ... Thomas Scholten Ulrich Friedrich V. Wulfmeyer B. Goswami Martin Volker Butz AI4CE 33 5 0 06 Apr 2023
Sequential Spatial Network for Collision Avoidance in Autonomous Driving Haichuan Li Liguo Zhou Zhenshan Bing M. Khatun Rolf Jung Alois C. Knoll 8 1 0 12 Mar 2023
Spatially Covariant Lesion Segmentation Hang Zhang Rongguang Wang Jinwei Zhang Dongdong Liu Chao Li Jiahao Nick Li MedIm 37 7 0 19 Jan 2023
Multi Kernel Positional Embedding ConvNeXt for Polyp Segmentation Trong-Hieu Nguyen-Mau Quoc-Huy Trinh Nhat-Tan Bui M. Tran Hai-Dang Nguyen MedIm 19 8 0 17 Jan 2023
Image-based Artificial Intelligence empowered surrogate model and shape morpher for real-time blank shape optimisation in the hot stamping process Hao Zhou Nan Li AI4CE 29 1 0 01 Dec 2022
QuadFormer: Quadruple Transformer for Unsupervised Domain Adaptation in Power Line Segmentation of Aerial Images P. Rao Feng Qiao Weide Zhang Yiliang Xu Yong Deng Guangbin Wu Qiang Zhang 29 8 0 29 Nov 2022
ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors Chenjie Cao Qiaole Dong Yanwei Fu 33 30 0 12 Oct 2022
MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depth Chenjie Cao Xinlin Ren Yanwei Fu 22 44 0 04 Aug 2022
Defect Transformer: An Efficient Hybrid Transformer Architecture for Surface Defect Detection Junpu Wang Guili Xu Fuju Yan Jinjin Wang Zhengsheng Wang ViT MedIm 21 65 0 17 Jul 2022
A graph-transformer for whole slide image classification Yi Zheng R. Gindra Emily J. Green E. Burks Margrit Betke J. Beane V. Kolachalama MedIm 34 121 0 19 May 2022
Distilling Inter-Class Distance for Semantic Segmentation Zheng Zhang Chunluan Zhou Zhigang Tu VLM 32 26 0 07 May 2022
Deeper Insights into the Robustness of ViTs towards Common Corruptions Rui Tian Zuxuan Wu Qi Dai Han Hu Yu-Gang Jiang ViT AAML 16 4 0 26 Apr 2022
$Cylin-Painting: Seamless {360\textdegree} Panoramic Image Outpainting and Beyond$ Cylin-Painting: Seamless {360\textdegree} Panoramic Image Outpainting and Beyond K. Liao Xiangyu Xu Chunyu Lin Wenqi Ren Yunchao Wei Yao Zhao 36 8 0 18 Apr 2022
Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer Songwei Ge Thomas Hayes Harry Yang Xiaoyue Yin Guan Pang David Jacobs Jia-Bin Huang Devi Parikh ViT 43 214 0 07 Apr 2022
Lane detection with Position Embedding Jun Xie Jiacheng Han Dezhen Qi F. Chen Kaer Huang Jia Shuai 20 4 0 23 Mar 2022
ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer Rui Yang Hailong Ma Jie Wu Yansong Tang Xuefeng Xiao Min Zheng Xiu Li ViT 19 53 0 21 Mar 2022
Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding Qiaole Dong Chenjie Cao Yanwei Fu CLL 20 138 0 02 Mar 2022
UniFormer: Unified Transformer for Efficient Spatiotemporal Representation Learning Kunchang Li Yali Wang Peng Gao Guanglu Song Yu Liu Hongsheng Li Yu Qiao ViT 31 238 0 12 Jan 2022
MPViT: Multi-Path Vision Transformer for Dense Prediction Youngwan Lee Jonghee Kim Jeffrey Willette Sung Ju Hwang ViT 27 244 0 21 Dec 2021
Autoencoder-based background reconstruction and foreground segmentation with background noise estimation Bruno Sauvalle A. de La Fortelle 13 12 0 15 Dec 2021
DualFormer: Local-Global Stratified Transformer for Efficient Video Recognition Yuxuan Liang Pan Zhou Roger Zimmermann Shuicheng Yan ViT 21 21 0 09 Dec 2021
MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection Rui Dai Srijan Das Kumara Kahatapitiya Michael S. Ryoo F. Brémond ViT 36 73 0 07 Dec 2021
A Survey of Visual Transformers Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Zhongchao Shi Jianping Fan Zhiqiang He 3DGS ViT 69 330 0 11 Nov 2021
UniNet: Unified Architecture Search with Convolution, Transformer, and MLP Jihao Liu Hongsheng Li Guanglu Song Xin Huang Yu Liu ViT 29 35 0 08 Oct 2021
Style Equalization: Unsupervised Learning of Controllable Generative Sequence Models Jen-Hao Rick Chang A. Shrivastava H. Koppula Xiaoshuai Zhang Oncel Tuzel DiffM 46 16 0 06 Oct 2021
Ripple Attention for Visual Perception with Sub-quadratic Complexity Lin Zheng Huijie Pan Lingpeng Kong 21 3 0 06 Oct 2021
Toward Spatially Unbiased Generative Models Jooyoung Choi Jungbeom Lee Yonghyun Jeong Sungroh Yoon DiffM 30 17 0 03 Aug 2021
Multi-Scale Local-Temporal Similarity Fusion for Continuous Sign Language Recognition Pan Xie Zhi Cui Yao Du Mengyi Zhao Jianwei Cui Bin Wang Xiaohui Hu SLR 18 32 0 27 Jul 2021
PVT v2: Improved Baselines with Pyramid Vision Transformer Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT AI4TS 13 1,606 0 25 Jun 2021
Alias-Free Generative Adversarial Networks Tero Karras M. Aittala S. Laine Erik Härkönen Janne Hellsten J. Lehtinen Timo Aila GAN 58 1,559 0 23 Jun 2021
Improved Padding in CNNs for Quantitative Susceptibility Mapping Juan Liu 13 2 0 21 Jun 2021
A Survey of Transformers Tianyang Lin Yuxin Wang Xiangyang Liu Xipeng Qiu ViT 27 1,086 0 08 Jun 2021
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers Enze Xie Wenhai Wang Zhiding Yu Anima Anandkumar J. Álvarez Ping Luo ViT 12 4,827 0 31 May 2021
ResT: An Efficient Transformer for Visual Recognition Qing-Long Zhang Yubin Yang ViT 16 229 0 28 May 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 36 2,163 0 20 Apr 2021
PLADE-Net: Towards Pixel-Level Accuracy for Self-Supervised Single-View Depth Estimation with Neural Positional Encoding and Distilled Matting Loss J. P. Bello Munchurl Kim 3DV MDE 30 47 0 12 Mar 2021
Spatial Attention Point Network for Deep-learning-based Robust Autonomous Robot Motion Generation Hideyuki Ichiwara Hiroshi Ito Kenjiro Yamamoto Hiroki Mori T. Ogata 3DPC 15 12 0 02 Mar 2021
Positional Encoding as Spatial Inductive Bias in GANs Rui Xu Xintao Wang Kai-xiang Chen Bolei Zhou Chen Change Loy GAN 27 89 0 09 Dec 2020
Truly shift-invariant convolutional neural networks Anadi Chaman Ivan Dokmanić 20 68 0 28 Nov 2020
Shift Equivariance in Object Detection M. Manfredi Yu Wang ObjD 11 18 0 13 Aug 2020
What shapes feature representations? Exploring datasets, architectures, and training Katherine L. Hermann Andrew Kyle Lampinen OOD 21 153 0 22 Jun 2020
A Comprehensive Study of Data Augmentation Strategies for Prostate Cancer Detection in Diffusion-weighted MRI using Convolutional Neural Networks Ruqian Hao Khashayar Namdar Lin Liu M. Haider Farzad Khalvati MedIm 13 57 0 01 Jun 2020
On Translation Invariance in CNNs: Convolutional Layers can Exploit Absolute Spatial Location O. Kayhan J. C. V. Gemert 209 232 0 16 Mar 2020
Do CNNs Encode Data Augmentations? Eddie Q. Yan Yanping Huang OOD 11 5 0 29 Feb 2020