Rethinking Skip Connection with Layer Normalization in Transformers and
ResNets

Rethinking Skip Connection with Layer Normalization in Transformers and ResNets

15 May 2021

Xuancheng Ren

Yuexian Zou

Papers citing "Rethinking Skip Connection with Layer Normalization in Transformers and ResNets"

13 / 13 papers shown

Title
Federated Learning with Flexible Architectures Jong-Ik Park Carlee Joe-Wong FedML 45 3 0 14 Jun 2024
Exploring the Efficacy of Group-Normalization in Deep Learning Models for Alzheimer's Disease Classification Gousia Habib Ishfaq Ahmed Malik Jameel Ahmad Imtiaz Ahmed Shaima Qureshi 36 0 0 01 Apr 2024
Multimodal Prompt Learning for Product Title Generation with Extremely Limited Labels Bang-ju Yang Fenglin Liu Zheng Li Qingyu Yin Chenyu You Bing Yin Yuexian Zou VLM 36 5 0 05 Jul 2023
Subject-Independent Classification of Brain Signals using Skip Connections Soowon Kim Ji-Won Lee Young-Eun Lee Seo-Hyun Lee 19 0 0 19 Jan 2023
Prophet Attention: Predicting Attention with Future Attention for Image Captioning Fenglin Liu Xuancheng Ren Xian Wu Wei Fan Yuexian Zou Xu Sun 29 46 0 19 Oct 2022
Rethinking skip connection model as a learnable Markov chain Dengsheng Chen Jie Hu Wenwen Qiang Xiaoming Wei Enhua Wu BDL 27 1 0 30 Sep 2022
A Secure and Efficient Data Deduplication Scheme with Dynamic Ownership Management in Cloud Computing Xuewei Ma Wenyuan Yang Yuesheng Zhu Zhiqiang Bai 32 5 0 18 Aug 2022
Graph-in-Graph Network for Automatic Gene Ontology Description Generation Fenglin Liu Bang-ju Yang Chenyu You Xian Wu Shen Ge Adelaide Woicik Sheng Wang GNN 44 4 0 10 Jun 2022
Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generation Fenglin Liu Chenyu You Xian Wu Shen Ge Sheng Wang Xu Sun MedIm 81 92 0 08 Nov 2021
MISSFormer: An Effective Medical Image Segmentation Transformer Xiaohong Huang Zhifang Deng Dandan Li Xueguang Yuan ViT MedIm 98 174 0 15 Sep 2021
Incorporating Residual and Normalization Layers into Analysis of Masked Language Models Goro Kobayashi Tatsuki Kuribayashi Sho Yokoi Kentaro Inui 160 46 0 15 Sep 2021
VOLO: Vision Outlooker for Visual Recognition Li-xin Yuan Qibin Hou Zihang Jiang Jiashi Feng Shuicheng Yan ViT 52 315 0 24 Jun 2021
simNet: Stepwise Image-Topic Merging Network for Generating Detailed and Comprehensive Image Captions Fenglin Liu Xuancheng Ren Yuanxin Liu Houfeng Wang Xu Sun 98 65 0 27 Aug 2018