Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 7,527 papers shown

Title
MV-DETR: Multi-modality indoor object detection by Multi-View DEtecton TRansformers Zichao Dong Yilin Zhang Xufeng Huang Hang Ji Zhan Shi Xin Zhan Junbo Chen ViT 43 0 0 13 Aug 2024
FoVNet: Configurable Field-of-View Speech Enhancement with Low Computation and Distortion for Smart Glasses Zhongweiyang Xu Ali Aroudi Ke Tan Ashutosh Pandey Jung-Suk Lee Buye Xu Francesco Nesta 32 1 0 12 Aug 2024
Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencoder Leonardo Berti DRL 40 0 0 12 Aug 2024
A Sharpness Based Loss Function for Removing Out-of-Focus Blur Uditangshu Aurangabadkar D. Ramsook Anil C. Kokaram 29 1 0 12 Aug 2024
Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI Lei Zhou Yuzhong Zhang Jiadong Zhang Xuejun Qian Chen Gong ... Zhongxiang Ding Xing Wang Zhenhui Li Zaiyi Liu Dinggang Shen MedIm 38 5 0 11 Aug 2024
AI-driven Java Performance Testing: Balancing Result Quality with Testing Time Luca Traini Federico Di Menna Vittorio Cortellessa 34 4 0 09 Aug 2024
Pedestrian Motion Prediction Using Transformer-based Behavior Clustering and Data-Driven Reachability Analysis Kleio Fragkedaki Frank J. Jiang K. H. Johansson Jonas Mårtensson 27 0 0 09 Aug 2024
Ensemble everything everywhere: Multi-scale aggregation for adversarial robustness Stanislav Fort Balaji Lakshminarayanan OOD AAML 36 4 0 08 Aug 2024
Image-Feature Weak-to-Strong Consistency: An Enhanced Paradigm for Semi-Supervised Learning Zhiyu Wu Jinshi Cui 35 0 0 08 Aug 2024
Beyond Over-smoothing: Uncovering the Trainability Challenges in Deep Graph Neural Networks Jie Peng Runlin Lei Zhewei Wei 33 5 0 07 Aug 2024
Weakly Contrastive Learning via Batch Instance Discrimination and Feature Clustering for Small Sample SAR ATR Yikui Zhai Wenlve Zhou Bing Sun Jingwen Li Qirui Ke ... Junying Gan Chaoyun Mai R. D. Labati Vincenzo Piuri F. Scotti 35 19 0 07 Aug 2024
Focal Depth Estimation: A Calibration-Free, Subject- and Daytime Invariant Approach B. Hosp Björn Severitt R. Agarwala Evgenia Rusak Yannick Sauer Siegfried Wahl 33 1 0 07 Aug 2024
Effect of Kernel Size on CNN-Vision-Transformer-Based Gaze Prediction Using Electroencephalography Data Chuhui Qiu Bugao Liang Matthew L. Key 36 0 0 06 Aug 2024
Malicious Internet Entity Detection Using Local Graph Inference Šimon Mandlík Tomás Pevný Václav Smídl L. Bajer 32 1 0 06 Aug 2024
AMES: Asymmetric and Memory-Efficient Similarity Estimation for Instance-level Retrieval Pavel Suma Giorgos Kordopatis-Zilos Ahmet Iscen Giorgos Tolias VLM 45 3 0 06 Aug 2024
Masked Random Noise for Communication Efficient Federaetd Learning Shiwei Li Yingyi Cheng Haozhao Wang Xing Tang Shijie Xu Weihong Luo Yuhua Li Dugang Liu Xiuqiang He and Ruixuan Li FedML 53 1 0 06 Aug 2024
FedBAT: Communication-Efficient Federated Learning via Learnable Binarization Shiwei Li Wenchao Xu Haozhao Wang Xing Tang Tianzhe Xiao Shijie Xu Weihong Luo Yuhua Li Xiuqiang He Ruixuan Li FedML 38 2 0 06 Aug 2024
Fast Point Cloud Geometry Compression with Context-based Residual Coding and INR-based Refinement Hao Xu Xi Zhang Xiaolin Wu 3DPC 34 1 0 06 Aug 2024
Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network Xinyi Zhang Qiqi Bao Qinpeng Cui Wenming Yang Qingmin Liao 3DH Mamba 28 1 0 06 Aug 2024
GAReT: Cross-view Video Geolocalization with Adapters and Auto-Regressive Transformers Manu S. Pillai Mamshad Nayeem Rizve M. Shah 56 2 0 05 Aug 2024
Enhancing Heterogeneous Knowledge Graph Completion with a Novel GAT-based Approach Wanxu Wei Yitong Song Bin Yao 47 6 0 05 Aug 2024
Backward Compatibility in Attributive Explanation and Enhanced Model Training Method Ryuta Matsuno 46 0 0 05 Aug 2024
Unsupervised Domain Adaption Harnessing Vision-Language Pre-training Wenlve Zhou Zhiheng Zhou VLM 38 33 0 05 Aug 2024
Conditional LoRA Parameter Generation Aaron Mueller Millicent Li Koyena Pal Wangbo Zhao Yukun Zhou Jiuding Sun Yonatan Belinkov DiffM 41 4 0 02 Aug 2024
HAIGEN: Towards Human-AI Collaboration for Facilitating Creativity and Style Generation in Fashion Design Juzheng Zhang Di Wu Hanhui Deng Yidan Long Wenyi Tang Yongqiang Chen Can Liu Zhanpeng Jin Wenlei Zhang Tangquan Qi 40 9 0 01 Aug 2024
What comes after transformers? -- A selective survey connecting ideas in deep learning Johannes Schneider AI4CE 43 2 0 01 Aug 2024
A new approach for encoding code and assisting code understanding Mengdan Fan Changde Du Haiyan Zhao Zhi Jin 46 0 0 01 Aug 2024
TRGR: Transmissive RIS-aided Gait Recognition Through Walls Yunlong Huang Junshuo Liu Jianan Zhang Tiebin Mi Xin Shi Robert C. Qiu 50 0 0 31 Jul 2024
Force Sensing Guided Artery-Vein Segmentation via Sequential Ultrasound Images Yimeng Geng Gaofeng Meng Ya-Ting Chan Guanglin Cao Mingyang Zhao Jianbo Zhao Chiou-Ting Hsu 18 0 0 31 Jul 2024
Contrasting Deep Learning Models for Direct Respiratory Insufficiency Detection Versus Blood Oxygen Saturation Estimation M. Gauy Natalia Hitomi Koza Ricardo Mikio Morita Gabriel Rocha Stanzione Arnaldo Cândido Júnior L. Berti A. S. Levin E. Sabino F. Svartman Marcelo Finger 38 0 0 30 Jul 2024
dopanim: A Dataset of Doppelganger Animals with Noisy Annotations from Multiple Humans M. Herde Denis Huseljic Lukas Rauch Bernhard Sick 42 1 0 30 Jul 2024
Autonomous Improvement of Instruction Following Skills via Foundation Models Zhiyuan Zhou P. Atreya Abraham Lee Homer Walke Oier Mees Sergey Levine 34 11 0 30 Jul 2024
Unveiling the Potential of Spiking Dynamics in Graph Representation Learning through Spatial-Temporal Normalization and Coding Strategies M. Xu Huifeng Yin Yujie Wu Guoqi Li Faqiang Liu Jing Pei Shuai Zhong Lei Deng 42 0 0 30 Jul 2024
Machine learning surrogates for efficient hydrologic modeling: Insights from stochastic simulations of managed aquifer recharge Timothy Dai Kate Maher Z. Perzan 37 1 0 30 Jul 2024
UniTTA: Unified Benchmark and Versatile Framework Towards Realistic Test-Time Adaptation Chaoqun Du Yulin Wang Jiayi Guo Yizeng Han Jie Zhou Gao Huang TTA 43 0 0 29 Jul 2024
Octave-YOLO: Cross frequency detection network with octave convolution Sangjune Shin Dongkun Shin ObjD 40 0 0 29 Jul 2024
Generalization bounds for regression and classification on adaptive covering input domains Wen-Liang Hwang 31 0 0 29 Jul 2024
Competition-based Adaptive ReLU for Deep Neural Networks Junjia Chen Zhibin Pan 32 0 0 28 Jul 2024
Depth-Wise Convolutions in Vision Transformers for Efficient Training on Small Datasets Tianxiao Zhang Wenju Xu Bo Luo Guanghui Wang ViT MDE 40 7 0 28 Jul 2024
A spring-block theory of feature learning in deep neural networks Chengzhi Shi Liming Pan Ivan Dokmanić AI4CE 40 1 0 28 Jul 2024
The Impact of LoRA Adapters for LLMs on Clinical NLP Classification Under Data Limitations Thanh-Dung Le T. Nguyen Vu Nguyen Ha 34 0 0 27 Jul 2024
Alleviating Over-Smoothing via Aggregation over Compact Manifolds Dongzhuoran Zhou Hui Yang Bo Xiong Yue Ma Evgeny Kharlamov 46 0 0 27 Jul 2024
Deep Companion Learning: Enhancing Generalization Through Historical Consistency Ruizhao Zhu Venkatesh Saligrama FedML 40 0 0 26 Jul 2024
CodedVO: Coded Visual Odometry Sachin Shah Naitri Rajyaguru Chahat Deep Singh Christopher A. Metzler Yiannis Aloimonos 29 0 0 25 Jul 2024
Network Inversion of Convolutional Neural Nets Pirzada Suhail Amit Sethi 42 1 0 25 Jul 2024
Towards the Spectral bias Alleviation by Normalizations in Coordinate Networks Zhicheng Cai Hao Zhu Qiu Shen Xinran Wang Xun Cao 43 0 0 25 Jul 2024
Enhanced Deep Learning Methodologies and MRI Selection Techniques for Dementia Diagnosis in the Elderly Population Nikolaos Ntampakis Konstantinos Diamantaras Ioanna Chouvarda Vasileios Argyriou Panagiotis Sarigianndis 21 1 0 24 Jul 2024
Robust Deep Hawkes Process under Label Noise of Both Event and Occurrence Xiaoyu Tan Bin Li Xihe Qiu Jingjing Huang Yinghui Xu Wei Chu NoLa 31 0 0 24 Jul 2024
Low-Latency Privacy-Preserving Deep Learning Design via Secure MPC Ke Lin Yasir Glani Ping Luo 21 0 0 24 Jul 2024
Progressive Query Refinement Framework for Bird's-Eye-View Semantic Segmentation from Surrounding Images Dooseop Choi Jungyu Kang Taeghyun An Kyounghwan Ahn Kyoung‐Wook Min 31 0 0 24 Jul 2024