v1v2v3 (latest)

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Christian Szegedy

OOD

ArXiv (abs)PDF HTML

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 11,142 papers shown

Title
Data-Free Generative Replay for Class-Incremental Learning on Imbalanced Data Sohaib Younis Bernhard Seeger 70 0 0 07 Jun 2024
Optimizing Time Series Forecasting Architectures: A Hierarchical Neural Architecture Search Approach Difan Deng Marius Lindauer AI4TS 91 0 0 07 Jun 2024
L-SFAN: Lightweight Spatially-focused Attention Network for Pain Behavior Detection Jorge Ortigoso-Narro F. Díaz-de-María Mohammad Mahdi Dehshibi Ana Tajadura-Jiménez 72 2 0 07 Jun 2024
CTBENCH: A Library and Benchmark for Certified Training Yuhao Mao Stefan Balauca Martin Vechev OOD 133 5 0 07 Jun 2024
Concurrent Training and Layer Pruning of Deep Neural Networks Valentin Frank Ingmar Guenter Athanasios Sideris 3DPC 86 3 0 06 Jun 2024
Conv-INR: Convolutional Implicit Neural Representation for Multimodal Visual Signals Zhicheng Cai 88 0 0 06 Jun 2024
Encoding Semantic Priors into the Weights of Implicit Neural Representation Zhicheng Cai Qiu Shen 91 0 0 06 Jun 2024
Quantum Implicit Neural Representations Jiaming Zhao Wenbo Qiao Peng Zhang Hui Gao 86 4 0 06 Jun 2024
1-D CNN-Based Online Signature Verification with Federated Learning Lingfeng Zhang Yuheng Guo Yepeng Ding Hiroyuki Sato FedML 25 1 0 06 Jun 2024
Quantifying Task Priority for Multi-Task Optimization Wooseong Jeong Kuk-Jin Yoon 83 4 0 05 Jun 2024
U-KAN Makes Strong Backbone for Medical Image Segmentation and Generation Chenxin Li Xinyu Liu Wenbo Li Cheng Wang Hengyu Liu Yifan Liu Zhen Chen Yixuan Yuan MedIm DiffM SSeg 143 143 0 05 Jun 2024
Residual Connections and Normalization Can Provably Prevent Oversmoothing in GNNs Michael Scholkemper Xinyi Wu Ali Jadbabaie Michael T. Schaub 221 9 0 05 Jun 2024
Textless Acoustic Model with Self-Supervised Distillation for Noise-Robust Expressive Speech-to-Speech Translation Min-Jae Hwang Ilia Kulikov Benjamin Peloquin Hongyu Gong Peng-Jen Chen Ann Lee 63 3 0 04 Jun 2024
GenS: Generalizable Neural Surface Reconstruction from Multi-View Images Rui Peng Xiaodong Gu Luyang Tang Shihe Shen F. Yu Ronggang Wang 3DGS 3DV 92 12 0 04 Jun 2024
Using Explainable AI for EEG-based Reduced Montage Neonatal Seizure Detection Dinuka Sandun Udayantha Kavindu Weerasinghe Nima Wickramasinghe Akila Abeyratne Kithmin Wickremasinghe J. Wanigasinghe Anjula De Silva Chamira U. S. Edussooriya 69 2 0 04 Jun 2024
Improving Generalization in Aerial and Terrestrial Mobile Robots Control Through Delayed Policy Learning Ricardo B. Grando Raul Steinmetz V. A. Kich A. H. Kolling Pablo M. Furik J. C. Jesus Bruna V. Guterres D. T. Gamarra R. S. Guerra Paulo L. J. Drews-Jr 92 5 0 04 Jun 2024
Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation Madison Cooley Shandian Zhe Robert M. Kirby Varun Shankar 204 1 0 04 Jun 2024
SAM as the Guide: Mastering Pseudo-Label Refinement in Semi-Supervised Referring Expression Segmentation Danni Yang Jiayi Ji Yiwei Ma Tianyu Guo Haowei Wang Xiaoshuai Sun Rongrong Ji ISeg VLM 95 6 0 03 Jun 2024
Compute-Efficient Medical Image Classification with Softmax-Free Transformers and Sequence Normalization Firas Khader Omar S. M. El Nahhas T. Han Gustav Muller-Franzes S. Nebelung Jakob Nikolas Kather Daniel Truhn MedIm 87 0 0 03 Jun 2024
On the Nonlinearity of Layer Normalization Yunhao Ni Yuxin Guo Junlong Jia Lei Huang 163 5 0 03 Jun 2024
A hybrid numerical methodology coupling Reduced Order Modeling and Graph Neural Networks for non-parametric geometries: applications to structural dynamics problems Victor Matray Faisal Amlani Frédéric Feyel David Néron AI4CE 91 5 0 03 Jun 2024
TE-NeXt: A LiDAR-Based 3D Sparse Convolutional Network for Traversability Estimation Antonio Santo J. J. Cabrera David Valiente C. Viegas Arturo Gil 3DPC 3DV 93 2 0 03 Jun 2024
Phonetic Error Analysis of Raw Waveform Acoustic Models with Parametric and Non-Parametric CNNs Erfan Loweimi Andrea Carmantini Peter Bell Steve Renals Zoran Cvetkovic 53 0 0 02 Jun 2024
An Unsupervised Approach for Periodic Source Detection in Time Series B. U. Demirel Christian Holz AI4TS 71 1 0 01 Jun 2024
Audio-Visual Talker Localization in Video for Spatial Sound Reproduction Davide Berghi Philip J. B. Jackson 78 0 0 01 Jun 2024
Pedestrian intention prediction in Adverse Weather Conditions with Spiking Neural Networks and Dynamic Vision Sensors Mustafa Sakhai Szymon Mazurek Jakub Caputa Jan K. Argasiñski Maciej Wielgosz 82 3 0 01 Jun 2024
Benchmarking for Deep Uplift Modeling in Online Marketing Dugang Liu Xing Tang Yang Qiao Miao Liu Zexu Sun Xiuqiang He Zhong Ming 69 1 0 01 Jun 2024
Image Captioning via Dynamic Path Customization Yiwei Ma Jiayi Ji Xiaoshuai Sun Yiyi Zhou Xiaopeng Hong Yongjian Wu Rongrong Ji 77 0 0 01 Jun 2024
Recurrent neural networks: vanishing and exploding gradients are not the end of the story Nicolas Zucchet Antonio Orvieto ODL AAML 114 17 0 31 May 2024
MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses Saif Mahmud Devansh Agarwal Ashwin Ajit Qikang Liang Thalia Viranda François Guimbretière Cheng Zhang 89 2 0 31 May 2024
Predicting ptychography probe positions using single-shot phase retrieval neural network Ming Du Tao Zhou Junjing Deng Daniel J. Ching S. Henke Mathew J. Cherukara 79 1 0 31 May 2024
MALT: Multi-scale Action Learning Transformer for Online Action Detection Zhipeng Yang Ruoyu Wang Yang Tan Liping Xie OffRL 77 1 0 31 May 2024
BackdoorIndicator: Leveraging OOD Data for Proactive Backdoor Detection in Federated Learning Songze Li Yanbo Dai AAML FedML 103 7 0 31 May 2024
Diffusion Models Are Innate One-Step Generators Bowen Zheng Tianming Yang DiffM VLM 75 13 0 31 May 2024
Mitigating the Impact of Labeling Errors on Training via Rockafellian Relaxation Louis L. Chen Bobbie Chern Eric Eckstrand Amogh Mahapatra J. Royset 33 0 0 30 May 2024
Domain Adaptation with Cauchy-Schwarz Divergence Wenzhe Yin Shujian Yu Yicong Lin Jie Li Jan-Jakob Sonke E. Gavves 94 4 0 30 May 2024
STAT: Shrinking Transformers After Training Megan Flynn Alexander Wang Dean Edward Alvarez Christopher De Sa Anil Damle 79 2 0 29 May 2024
Understanding and Minimising Outlier Features in Neural Network Training Bobby He Lorenzo Noci Daniele Paliotta Imanol Schlag Thomas Hofmann 89 4 0 29 May 2024
On the Condition Monitoring of Bolted Joints through Acoustic Emission and Deep Transfer Learning: Generalization, Ordinal Loss and Super-Convergence Emmanuel Ramasso Rafael Teloli Romain Marcel 45 3 0 29 May 2024
On the Limits of Multi-modal Meta-Learning with Auxiliary Task Modulation Using Conditional Batch Normalization Jordi Armengol-Estapé Vincent Michalski Ramnath Kumar P. St-Charles Doina Precup Samira Ebrahimi Kahou 141 0 0 29 May 2024
Rejection via Learning Density Ratios Alexander Soen Hisham Husain Philip Schulz Vu-Linh Nguyen 135 2 0 29 May 2024
Edge-guided and Class-balanced Active Learning for Semantic Segmentation of Aerial Images Lianlei Shan Weiqiang Wang Ke Lv Bin Luo VLM 128 1 0 28 May 2024
2BP: 2-Stage Backpropagation Christopher Rae Joseph K. L. Lee James Richings MoE MQ 52 0 0 28 May 2024
$C^2M^3$ : Cycle-Consistent Multi-Model Merging Donato Crisostomi Marco Fumero Daniele Baieri F. Bernard Emanuele Rodolà MoMe 101 10 0 28 May 2024
SelMatch: Effectively Scaling Up Dataset Distillation via Selection-Based Initialization and Partial Updates by Trajectory Matching Yongmin Lee Hye Won Chung 119 9 0 28 May 2024
The Binary Quantized Neural Network for Dense Prediction via Specially Designed Upsampling and Attention Xingyu Ding Li Shan Guiqin Zhao Meiqi Wu Wenzhang Zhou Wei Li MQ 71 1 0 28 May 2024
Deep Feature Gaussian Processes for Single-Scene Aerosol Optical Depth Reconstruction Shengjie Liu Lu Zhang 34 2 0 27 May 2024
Supervised Batch Normalization Bilal Faye M. Lebbah Hanane Azzag 32 1 0 27 May 2024
High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost Jiakui Hu Man Yao Xuerui Qiu Yuhong Chou Yuxuan Cai Ning Qiao Yonghong Tian Boxing Xu Guoqi Li AI4CE 68 13 0 26 May 2024
AdaFisher: Adaptive Second Order Optimization via Fisher Information Damien Martins Gomes Yanlei Zhang Eugene Belilovsky Guy Wolf Mahdi S. Hosseini ODL 216 3 0 26 May 2024