v1v2v3 (latest)

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Christian Szegedy

OOD

ArXiv (abs)PDF HTML

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 11,282 papers shown

Title
The Cascaded Forward Algorithm for Neural Network Training Gongpei Zhao Tao Wang Yidong Li Yi Jin Congyan Lang Haibin Ling 61 16 0 17 Mar 2023
SUD $^2$ : Supervision by Denoising Diffusion Models for Image Reconstruction Matthew A. Chan Sean I. Young Christopher A. Metzler DiffM 60 5 0 16 Mar 2023
Tackling Clutter in Radar Data -- Label Generation and Detection Using PointNet++ Johannes Kopp Dominik Kellner Aldi Piroli Klaus C. J. Dietmayer 76 11 0 16 Mar 2023
All4One: Symbiotic Neighbour Contrastive Learning via Self-Attention and Redundancy Reduction Imanol G. Estepa Ignacio Sarasúa Bhalaji Nagarajan Petia Radeva SSL 90 9 0 16 Mar 2023
Hybrid Spectral Denoising Transformer with Guided Attention Zeqiang Lai C. Yan Ying Fu 77 21 0 16 Mar 2023
ViTO: Vision Transformer-Operator O. Ovadia Adar Kahana P. Stinis Eli Turkel George Karniadakis 39 22 0 15 Mar 2023
Feature propagation as self-supervision signals on graphs Oscar Pina Verónica Vilaplana SSL 61 1 0 15 Mar 2023
Enhancing Unsupervised Audio Representation Learning via Adversarial Sample Generation Yulin Pan Xiangteng He Biao Gong Yuxin Peng Yiliang Lv SSL 51 0 0 15 Mar 2023
DeDA: Deep Directed Accumulator Hang Zhang Rongguang Wang Renjiu Hu Jinwei Zhang Jiahao Nick Li MedIm 72 5 0 15 Mar 2023
FairAdaBN: Mitigating unfairness with adaptive batch normalization and its application to dermatological disease classification Zikang Xu Shang Zhao Quan Quan Qingsong Yao S. Kevin Zhou 137 14 0 15 Mar 2023
A Hierarchical Regression Chain Framework for Affective Vocal Burst Recognition Jinchao Li Xixin Wu Kaitao Song Dongsheng Li Xunying Liu Helen M. Meng 61 2 0 14 Mar 2023
Activity Recognition From Newborn Resuscitation Videos Øyvind Meinich-Bache Simon Lennart Austnes K. Engan Ivar Austvoll T. Eftestøl H. Myklebust S. Kusulla H. Kidanto H. Ersdal 38 19 0 14 Mar 2023
Feature representations useful for predicting image memorability Takumi Harada Hiroyuki Sakai 52 1 0 14 Mar 2023
Context Normalization Layer with Applications Bilal Faye M. Dilmi Hanene Azzag M. Lebbah D. Bouchaffra 89 0 0 14 Mar 2023
Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need Da-Wei Zhou Han-Jia Ye De-Chuan Zhan Ziwei Liu CLL 108 111 0 13 Mar 2023
Learning Reduced-Order Models for Cardiovascular Simulations with Graph Neural Networks Luca Pegolotti Martin R. Pfaller Natalia L. Rubio Ke Ding Rita Brugarolas Brufau Eric F. Darve Alison L. Marsden AI4CE 76 36 0 13 Mar 2023
Bag of Tricks with Quantized Convolutional Neural Networks for image classification Jie Hu Mengze Zeng Enhua Wu MQ 62 2 0 13 Mar 2023
Uni3D: A Unified Baseline for Multi-dataset 3D Object Detection Bo Zhang Jiakang Yuan Botian Shi Tao Chen Yikang Li Yu Qiao 3DPC 107 40 0 13 Mar 2023
FusionLoc: Camera-2D LiDAR Fusion Using Multi-Head Self-Attention for End-to-End Serving Robot Relocalization Jieun Lee Hakjun Lee Ji-Yong Oh 3DPC 72 7 0 13 Mar 2023
Transformer Encoder with Multiscale Deep Learning for Pain Classification Using Physiological Signals Zhenyu Lu Burcu Ozek S. Kamarthi ViT MedIm 63 15 0 13 Mar 2023
TranSG: Transformer-Based Skeleton Graph Prototype Contrastive Learning with Structure-Trajectory Prompted Reconstruction for Person Re-Identification Haocong Rao Steven C. H. Hoi 135 29 0 13 Mar 2023
Dynamic Clustering and Cluster Contrastive Learning for Unsupervised Person Re-identification Ziqi He Mengjia Xue Yunhao Du Zhicheng Zhao Fei Su 67 1 0 13 Mar 2023
Making Batch Normalization Great in Federated Deep Learning Shitian Zhao Hong-You Chen Wei-Lun Chao FedML 144 11 0 12 Mar 2023
Resurrecting Recurrent Neural Networks for Long Sequences Antonio Orvieto Samuel L. Smith Albert Gu Anushan Fernando Çağlar Gülçehre Razvan Pascanu Soham De 364 299 0 11 Mar 2023
Optimizing Federated Learning for Medical Image Classification on Distributed Non-iid Datasets with Partial Labels Pranav Kulkarni Adway U. Kanhere Paul H. Yi V. Parekh OOD FedML 48 4 0 10 Mar 2023
Single-branch Network for Multimodal Training M. S. Saeed Shah Nawaz M. H. Khan M. Zaheer Karthik Nandakumar Muhammad Haroon Yousaf Arif Mahmood 42 13 0 10 Mar 2023
Towards domain-invariant Self-Supervised Learning with Batch Styles Standardization Marin Scalbert Maria Vakalopoulou Florent Couzinié-Devy 106 2 0 10 Mar 2023
Lemmas: Generation, Selection, Application Michael Rawson C. Wernhard Zsolt Zombori W. Bibel 67 7 0 10 Mar 2023
Training, Architecture, and Prior for Deterministic Uncertainty Methods Bertrand Charpentier Chenxiang Zhang Stephan Günnemann UQCV OOD AI4CE 98 7 0 10 Mar 2023
Multi-site, Multi-domain Airway Tree Modeling (ATM'22): A Public Benchmark for Pulmonary Airway Segmentation Minghui Zhang Yang Wu Hanxiao Zhang Yulei Qin Hao Zheng ... Raúl San José Estépar C. Espinosa Jiayuan Sun Guang-Zhong Yang Yun Gu 73 12 0 10 Mar 2023
HumanBench: Towards General Human-centric Perception with Projector Assisted Pretraining Shixiang Tang Cheng Chen Qingsong Xie Meilin Chen Yizhou Wang ... Feng Zhu Haiyang Yang Li Yi Rui Zhao Wanli Ouyang VLM 110 36 0 10 Mar 2023
Towards better traffic volume estimation: Jointly addressing the underdetermination and nonequilibrium problems with correlation-adaptive GNNs Tong Nie Guoyang Qin Yunpeng Wang Jiangming Sun 141 15 0 10 Mar 2023
EHRDiff: Exploring Realistic EHR Synthesis with Diffusion Models Hongyi Yuan Songchi Zhou Sheng Yu DiffM MedIm 68 18 0 10 Mar 2023
Direct Robot Configuration Space Construction using Convolutional Encoder-Decoders Christopher Benka Carl Gross Riya Gupta Hod Lipson 51 2 0 10 Mar 2023
TANGOS: Regularizing Tabular Neural Networks through Gradient Orthogonalization and Specialization Alan Jeffares Tennison Liu Jonathan Crabbé F. Imrie M. Schaar CML 84 27 0 09 Mar 2023
Scalable Stochastic Gradient Riemannian Langevin Dynamics in Non-Diagonal Metrics Hanlin Yu M. Hartmann Bernardo Williams Arto Klami BDL 95 6 0 09 Mar 2023
Improving Video Retrieval by Adaptive Margin Feng He Qi Wang Zhifan Feng Wenbin Jiang Yajuan Lü Yong Zhu Xiao Tan 143 22 0 09 Mar 2023
NIFF: Alleviating Forgetting in Generalized Few-Shot Object Detection via Neural Instance Feature Forging Karim Guirguis Johannes Meier George Eskandar Matthias Kayser B. Yang Juergen Beyerer 111 9 0 09 Mar 2023
Advancing Direct Convolution using Convolution Slicing Optimization and ISA Extensions Victor Ferrari R. Sousa M. Pereira João P. L. De Carvalho J. N. Amaral José Moreira Guido Araujo 28 6 0 08 Mar 2023
Radio astronomical images object detection and segmentation: A benchmark on deep learning methods Renato Sortino D. Magro G. Fiameni E. Sciacca S. Riggi ... A. Hopkins F. Bufano F. Schillirò C. Bordiu C. Pino 70 8 0 08 Mar 2023
Onsets and Velocities: Affordable Real-Time Piano Transcription Using Convolutional Neural Networks Andres Fernandez 64 3 0 08 Mar 2023
A Message Passing Perspective on Learning Dynamics of Contrastive Learning Yifei Wang Qi Zhang Tianqi Du Jiansheng Yang Zhouchen Lin Yisen Wang SSL 67 20 0 08 Mar 2023
QuickSRNet: Plain Single-Image Super-Resolution Architecture for Faster Inference on Mobile Platforms Guillaume Berger Manik Dhingra Antoine Mercier Yash Savani Sunny Panchal Fatih Porikli SupR 57 5 0 08 Mar 2023
PSDNet: Determination of Particle Size Distributions Using Synthetic Soil Images and Convolutional Neural Networks javad Manashti Pouyan Pirnia Alireza Manashty Sahar Ujan Matthew Toews Franccois Duhaime 25 2 0 07 Mar 2023
Comparing PSDNet, pretrained networks, and traditional feature extraction for predicting the particle size distribution of granular materials from photographs javad Manashti Franccois Duhaime Matthew Toews Pouyan Pirnia Jn Kinsonn Telcy 3DPC 50 0 0 07 Mar 2023
Predicted Embedding Power Regression for Large-Scale Out-of-Distribution Detection Han Yang William R. Gebhardt Alexander Ororbia Travis J. Desell OODD 43 0 0 07 Mar 2023
At Your Fingertips: Extracting Piano Fingering Instructions from Videos Amit Moryossef Yanai Elazar Yoav Goldberg 86 2 0 07 Mar 2023
An Edge-based WiFi Fingerprinting Indoor Localization Using Convolutional Neural Network and Convolutional Auto-Encoder Amin Kargar-Barzi Ebrahim Farahmand Nooshin Taheri Chatrudi A. Mahani M. Shafique 57 8 0 07 Mar 2023
Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networks Jierun Chen Shiu-hong Kao Hao He Weipeng Zhuo Song Wen Chul-Ho Lee Shueng-Han Gary Chan OOD 122 887 0 07 Mar 2023
Evolutionary Deep Nets for Non-Intrusive Load Monitoring Jinsong Wang K. Loparo 29 0 0 06 Mar 2023