v1v2v3 (latest)

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Christian Szegedy

OOD

ArXiv (abs)PDF HTML

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 11,260 papers shown

Title
Obscured Wildfire Flame Detection By Temporal Analysis of Smoke Patterns Captured by Unmanned Aerial Systems U. Meleti Abolfazl Razi 88 1 0 30 Jun 2023
Implicit 3D Human Mesh Recovery using Consistency with Pose and Shape from Unseen-view Hanbyel Cho Yooshin Cho Jaesung Ahn Junmo Kim 3DH 84 16 0 30 Jun 2023
Systematic Investigation of Sparse Perturbed Sharpness-Aware Minimization Optimizer Peng Mi Li Shen Tianhe Ren Yiyi Zhou Tianshuo Xu Xiaoshuai Sun Tongliang Liu Rongrong Ji Dacheng Tao AAML 75 2 0 30 Jun 2023
Safe Model-Based Multi-Agent Mean-Field Reinforcement Learning Matej Jusup Barna Pásztor Tadeusz Janik Kecheng Zhang Francesco Corman Andreas Krause Ilija Bogunovic 83 3 0 29 Jun 2023
Spectral Batch Normalization: Normalization in the Frequency Domain Rinor Cakaj Jens Mehnert Bin Yang 45 2 0 29 Jun 2023
Weight Compander: A Simple Weight Reparameterization for Regularization Rinor Cakaj Jens Mehnert B. Yang 46 1 0 29 Jun 2023
Leveraging Cross-Utterance Context For ASR Decoding Robert Flynn Anton Ragni 71 1 0 29 Jun 2023
Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging Max Zimmer Christoph Spiegel Sebastian Pokutta MoMe 131 14 0 29 Jun 2023
Performance Analysis of DNN Inference/Training with Convolution and non-Convolution Operations H. Esmaeilzadeh Soroush Ghodrati A. Kahng Sean Kinzer Susmita Dey Manasi S. Sapatnekar Zhiang Wang 59 2 0 29 Jun 2023
BinaryViT: Pushing Binary Vision Transformers Towards Convolutional Models Phuoc-Hoan Charles Le Xinlin Li ViT MQ 87 21 0 29 Jun 2023
Game Level Blending using a Learned Level Representation Venkata Sai Revanth Atmakuri Seth Cooper Matthew J. Guzdial 52 0 0 29 Jun 2023
Joint Level Generation and Translation Using Gameplay Videos Negar Mirgati Matthew J. Guzdial VGen 52 0 0 29 Jun 2023
Deep Equilibrium Multimodal Fusion Jinhong Ni Yalong Bai Wei Zhang Ting Yao Tao Mei 90 1 0 29 Jun 2023
Neural network analysis of neutron and X-ray reflectivity data: Incorporating prior knowledge for tackling the phase problem Valentin Munteanu V. Starostin Alessandro Greco L. Pithan A. Gerlach A. Hinderhofer S. Kowarik F. Schreiber 44 4 0 28 Jun 2023
DUET: 2D Structured and Approximately Equivariant Representations Xavier Suau Federico Danieli Thomas Anderson Keller Arno Blaas Chen Huang Jason Ramapuram Dan Busbridge Luca Zappella 66 3 0 28 Jun 2023
MyDigitalFootprint: an extensive context dataset for pervasive computing applications at the edge M. Campana Franca Delmastro 26 3 0 28 Jun 2023
Tensorformer: Normalized Matrix Attention Transformer for High-quality Point Cloud Reconstruction Hui Tian Zheng Qin Renjiao Yi Chenyang Zhu Kai Xu ViT 115 4 0 28 Jun 2023
Reduce Computational Complexity for Convolutional Layers by Skipping Zeros Zhiyi Zhang Pengfei Zhang Zhuopin Xu Qi Wang 42 1 0 28 Jun 2023
Multi-network Contrastive Learning Based on Global and Local Representations Weiquan Li Xianzhong Long Yun Li SSL 60 0 0 28 Jun 2023
Ordering for Non-Replacement SGD Yuetong Xu Baharan Mirzasoleiman 48 0 0 28 Jun 2023
"Is a picture of a bird a bird": Policy recommendations for dealing with ambiguity in machine vision models Alicia Parrish Sarah Laszlo Lora Aroyo VLM 35 5 0 27 Jun 2023
Differentially Private Video Activity Recognition Zelun Luo Yuliang Zou Yijin Yang Zane Durante De-An Huang Zhiding Yu Chaowei Xiao L. Fei-Fei Anima Anandkumar PICV 85 5 0 27 Jun 2023
Large-scale unsupervised audio pre-training for video-to-speech synthesis Triantafyllos Kefalas Yannis Panagakis Maja Pantic VGen 71 4 0 27 Jun 2023
RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Music Haojie Wei Xueke Cao Tangpeng Dan Yueguo Chen 100 24 0 27 Jun 2023
Mean Field Theory in Deep Metric Learning Takuya Furusawa 60 2 0 27 Jun 2023
Machine learning in solar physics A. Asensio Ramos Mark C. M. Cheung I. Chifu Ricardo Gafeira AI4CE PINN 64 35 0 27 Jun 2023
CLERA: A Unified Model for Joint Cognitive Load and Eye Region Analysis in the Wild Li Ding Jack Terwilliger Aishni Parab Meng Wang Lex Fridman Bruce Mehler B. Reimer 39 2 0 26 Jun 2023
The Deep Arbitrary Polynomial Chaos Neural Network or how Deep Artificial Neural Networks could benefit from Data-Driven Homogeneous Chaos Theory S. Oladyshkin T. Praditia Ilja Kroker F. Mohammadi Wolfgang Nowak S. Otte AI4CE 50 5 0 26 Jun 2023
CIMulator: A Comprehensive Simulation Platform for Computing-In-Memory Circuit Macros with Low Bit-Width and Real Memory Materials Hoang-Hiep Le M. Baig Wei-Chen Hong Chengshian Tsai Cheng-Jui Yeh ... Nan-Yow Chen Wen-Jay Lee Ing-Chao Lin Da-Wei Chang D. Lu 27 1 0 26 Jun 2023
Learnable Differencing Center for Nighttime Depth Perception Zhiqiang Yan Yupeng Zheng Chongyi Li Jun Yu Li Jian Yang 3DV 74 12 0 26 Jun 2023
Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning Kuan-Fu Ding Jingyang Li Kim-Chuan Toh 140 8 0 26 Jun 2023
Contrastive Multi-view Framework for Customer Lifetime Value Prediction Chuhan Wu Jingjie Li Qinglin Jia Hong Zhu Yuan Fang Ruiming Tang 78 2 0 26 Jun 2023
Maintaining Plasticity in Deep Continual Learning Shibhansh Dohare J. F. Hernandez-Garcia Parash Rahman A. Rupam Mahmood Richard S. Sutton KELM CLL 97 30 0 23 Jun 2023
Magenta Green Screen: Spectrally Multiplexed Alpha Matting with Deep Colorization Dmitriy Smirnov Chloe LeGendre Xueming Yu P. Debevec 62 4 0 23 Jun 2023
Variance-Covariance Regularization Improves Representation Learning Jiachen Zhu Katrina Evtimova Yubei Chen Ravid Shwartz-Ziv Yann LeCun SSL 94 7 0 23 Jun 2023
On Sensitivity and Robustness of Normalization Schemes to Input Distribution Shifts in Automatic MR Image Diagnosis Divyam Madaan D. Sodickson K. Cho S. Chopra OOD MedIm 75 1 0 23 Jun 2023
Squeeze, Recover and Relabel: Dataset Condensation at ImageNet Scale From A New Perspective Zeyuan Yin Eric P. Xing Zhiqiang Shen DD 103 84 0 22 Jun 2023
Triggering Dark Showers with Conditional Dual Auto-Encoders Luca Anzalone S. S. Chhibra B. Maier N. Chernyavskaya M. Pierini AI4CE 68 4 0 22 Jun 2023
Data-Free Backbone Fine-Tuning for Pruned Neural Networks Adrian Holzbock Achyut Hegde Klaus C. J. Dietmayer Vasileios Belagiannis 54 0 0 22 Jun 2023
Accelerated Training via Incrementally Growing Neural Networks using Variance Transfer and Learning Rate Adaptation Xin Yuan Pedro H. P. Savarese Michael Maire 64 5 0 22 Jun 2023
FFCV: Accelerating Training by Removing Data Bottlenecks Guillaume Leclerc Andrew Ilyas Logan Engstrom Sung Min Park Hadi Salman Aleksander Madry 70 70 0 21 Jun 2023
Efficient Deep Spiking Multi-Layer Perceptrons with Multiplication-Free Inference Boyan Li Luziwei Leng Shuaijie Shen Kaixuan Zhang Jianguo Zhang Jianxing Liao Ran Cheng 132 7 0 21 Jun 2023
Efficient ResNets: Residual Network Design Aditya Thakur Harish Chauhan Nikunj Gupta 38 0 0 21 Jun 2023
No Wrong Turns: The Simple Geometry Of Neural Networks Optimization Paths Charles Guille-Escuret Hiroki Naganuma Kilian Fatras Ioannis Mitliagkas 85 4 0 20 Jun 2023
Learning Profitable NFT Image Diffusions via Multiple Visual-Policy Guided Reinforcement Learning Huiguo He Tianfu Wang Huan Yang Jianlong Fu N. Yuan Jian Yin Hongyang Chao Qi Zhang EGVM 152 10 0 20 Jun 2023
The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks Yuan Cao Difan Zou Yuan-Fang Li Quanquan Gu MLT 102 5 0 20 Jun 2023
Traversing Between Modes in Function Space for Fast Ensembling Eunggu Yun Hyungi Lee G. Nam Juho Lee UQCV 69 3 0 20 Jun 2023
Deep Learning of Dynamical System Parameters from Return Maps as Images Connor James Stephens E. Blazquez 17 0 0 20 Jun 2023
sEMG-based Hand Gesture Recognition with Deep Learning Marcello Zanghieri 43 5 0 19 Jun 2023
B-cos Alignment for Inherently Interpretable CNNs and Vision Transformers Moritz D Boehle Navdeeppal Singh Mario Fritz Bernt Schiele 166 27 0 19 Jun 2023