The Disharmony between BN and ReLU Causes Gradient Explosion, but is Offset by the Correlation between Activations

23 April 2023

Papers citing "The Disharmony between BN and ReLU Causes Gradient Explosion, but is Offset by the Correlation between Activations"

2 / 2 papers shown

Title
Opacus: User-Friendly Differential Privacy Library in PyTorch Ashkan Yousefpour I. Shilov Alexandre Sablayrolles Davide Testuggine Karthik Prasad ... Sayan Gosh Akash Bharadwaj Jessica Zhao Graham Cormode Ilya Mironov VLM 159 349 0 25 Sep 2021
High-Performance Large-Scale Image Recognition Without Normalization Andrew Brock Soham De Samuel L. Smith Karen Simonyan VLM 223 512 0 11 Feb 2021