A Scale Invariant Flatness Measure for Deep Network Minima

A Scale Invariant Flatness Measure for Deep Network Minima

6 February 2019

Akshay Rangamani

Papers citing "A Scale Invariant Flatness Measure for Deep Network Minima"

17 / 17 papers shown

Title
Identifying Generalization Properties in Neural Networks Huan Wang N. Keskar Caiming Xiong R. Socher 38 49 0 19 Sep 2018
Norm matters: efficient and accurate normalization schemes in deep networks Elad Hoffer Ron Banner Itay Golan Daniel Soudry OffRL 56 179 0 05 Mar 2018
Sensitivity and Generalization in Neural Networks: an Empirical Study Roman Novak Yasaman Bahri Daniel A. Abolafia Jeffrey Pennington Jascha Narain Sohl-Dickstein AAML 93 437 0 23 Feb 2018
Visualizing the Loss Landscape of Neural Nets Hao Li Zheng Xu Gavin Taylor Christoph Studer Tom Goldstein 236 1,873 0 28 Dec 2017
Projection Based Weight Normalization for Deep Neural Networks Lei Huang Xianglong Liu B. Lang Yue Liu 49 18 0 06 Oct 2017
Riemannian approach to batch normalization Minhyung Cho Jaehyung Lee 53 94 0 27 Sep 2017
A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks Behnam Neyshabur Srinadh Bhojanapalli Nathan Srebro 75 604 0 29 Jul 2017
Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Data Gintare Karolina Dziugaite Daniel M. Roy 93 808 0 31 Mar 2017
Sharp Minima Can Generalize For Deep Nets Laurent Dinh Razvan Pascanu Samy Bengio Yoshua Bengio ODL 108 766 0 15 Mar 2017
Entropy-SGD: Biasing Gradient Descent Into Wide Valleys Pratik Chaudhari A. Choromańska Stefano Soatto Yann LeCun Carlo Baldassi C. Borgs J. Chayes Levent Sagun R. Zecchina ODL 92 769 0 06 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 384 2,922 0 15 Sep 2016
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks Tim Salimans Diederik P. Kingma ODL 158 1,933 0 25 Feb 2016
Path-SGD: Path-Normalized Optimization in Deep Neural Networks Behnam Neyshabur Ruslan Salakhutdinov Nathan Srebro ODL 73 305 0 08 Jun 2015
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren Kaiming He Ross B. Girshick Jian Sun AIMat ObjD 432 61,900 0 04 Jun 2015
On Using Very Large Target Vocabulary for Neural Machine Translation Sébastien Jean Kyunghyun Cho Roland Memisevic Yoshua Bengio 132 1,010 0 05 Dec 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 326 20,491 0 10 Sep 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.2K 99,991 0 04 Sep 2014