Partial local entropy and anisotropy in deep weight spaces

17 July 2020

Papers citing "Partial local entropy and anisotropy in deep weight spaces"

8 / 8 papers shown

Title
Entropic gradient descent algorithms and wide flat minima Fabrizio Pittorino Carlo Lucibello Christoph Feinauer Gabriele Perugini Carlo Baldassi Elizaveta Demyanenko R. Zecchina ODL MLT 59 33 0 14 Jun 2020
A Neural Scaling Law from the Dimension of the Data Manifold Utkarsh Sharma Jared Kaplan 44 52 0 22 Apr 2020
Mean-field inference methods for neural networks Marylou Gabrié AI4CE 48 33 0 03 Nov 2019
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 168 8,807 0 25 Aug 2017
Entropy-SGD: Biasing Gradient Descent Into Wide Valleys Pratik Chaudhari A. Choromańska Stefano Soatto Yann LeCun Carlo Baldassi C. Borgs J. Chayes Levent Sagun R. Zecchina ODL 84 769 0 06 Nov 2016
Unreasonable Effectiveness of Learning Neural Networks: From Accessible States and Robust Ensembles to Basic Algorithmic Schemes Carlo Baldassi C. Borgs J. Chayes Alessandro Ingrosso Carlo Lucibello Luca Saglietti R. Zecchina 45 166 0 20 May 2016
Subdominant Dense Clusters Allow for Simple Learning and High Computational Performance in Neural Networks with Discrete Synapses Carlo Baldassi Alessandro Ingrosso Carlo Lucibello Luca Saglietti R. Zecchina 42 127 0 18 Sep 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 168 18,534 0 06 Feb 2015