v1v2v3v4v5 (latest)

Essentially No Barriers in Neural Network Energy Landscape

2 March 2018

Papers citing "Essentially No Barriers in Neural Network Energy Landscape"

45 / 295 papers shown

Title
Linear Mode Connectivity and the Lottery Ticket Hypothesis Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy Michael Carbin MoMe 183 630 0 11 Dec 2019
Deep Ensembles: A Loss Landscape Perspective Stanislav Fort Huiyi Hu Balaji Lakshminarayanan OOD UQCV 171 632 0 05 Dec 2019
Rigging the Lottery: Making All Tickets Winners Utku Evci Trevor Gale Jacob Menick Pablo Samuel Castro Erich Elsen 233 612 0 25 Nov 2019
Sub-Optimal Local Minima Exist for Neural Networks with Almost All Non-Linear Activations Tian Ding Dawei Li Ruoyu Sun 95 13 0 04 Nov 2019
Generalization in multitask deep neural classifiers: a statistical physics approach Tyler Lee A. Ndirango AI4CE 147 20 0 30 Oct 2019
Sparsification as a Remedy for Staleness in Distributed Asynchronous SGD Rosa Candela Giulio Franzese Maurizio Filippone Pietro Michiardi 91 1 0 21 Oct 2019
Loss Landscape Sightseeing with Multi-Point Optimization Ivan Skorokhodov Andrey Kravchenko 3DPC 62 18 0 09 Oct 2019
Generalization Bounds for Convolutional Neural Networks Shan Lin Jingwei Zhang MLT 60 35 0 03 Oct 2019
How noise affects the Hessian spectrum in overparameterized neural networks Ming-Bo Wei D. Schwab 85 28 0 01 Oct 2019
GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing Xiaohong Liu Yongrui Ma Zhihao Shi Jun Chen 126 762 0 08 Aug 2019
Defense Against Adversarial Attacks Using Feature Scattering-based Adversarial Training Haichao Zhang Jianyu Wang AAML 112 231 0 24 Jul 2019
Towards Understanding Generalization in Gradient-Based Meta-Learning Simon Guiroy Vikas Verma C. Pal 73 21 0 16 Jul 2019
Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape Johanni Brea Berfin Simsek Bernd Illing W. Gerstner 102 58 0 05 Jul 2019
Finding the Needle in the Haystack with Convolutions: on the benefits of architectural bias Stéphane dÁscoli Levent Sagun Joan Bruna Giulio Biroli 95 37 0 16 Jun 2019
Explaining Landscape Connectivity of Low-cost Solutions for Multilayer Nets Rohith Kuditipudi Xiang Wang Holden Lee Yi Zhang Zhiyuan Li Wei Hu Sanjeev Arora Rong Ge FAtt 123 93 0 14 Jun 2019
Learning Curves for Deep Neural Networks: A Gaussian Field Theory Perspective Omry Cohen Orit Malka Zohar Ringel AI4CE 78 22 0 12 Jun 2019
A Closer Look at the Optimization Landscapes of Generative Adversarial Networks Hugo Berard Gauthier Gidel Amjad Almahairi Pascal Vincent Simon Lacoste-Julien GAN 60 64 0 11 Jun 2019
Large Scale Structure of Neural Network Loss Landscapes Stanislav Fort Stanislaw Jastrzebski 74 84 0 11 Jun 2019
A Direct Approach to Robust Deep Learning Using Adversarial Networks Huaxia Wang Chun-Nam Yu GAN AAML OOD 76 77 0 23 May 2019
Budgeted Training: Rethinking Deep Neural Network Training Under Resource Constraints Mengtian Li Ersin Yumer Deva Ramanan 72 49 0 12 May 2019
A Generative Model for Sampling High-Performance and Diverse Weights for Neural Networks Lior Deutsch Erik Nijkamp Yu Yang 71 16 0 07 May 2019
Genuinely Distributed Byzantine Machine Learning El-Mahdi El-Mhamdi R. Guerraoui Arsany Guirguis Lê Nguyên Hoang Sébastien Rouault FedML OOD 78 19 0 05 May 2019
TATi-Thermodynamic Analytics ToolkIt: TensorFlow-based software for posterior sampling in machine learning applications Frederik Heber Zofia Trstanova Benedict Leimkuhler 40 1 0 20 Mar 2019
Uniform convergence may be unable to explain generalization in deep learning Vaishnavh Nagarajan J. Zico Kolter MoMe AI4CE 100 317 0 13 Feb 2019
Combining learning rate decay and weight decay with complexity gradient descent - Part I Pierre Harvey Richemond Yike Guo 37 4 0 07 Feb 2019
A Simple Baseline for Bayesian Uncertainty in Deep Learning Wesley J. Maddox T. Garipov Pavel Izmailov Dmitry Vetrov A. Wilson BDL UQCV 165 810 0 07 Feb 2019
The role of a layer in deep neural networks: a Gaussian Process perspective Oded Ben-David Zohar Ringel AI4CE 39 3 0 06 Feb 2019
Asymmetric Valleys: Beyond Sharp and Flat Local Minima Haowei He Gao Huang Yang Yuan ODL MLT 92 150 0 02 Feb 2019
An Investigation into Neural Net Optimization via Hessian Eigenvalue Density Behrooz Ghorbani Shankar Krishnan Ying Xiao ODL 121 326 0 29 Jan 2019
On Connected Sublevel Sets in Deep Learning Quynh N. Nguyen 136 103 0 22 Jan 2019
Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks using PAC-Bayesian Analysis Yusuke Tsuzuku Issei Sato Masashi Sugiyama 84 77 0 15 Jan 2019
Visualising Basins of Attraction for the Cross-Entropy and the Squared Error Neural Network Loss Functions Anna Sergeevna Bosman A. Engelbrecht Mardé Helbig 78 77 0 08 Jan 2019
Enhancing Discrete Choice Models with Representation Learning Brian Sifringer Virginie Lurkin Alexandre Alahi 30 12 0 23 Dec 2018
Wireless Network Intelligence at the Edge Jihong Park S. Samarakoon M. Bennis Mérouane Debbah 113 521 0 07 Dec 2018
Understanding the impact of entropy on policy optimization Zafarali Ahmed Nicolas Le Roux Mohammad Norouzi Dale Schuurmans 83 238 0 27 Nov 2018
Connections between physics, mathematics and deep learning J. Thierry-Mieg AI4CE PINN 18 0 0 01 Nov 2018
A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation Akhilesh Deepak Gotmare N. Keskar Caiming Xiong R. Socher ODL 105 277 0 29 Oct 2018
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min Lin Fred Hamprecht Yoshua Bengio Aaron Courville 172 1,463 0 22 Jun 2018
Using Mode Connectivity for Loss Landscape Analysis Akhilesh Deepak Gotmare N. Keskar Caiming Xiong R. Socher 71 28 0 18 Jun 2018
Deep learning generalizes because the parameter-function map is biased towards simple functions Guillermo Valle Pérez Chico Q. Camargo A. Louis MLT AI4CE 122 232 0 22 May 2018
The global optimum of shallow neural network is attained by ridgelet transform Sho Sonoda Isao Ishikawa Masahiro Ikeda Kei Hagihara Y. Sawano Takuo Matsubara Noboru Murata 35 1 0 19 May 2018
Averaging Weights Leads to Wider Optima and Better Generalization Pavel Izmailov Dmitrii Podoprikhin T. Garipov Dmitry Vetrov A. Wilson FedML MoMe 231 1,677 0 14 Mar 2018
Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs T. Garipov Pavel Izmailov Dmitrii Podoprikhin Dmitry Vetrov A. Wilson UQCV 138 758 0 27 Feb 2018
Spurious Valleys in Two-layer Neural Network Optimization Landscapes Luca Venturi Afonso S. Bandeira Joan Bruna 97 75 0 18 Feb 2018
Generating Neural Networks with Neural Networks Lior Deutsch 105 21 0 06 Jan 2018