Using Mode Connectivity for Loss Landscape Analysis

Using Mode Connectivity for Loss Landscape Analysis

18 June 2018

Akhilesh Deepak Gotmare

Papers citing "Using Mode Connectivity for Loss Landscape Analysis"

12 / 12 papers shown

Title
Understanding Mode Connectivity via Parameter Space Symmetry B. Zhao Nima Dehmamy Robin Walters Rose Yu 109 7 0 29 May 2025
Averaging Weights Leads to Wider Optima and Better Generalization Pavel Izmailov Dmitrii Podoprikhin T. Garipov Dmitry Vetrov A. Wilson FedML MoMe 93 1,643 0 14 Mar 2018
Essentially No Barriers in Neural Network Energy Landscape Felix Dräxler K. Veschgini M. Salmhofer Fred Hamprecht MoMe 97 430 0 02 Mar 2018
Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs T. Garipov Pavel Izmailov Dmitrii Podoprikhin Dmitry Vetrov A. Wilson UQCV 56 746 0 27 Feb 2018
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium M. Heusel Hubert Ramsauer Thomas Unterthiner Bernhard Nessler Sepp Hochreiter 61 464 0 26 Jun 2017
The Marginal Value of Adaptive Gradient Methods in Machine Learning Ashia Wilson Rebecca Roelofs Mitchell Stern Nathan Srebro Benjamin Recht ODL 48 1,023 0 23 May 2017
Snapshot Ensembles: Train 1, get M for free Gao Huang Yixuan Li Geoff Pleiss Zhuang Liu John E. Hopcroft Kilian Q. Weinberger OOD FedML UQCV 110 938 0 01 Apr 2017
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 353 2,922 0 15 Sep 2016
Cyclical Learning Rates for Training Neural Networks L. Smith ODL 116 2,515 0 03 Jun 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 778 149,474 0 22 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 891 99,991 0 04 Sep 2014
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 164 14,831 1 21 Dec 2013