Data-induced multiscale losses and efficient multirate gradient descent
schemes

v1v2 (latest)

Data-induced multiscale losses and efficient multirate gradient descent schemes

5 February 2024

ArXiv (abs)PDF HTML

Papers citing "Data-induced multiscale losses and efficient multirate gradient descent schemes"

10 / 10 papers shown

Title
Verifying the Union of Manifolds Hypothesis for Image Data Bradley Brown Anthony L. Caterini Brendan Leigh Ross Jesse C. Cresswell Gabriel Loaiza-Ganem 101 43 0 06 Jul 2022
Side Effects of Learning from Low-dimensional Data Embedded in a Euclidean Space Juncai He R. Tsai Rachel A. Ward 69 9 0 01 Mar 2022
Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect Yuqing Wang Minshuo Chen T. Zhao Molei Tao AI4CE 98 42 0 07 Oct 2021
The Intrinsic Dimension of Images and Its Impact on Learning Phillip E. Pope Chen Zhu Ahmed Abdelkader Micah Goldblum Tom Goldstein 231 273 0 18 Apr 2021
Intrinsic dimension of data representations in deep neural networks A. Ansuini Alessandro Laio Jakob H. Macke D. Zoccolan AI4CE 81 279 0 29 May 2019
Asymmetric Valleys: Beyond Sharp and Flat Local Minima Haowei He Gao Huang Yang Yuan ODL MLT 69 150 0 02 Feb 2019
Gradient Descent Provably Optimizes Over-parameterized Neural Networks S. Du Xiyu Zhai Barnabás Póczós Aarti Singh MLT ODL 229 1,276 0 04 Oct 2018
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 350 8,174 0 13 Aug 2016
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 338 18,651 0 06 Feb 2015
Testing the Manifold Hypothesis Charles Fefferman S. Mitter Hariharan Narayanan 158 535 0 01 Oct 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.