ResearchTrend.AI
How to escape sharp minima with random perturbations
v1v2v3 (latest)

How to escape sharp minima with random perturbations

Kwangjun Ahn
Ali Jadbabaie
S. Sra
    ODL
ArXiv (abs)PDFHTML

Papers citing "How to escape sharp minima with random perturbations"

3 / 3 papers shown
Title
Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late in Training
Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late in Training
Zhanpeng Zhou
Mingze Wang
Yuchen Mao
Bingrui Li
Junchi Yan
AAML
132
1
0
14 Oct 2024
On the Trade-off between Flatness and Optimization in Distributed Learning
On the Trade-off between Flatness and Optimization in Distributed Learning
Ying Cao
Zhaoxian Wu
Kun Yuan
Ali H. Sayed
103
1
0
28 Jun 2024
Does SGD really happen in tiny subspaces?
Does SGD really happen in tiny subspaces?
Minhak Song
Kwangjun Ahn
Chulhee Yun
131
7
1
25 May 2024

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.