ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2103.03466
  4. Cited By
Unintended Effects on Adaptive Learning Rate for Training Neural Network
  with Output Scale Change

Unintended Effects on Adaptive Learning Rate for Training Neural Network with Output Scale Change

5 March 2021
Ryuichi Kanoh
M. Sugiyama
ArXivPDFHTML

Papers citing "Unintended Effects on Adaptive Learning Rate for Training Neural Network with Output Scale Change"

2 / 2 papers shown
Title
The large learning rate phase of deep learning: the catapult mechanism
The large learning rate phase of deep learning: the catapult mechanism
Aitor Lewkowycz
Yasaman Bahri
Ethan Dyer
Jascha Narain Sohl-Dickstein
Guy Gur-Ari
ODL
159
234
0
04 Mar 2020
Double Trouble in Double Descent : Bias and Variance(s) in the Lazy
  Regime
Double Trouble in Double Descent : Bias and Variance(s) in the Lazy Regime
Stéphane dÁscoli
Maria Refinetti
Giulio Biroli
Florent Krzakala
93
152
0
02 Mar 2020
1