ResearchTrend.AI
Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)

Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)

Artem Riabinin
Egor Shulgin
Kaja Gruntkowska
Peter Richtárik
ArXiv (abs)PDFHTML

Papers citing "Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)"

2 / 2 papers shown
Title
The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithm
The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithm
Noah Amsel
David Persson
Christopher Musco
Robert Gower
28
1
0
22 May 2025
Understanding Gradient Orthogonalization for Deep Learning via Non-Euclidean Trust-Region Optimization
Understanding Gradient Orthogonalization for Deep Learning via Non-Euclidean Trust-Region Optimization
Dmitry Kovalev
139
5
0
16 Mar 2025