Optimal Embedding Learning Rate in LLMs: The Effect of Vocabulary Size

Optimal Embedding Learning Rate in LLMs: The Effect of Vocabulary Size

17 June 2025

Soufiane Hayou

Liyuan Liu

ArXiv (abs)PDF HTML

Papers citing "Optimal Embedding Learning Rate in LLMs: The Effect of Vocabulary Size"

Title
No papers