Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2412.19820
Cited By
GaLore
+
+
+
: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection
31 December 2024
Xutao Liao
Shaohui Li
Yuhui Xu
Zhi Li
Yebin Liu
You He
VLM
Re-assign community
ArXiv
PDF
HTML
Papers citing
"GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection"
3 / 3 papers shown
Title
AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections
Xin Yu
Yujia Wang
Jinghui Chen
Lingzhou Xue
24
0
0
18 May 2025
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM
Yehonathan Refael
Iftach Arbel
Ofir Lindenbaum
Tom Tirer
73
0
0
26 Feb 2025
CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation
Zhengwu Liu
Ruijie Zhang
Zihan Wang
Zi Yang
Paul Hovland
Bogdan Nicolae
Franck Cappello
Z. Zhang
54
0
0
16 Feb 2025
1