ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2412.19820
  4. Cited By
GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection

GaLore+++: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection

31 December 2024
Xutao Liao
Shaohui Li
Yuhui Xu
Zhi Li
Yebin Liu
You He
    VLM
ArXivPDFHTML

Papers citing "GaLore$+$: Boosting Low-Rank Adaptation for LLMs with Cross-Head Projection"

3 / 3 papers shown
Title
AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections
AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections
Xin Yu
Yujia Wang
Jinghui Chen
Lingzhou Xue
24
0
0
18 May 2025
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM
LORENZA: Enhancing Generalization in Low-Rank Gradient LLM Training via Efficient Zeroth-Order Adaptive SAM
Yehonathan Refael
Iftach Arbel
Ofir Lindenbaum
Tom Tirer
73
0
0
26 Feb 2025
CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation
CoLA: Compute-Efficient Pre-Training of LLMs via Low-Rank Activation
Zhengwu Liu
Ruijie Zhang
Zihan Wang
Zi Yang
Paul Hovland
Bogdan Nicolae
Franck Cappello
Z. Zhang
54
0
0
16 Feb 2025
1