Zeroth-Order Fine-Tuning of LLMs in Random Subspaces

11 October 2024

Papers citing "Zeroth-Order Fine-Tuning of LLMs in Random Subspaces"

2 / 2 papers shown

Title
Stochastic Subspace Descent Accelerated via Bi-fidelity Line Search Nuojin Cheng Alireza Doostan Stephen Becker 39 0 0 30 Apr 2025
MaZO: Masked Zeroth-Order Optimization for Multi-Task Fine-Tuning of Large Language Models Zhen Zhang Yi Yang Kai Zhen Nathan Susanj Athanasios Mouchtaris Siegfried Kunzmann Zheng Zhang 54 0 0 17 Feb 2025