InRank: Incremental Low-Rank Learning

20 June 2023

Papers citing "InRank: Incremental Low-Rank Learning"

5 / 5 papers shown

Title
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection Jiawei Zhao Zhenyu Zhang Beidi Chen Zhangyang Wang A. Anandkumar Yuandong Tian 43 179 0 06 Mar 2024
FFSplit: Split Feed-Forward Network For Optimizing Accuracy-Efficiency Trade-off in Language Model Inference Zirui Liu Qingquan Song Q. Xiao Sathiya Keerthi Selvaraj Rahul Mazumder Aman Gupta Xia Hu 42 4 0 08 Jan 2024
Cuttlefish: Low-Rank Model Training without All the Tuning Hongyi Wang Saurabh Agarwal Pongsakorn U-chupala Yoshiki Tanaka Eric P. Xing Dimitris Papailiopoulos OffRL 63 22 0 04 May 2023
Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations Steffen Schotthöfer Emanuele Zangrando J. Kusch Gianluca Ceruti Francesco Tudisco 53 36 0 26 May 2022
PINNup: Robust neural network wavefield solutions using frequency upscaling and neuron splitting Xinquan Huang T. Alkhalifah 43 45 0 29 Sep 2021