v1v2v3 (latest)

A Survey on LoRA of Large Language Models

8 July 2024

ArXiv (abs)PDF HTML Github (164★)

Papers citing "A Survey on LoRA of Large Language Models"

26 / 26 papers shown

Title
Collaborative Editable Model Kaiwen Tang Aitong Wu Yao Lu Guangda Sun KELM 54 0 0 17 Jun 2025
SLICK: Selective Localization and Instance Calibration for Knowledge-Enhanced Car Damage Segmentation in Automotive Insurance Teerapong Panboonyuen 161 0 0 12 Jun 2025
FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA Divyansh Jhunjhunwala Arian Raje Madan Ravi Ganesh Chaithanya Kumar Mummadi Chaoqun Dong Jiawei Zhou Wan-Yi Lin Gauri Joshi Zhenzhen Li 54 0 0 01 Jun 2025
Structured Gradient Guidance for Few-Shot Adaptation in Large Language Models Hongye Zheng Yichen Wang Ray Pan Guiran Liu Binrong Zhu Hanlu Zhang 35 0 0 31 May 2025
PDE-Transformer: Efficient and Versatile Transformers for Physics Simulations Benjamin Holzschuh Qiang Liu Georg Kohl Nils Thuerey AI4CE 54 1 0 30 May 2025
The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learning Shiwei Li Xiandi Luo Haozhao Wang Xing Tang Shijie Xu Weihong Luo Yuhua Li Xiuqiang He Ruixuan Li FedML 25 0 0 29 May 2025
Compressing Sine-Activated Low-Rank Adapters through Post-Training Quantization Cameron Gordon Yiping Ji Hemanth Saratchandran Paul Albert Simon Lucey MQ 65 0 0 28 May 2025
FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasets Dannong Wang Jaisal Patel Daochen Zha Steve Yang Xiao-Yang Liu 33 0 0 26 May 2025
FedHL: Federated Learning for Heterogeneous Low-Rank Adaptation via Unbiased Aggregation Zihao Peng Jiandian Zeng Boyuan Li Guo Li Shengbo Chen Tian Wang FedML 117 0 0 24 May 2025
CT-Agent: A Multimodal-LLM Agent for 3D CT Radiology Question Answering Yuren Mao Wenyi Xu Yuyang Qin Yunjun Gao MedIm 81 0 0 22 May 2025
Does Low Rank Adaptation Lead to Lower Robustness against Training-Time Attacks? Zi Liang Haibo Hu Qingqing Ye Yaxin Xiao Ronghua Li AAML 105 1 0 19 May 2025
scAgent: Universal Single-Cell Annotation via a LLM Agent Yuren Mao Yu Mi Peigen Liu Mengfei Zhang Hanqing Liu Yunjun Gao LLMAG 60 2 0 07 Apr 2025
MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning Maolin Wang Xiangyu Zhao AI4CE 129 0 0 01 Apr 2025
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Model Wenke Huang Jian Liang Xianda Guo Yiyang Fang Guancheng Wan ... Bin Yang He Li Jiawei Shao Mang Ye Di Lin OffRL LRM MLLM KELM VLM 161 4 0 06 Mar 2025
Scientific Reasoning: Assessment of Multimodal Generative LLMs Florian Dreyer Ekaterina Kolos Daria Matiash ReLM LRM 93 0 0 03 Mar 2025
LUNAR: LLM Unlearning via Neural Activation Redirection William F. Shen Xinchi Qiu Meghdad Kurmanji Alex Iacob Lorenzo Sani Yihong Chen Nicola Cancedda Nicholas D. Lane MU 132 6 0 11 Feb 2025
Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning Ziyu Zhao Yixiao Zhou Didi Zhu Tao Shen Xinze Wang ... Leilei Gan Minqin Zhu Zhongyu Wei Fei Wu Yu Cheng MoE MoMe 120 3 0 25 Jan 2025
Graph-Aware Isomorphic Attention for Adaptive Dynamics in Transformers Markus J. Buehler AI4CE 158 3 0 04 Jan 2025
Reassessing Layer Pruning in LLMs: New Insights and Methods Yao Lu Hao Cheng Yujie Fang Zeyu Wang Jiaheng Wei Dongwei Xu Qi Xuan Xiaoniu Yang Zhaowei Zhu 130 4 0 23 Nov 2024
Rapid Adaptation of Earth Observation Foundation Models for Segmentation Karthick Panner Selvam Raúl Ramos-Pollán F. Kalaitzis AI4CE 93 5 0 16 Sep 2024
FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations Ziyao Wang Zheyu Shen Yexiao He Guoheng Sun Hongyi Wang Lingjuan Lyu Ang Li 93 49 0 09 Sep 2024
NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models Cheng Lin Lujun Li Dezhi Li Jie Zou Wei Xue Yike Guo AI4TS 97 8 0 18 Aug 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models Fanxu Meng Zhaohui Wang Muhan Zhang VLM 161 104 0 03 Apr 2024
ResAdapter: Domain Consistent Resolution Adapter for Diffusion Models Jiaxiang Cheng Pan Xie Xin Xia Jiashi Li Jie Wu Yuxi Ren Huixia Li Xuefeng Xiao Min Zheng Lean Fu 118 12 0 04 Mar 2024
MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning Fajie Yuan Chengshun Shi Shiguang Wu Mengqi Zhang Zhaochun Ren Maarten de Rijke Zhumin Chen Jiahuan Pei MoE 217 13 0 27 Feb 2024
DropBP: Accelerating Fine-Tuning of Large Language Models by Dropping Backward Propagation Sunghyeon Woo Baeseong Park Byeongwook Kim Minjung Jo S. Kwon Dongsuk Jeon Dongsoo Lee 135 3 0 27 Feb 2024