v1v2 (latest)

DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation

14 October 2022

Papers citing "DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation"

50 / 131 papers shown

Title
Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weights Zhiyuan Liang Dongwen Tang Yuhao Zhou Xuanlei Zhao Mingjia Shi ... Damian Borth Michael M. Bronstein Yang You Zhangyang Wang Kai Wang OffRL 23 0 0 19 Jun 2025
Improving LoRA with Variational Learning Bai Cong Nico Daheim Yuesong Shen Rio Yokota Mohammad Emtiyaz Khan Thomas Möllenhoff 33 0 0 17 Jun 2025
Dynamic Context-oriented Decomposition for Task-aware Low-rank Adaptation with Less Forgetting and Faster Convergence Yibo Yang Sihao Liu Chuan Rao Bang An Tiancheng Shen Philip Torr Ming-Hsuan Yang Bernard Ghanem 24 0 0 16 Jun 2025
LoRMA: Low-Rank Multiplicative Adaptation for LLMs Harsh Bihany Shubham Patel Ashutosh Modi 22 0 0 09 Jun 2025
GaRA-SAM: Robustifying Segment Anything Model with Gated-Rank Adaptation Sohyun Lee Yeho Kwon Lukas Hoyer Suha Kwak 77 0 0 03 Jun 2025
FLoE: Fisher-Based Layer Selection for Efficient Sparse Adaptation of Low-Rank Experts Xinyi Wang Lirong Gao Haobo Wang Yiming Zhang Junbo Zhao MoE 40 0 0 31 May 2025
CL-LoRA: Continual Low-Rank Adaptation for Rehearsal-Free Class-Incremental Learning Jiangpeng He Zhihao Duan Fengqing M Zhu CLL 29 1 0 30 May 2025
MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning Dacao Zhang Kun Zhang Shimao Chu Le Wu Xin Li Si Wei MoE ALM OffRL 35 0 0 28 May 2025
Improved Representation Steering for Language Models Zhengxuan Wu Qinan Yu Aryaman Arora Christopher D. Manning Christopher Potts LLMSV 76 0 0 27 May 2025
HOFT: Householder Orthogonal Fine-tuning Alejandro Moreno Arcas Albert Sanchis Jorge Civera Alfons Juan 69 0 0 22 May 2025
AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections Xin Yu Yujia Wang Jinghui Chen Lingzhou Xue 101 0 0 18 May 2025
SRLoRA: Subspace Recomposition in Low-Rank Adaptation via Importance-Based Fusion and Reinitialization Haodong Yang Lei Wang Md Zakir Hossain 97 0 0 18 May 2025
Federated Low-Rank Adaptation for Foundation Models: A Survey Yiyuan Yang Guodong Long Qinghua Lu Liming Zhu Jing Jiang Chengqi Zhang AI4CE 80 0 0 16 May 2025
Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning Le-Trung Nguyen Ael Quélennec Van-Tam Nguyen Enzo Tartaglione 94 0 0 08 May 2025
A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning Jieming Bian Yuanzhe Peng Lei Wang Yin Huang Jie Xu FedML 117 1 0 29 Apr 2025
AC-LoRA: Auto Component LoRA for Personalized Artistic Style Image Generation Zhipu Cui Andong Tian Zhi Ying Jialiang Lu 74 0 0 03 Apr 2025
Towards Symmetric Low-Rank Adapters Tales Panoutsos Rodrygo L. T. Santos Flavio Figueiredo 173 0 0 29 Mar 2025
MSPLoRA: A Multi-Scale Pyramid Low-Rank Adaptation for Efficient Model Fine-Tuning Jiancheng Zhao Xingda Yu Zhen Yang MoE 88 3 0 27 Mar 2025
LoR2C : Low-Rank Residual Connection Adaptation for Parameter-Efficient Fine-Tuning Jiancheng Zhao Xingda Yu Yuxiang Zhang Zhen Yang OffRL 80 0 0 01 Mar 2025
CLLoRA: An Approach to Measure the Effects of the Context Length for LLM Fine-Tuning Ping Zhang Zhaorui Zhang Sheng Di Yao Xin Benben Liu 101 2 0 26 Feb 2025
NEAT: Nonlinear Parameter-efficient Adaptation of Pre-trained Models Yibo Zhong Haoxiang Jiang Lincan Li Ryumei Nakada Tianci Liu Linjun Zhang Huaxiu Yao Haoyu Wang 253 3 0 24 Feb 2025
DP-MemArc: Differential Privacy Transfer Learning for Memory Efficient Language Models Yanming Liu Xinyue Peng Yuwei Zhang Xiaolan Ke Songhang Deng ... Sheng Cheng Xun Wang Yuxiang Cai Tianyu Du Xuhong Zhang 179 0 0 21 Feb 2025
HADL Framework for Noise Resilient Long-Term Time Series Forecasting Aditya Dey Jonas Kusch Fadi Al Machot AI4TS 86 0 0 14 Feb 2025
Low-Rank Agent-Specific Adaptation (LoRASA) for Multi-Agent Policy Learning Beining Zhang Aditya Kapoor Mingfei Sun 270 0 0 08 Feb 2025
LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning Zhekai Du Yinjie Min Jingjing Li Ke Lu Changliang Zou Liuhua Peng Tingjin Chu Mingming Gong 464 2 0 05 Feb 2025
TabPFN Unleashed: A Scalable and Effective Solution to Tabular Classification Problems Si-Yang Liu Han-Jia Ye 179 12 0 04 Feb 2025
Memory-Efficient Fine-Tuning of Transformers via Token Selection Antoine Simoulin Namyong Park Xiaoyi Liu Grey Yang 195 1 0 31 Jan 2025
Spectral-Aware Low-Rank Adaptation for Speaker Verification Zhe Li Man-Wai Mak Mert Pilanci Hung-yi Lee Helen Meng 122 0 0 07 Jan 2025
PETALface: Parameter Efficient Transfer Learning for Low-resolution Face Recognition Kartik Narayan Nithin Gopalakrishnan Nair Jennifer Xu Rama Chellappa Vishal M. Patel CVBM CLL 119 2 0 10 Dec 2024
KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models Fan Wang Juyong Jiang Chansung Park Sunghun Kim Jing Tang 203 2 0 08 Dec 2024
Customize Segment Anything Model for Multi-Modal Semantic Segmentation with Mixture of LoRA Experts Chenyang Zhu Bin Xiao Lin Shi Shoukun Xu Xu Zheng MoE 176 12 0 05 Dec 2024
Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation Ayan Sengupta Vaibhav Seth Arinjay Pathak Natraj Raman Sriram Gopalakrishnan Tanmoy Chakraborty BDL 53 2 0 07 Nov 2024
Disentangling Disentangled Representations: Towards Improved Latent Units via Diffusion Models Youngjun Jun Jiwoo Park Kyobin Choo Tae Eun Choi Seong Jae Hwang CoGe 119 0 0 31 Oct 2024
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization Jui-Nan Yen Si Si Zhao Meng Felix X. Yu Sai Surya Duvvuri Inderjit Dhillon Cho-Jui Hsieh Sanjiv Kumar 72 5 0 27 Oct 2024
GeoLoRA: Geometric integration for parameter efficient fine-tuning Steffen Schotthöfer Emanuele Zangrando Gianluca Ceruti Francesco Tudisco J. Kusch AI4CE 38 2 0 24 Oct 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies Liwen Wang Sheng Chen Linnan Jiang Shu Pan Runze Cai Sen Yang Fei Yang 181 7 0 24 Oct 2024
PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers in a resource-limited Context Maximilian Augustin Syed Shakib Sarwar Mostafa Elhoushi Sai Qian Zhang Yuecheng Li B. D. Salvo 66 1 0 23 Oct 2024
LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-Tuning Yiming Shi Jiwei Wei Yujia Wu Ran Ran Chengwei Sun Shiyuan He Yang Yang ALM 97 1 0 17 Oct 2024
LoKO: Low-Rank Kalman Optimizer for Online Fine-Tuning of Large Models Hossein Abdi Mingfei Sun Andi Zhang Samuel Kaski Wei Pan 73 0 0 15 Oct 2024
Hyper Adversarial Tuning for Boosting Adversarial Robustness of Pretrained Large Vision Models Kangtao Lv Huangsen Cao Kainan Tu Yihuai Xu Zhimeng Zhang Xin Ding Yongwei Wang MoMe AAML VLM 53 1 0 08 Oct 2024
LoRTA: Low Rank Tensor Adaptation of Large Language Models Ignacio Hounie Charilaos I. Kanatsoulis Arnuv Tandon Alejandro Ribeiro 183 0 0 05 Oct 2024
AutoLoRA: AutoGuidance Meets Low-Rank Adaptation for Diffusion Models Artur Kasymov Marcin Sendera Michał Stypułkowski Maciej Ziȩba Przemysław Spurek 142 1 0 04 Oct 2024
Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint? Xi Chen Kaituo Feng Changsheng Li Xunhao Lai Xiangyu Yue Ye Yuan Guoren Wang 94 15 0 02 Oct 2024
MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards Sheng Wang Liheng Chen Pengan Chen Jingwei Dong Boyang Xue Jiyue Jiang Lingpeng Kong Chuan Wu MoE 100 9 0 01 Oct 2024
LoRKD: Low-Rank Knowledge Decomposition for Medical Foundation Models Haolin Li Yuhang Zhou Ziheng Zhao Siyuan Du Jiangchao Yao Weidi Xie Ya Zhang Yanfeng Wang 74 1 0 29 Sep 2024
Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely Siyun Zhao Yuqing Yang Zilong Wang Zhiyuan He Luna Qiu Lili Qiu SyDa RALM 3DV 118 42 0 23 Sep 2024
Communication-Efficient Federated Low-Rank Update Algorithm and its Connection to Implicit Regularization Haemin Park Diego Klabjan FedML 96 1 0 19 Sep 2024
The representation landscape of few-shot learning and fine-tuning in large language models Diego Doimo Alessandro Serra A. Ansuini Alberto Cazzaniga 135 4 0 05 Sep 2024
CoRA: Optimizing Low-Rank Adaptation with Common Subspace of Large Language Models Xiaojun Xiao Sen Shen Qiming Bao Hongfei Rong Kairui Liu Zhongsheng Wang Jing Liu 67 2 0 31 Aug 2024
Foundational Model for Electron Micrograph Analysis: Instruction-Tuning Small-Scale Language-and-Vision Assistant for Enterprise Adoption Sakhinana Sagar Srinivas Chidaksh Ravuru Geethan Sannidhi Venkataramana Runkana 73 0 0 23 Aug 2024