Continual Learning with Low Rank Adaptation

Continual Learning with Low Rank Adaptation

29 November 2023

Prabhu Teja Sivaprasad

Giovanni Zappella

ArXiv (abs)PDF HTML

Papers citing "Continual Learning with Low Rank Adaptation"

13 / 13 papers shown

Title
CL-LoRA: Continual Low-Rank Adaptation for Rehearsal-Free Class-Incremental Learning Jiangpeng He Zhihao Duan Fengqing M Zhu CLL 26 1 0 30 May 2025
PDE-Transformer: Efficient and Versatile Transformers for Physics Simulations Benjamin Holzschuh Qiang Liu Georg Kohl Nils Thuerey AI4CE 46 1 0 30 May 2025
One Rank at a Time: Cascading Error Dynamics in Sequential Learning Mahtab Alizadeh Vandchali Fangshuo Liao Anastasios Kyrillidis 31 0 0 28 May 2025
Scalable Strategies for Continual Learning with Replay Truman Hickok CLL 87 0 0 18 May 2025
Pre-Act: Multi-Step Planning and Reasoning Improves Acting in LLM Agents Mrinal Rawat Ambuje Gupta Rushil Goomer Alessandro Di Bari Neha Gupta Roberto Pieraccini LLMAG LRM 100 0 0 15 May 2025
Proxy-Anchor and EVT-Driven Continual Learning Method for Generalized Category Discovery Alireza Fathalizadeh Roozbeh Razavi-Far CLL 82 0 0 11 Apr 2025
LoRAX: LoRA eXpandable Networks for Continual Synthetic Image Attribution Danielle Sullivan-Pao Nicole Tian Pooya Khorrami CLL 94 0 0 10 Apr 2025
Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation Xiwen Wei Guihong Li R. Marculescu 71 4 0 08 Nov 2024
Dual Low-Rank Adaptation for Continual Learning with Pre-Trained Models Huancheng Chen Jingtao Li Nidham Gazagnadou Weiming Zhuang Chen Chen Lingjuan Lyu VLM CLL 158 2 0 01 Nov 2024
Incremental Learning of Retrievable Skills For Efficient Continual Task Adaptation Daehee Lee Minjong Yoo Woo Kyung Kim Wonje Choi Honguk Woo CLL 184 8 0 30 Oct 2024
Towards Lifelong Learning of Large Language Models: A Survey Junhao Zheng Shengjie Qiu Chengming Shi Qianli Ma KELM CLL 83 28 0 10 Jun 2024
An Empirical Analysis of Forgetting in Pre-trained Models with Incremental Low-Rank Updates Albin Soutif--Cormerais Simone Magistri Joost van de Weijer Andew D. Bagdanov 123 2 0 28 May 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 156 88 0 25 Apr 2024