Task Arithmetic with LoRA for Continual Learning

Task Arithmetic with LoRA for Continual Learning

4 November 2023

Archana Ghotkar

Papers citing "Task Arithmetic with LoRA for Continual Learning"

14 / 14 papers shown

Title
ReqBrain: Task-Specific Instruction Tuning of LLMs for AI-Assisted Requirements Generation Mohammad Kasra Habib Daniel Graziotin Stefan Wagner 179 0 0 23 May 2025
When is Task Vector Provably Effective for Model Editing? A Generalization Analysis of Nonlinear Transformers Hongkang Li Yihua Zhang Shuai Zhang Ming Wang Sijia Liu Pin-Yu Chen MoMe 185 8 0 15 Apr 2025
R-MTLLMF: Resilient Multi-Task Large Language Model Fusion at the Wireless Edge Aladin Djuhera Vlad-Costin Andrei Mohsen Pourghasemian Haris Gacanin Holger Boche Walid Saad MoMe 158 0 0 24 Feb 2025
An Empirical Analysis of Forgetting in Pre-trained Models with Incremental Low-Rank Updates Albin Soutif--Cormerais Simone Magistri Joost van de Weijer Andew D. Bagdanov 81 2 0 28 May 2024
Continual VQA for Disaster Response Systems Aditya Kane V. Manushree Sahil Khose 93 3 0 21 Sep 2022
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 258 2,824 0 15 Jun 2021
Avalanche: an End-to-End Library for Continual Learning Vincenzo Lomonaco Lorenzo Pellegrini Andrea Cossu Antonio Carta G. Graffieti ... Christopher Kanan Joost van de Weijer Tinne Tuytelaars D. Bacciu Davide Maltoni BDL AI4TS 93 183 0 01 Apr 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 441 21,418 0 25 Mar 2021
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases Stéphane dÁscoli Hugo Touvron Matthew L. Leavitt Ari S. Morcos Giulio Biroli Levent Sagun ViT 114 826 0 19 Mar 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 377 6,762 0 23 Dec 2020
Efficient Lifelong Learning with A-GEM Arslan Chaudhry MarcÁurelio Ranzato Marcus Rohrbach Mohamed Elhoseiny CLL 199 1,453 0 02 Dec 2018
Experience Replay for Continual Learning David Rolnick Arun Ahuja Jonathan Richard Schwarz Timothy Lillicrap Greg Wayne CLL 116 1,160 0 28 Nov 2018
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 354 7,504 0 02 Dec 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 292 4,402 0 29 Jun 2016