Task Singular Vectors: Reducing Task Interference in Model Merging

26 November 2024

Papers citing "Task Singular Vectors: Reducing Task Interference in Model Merging"

6 / 6 papers shown

Title
Mergenetic: a Simple Evolutionary Model Merging Library Adrian Robert Minut Tommaso Mencattini Andrea Santilli Donato Crisostomi Emanuele Rodolà MoMe 32 0 0 16 May 2025
MASS: MoErging through Adaptive Subspace Selection Donato Crisostomi Alessandro Zirilli Antonio Andrea Gargiulo Maria Sofia Bucarelli Simone Scardapane Fabrizio Silvestri Iacopo Masi Emanuele Rodolà MoMe 45 0 0 06 Apr 2025
AdaRank: Adaptive Rank Pruning for Enhanced Model Merging Chanhyuk Lee Jiho Choi Chanryeol Lee Donggyun Kim Seunghoon Hong MoMe 60 0 0 28 Mar 2025
Layer-Aware Task Arithmetic: Disentangling Task-Specific and Instruction-Following Knowledge Yan-Lun Chen Yi-Ru Wei Chia-Yi Hsu Chia-Mu Yu Chun-ying Huang Ying-Dar Lin Yu-Sung Wu Wei-Bin Lee MoMe KELM 61 0 0 27 Feb 2025
Scalable Model Merging with Progressive Layer-wise Distillation Jing Xu Jiazheng Li J.N. Zhang MoMe FedML 90 0 0 18 Feb 2025
ATM: Improving Model Merging by Alternating Tuning and Merging Luca Zhou Daniele Solombrino Donato Crisostomi Maria Sofia Bucarelli Fabrizio Silvestri Emanuele Rodolà MoMe 50 5 0 05 Nov 2024