ResearchTrend.AI
Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging

Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging

Li Shen
Anke Tang
Enneng Yang
G. Guo
Yong Luo
Lefei Zhang
Xiaochun Cao
Di Lin
Dacheng Tao
    MoMe
ArXiv (abs)PDFHTML

Papers citing "Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging"

4 / 4 papers shown
Title
Subspace-Boosted Model Merging
Subspace-Boosted Model Merging
Ronald Skorobogat
Karsten Roth
Mariana-Iuliana Georgescu
Zeynep Akata
MoMe
18
0
0
19 Jun 2025
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications
Siyuan Mu
Sen Lin
MoE
485
5
0
10 Mar 2025
Evolutionary Optimization of Model Merging Recipes
Evolutionary Optimization of Model Merging Recipes
Takuya Akiba
Makoto Shing
Yujin Tang
Qi Sun
David Ha
MoMe
297
126
0
28 Jan 2025
Task Singular Vectors: Reducing Task Interference in Model Merging
Task Singular Vectors: Reducing Task Interference in Model Merging
Antonio Andrea Gargiulo
Donato Crisostomi
Maria Sofia Bucarelli
Simone Scardapane
Fabrizio Silvestri
Emanuele Rodolà
MoMe
165
16
0
26 Nov 2024