$C^2M^3$: Cycle-Consistent Multi-Model Merging

$C^2M^3$ : Cycle-Consistent Multi-Model Merging

28 May 2024

Donato Crisostomi

Emanuele Rodolà

Papers citing "$C^2M^3$: Cycle-Consistent Multi-Model Merging"

15 / 15 papers shown

Title
Task Singular Vectors: Reducing Task Interference in Model Merging Antonio Andrea Gargiulo Donato Crisostomi Maria Sofia Bucarelli Simone Scardapane Fabrizio Silvestri Emanuele Rodolà MoMe 129 14 0 26 Nov 2024
ATM: Improving Model Merging by Alternating Tuning and Merging Luca Zhou Daniele Solombrino Donato Crisostomi Maria Sofia Bucarelli Fabrizio Silvestri Emanuele Rodolà MoMe 96 5 0 05 Nov 2024
Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods Akira Ito Masanori Yamada Atsutoshi Kumagai MoMe 94 5 0 06 Feb 2024
Re-basin via implicit Sinkhorn differentiation F. Guerrero-Peña H. R. Medeiros Thomas Dubail Masih Aminbeidokhti Eric Granger M. Pedersoli MoMe 63 48 0 22 Dec 2022
Mechanistic Mode Connectivity Ekdeep Singh Lubana Eric J. Bigelow Robert P. Dick David M. Krueger Hidenori Tanaka 77 46 0 15 Nov 2022
REPAIR: REnormalizing Permuted Activations for Interpolation Repair Keller Jordan Hanie Sedghi O. Saukh R. Entezari Behnam Neyshabur MoMe 59 97 0 15 Nov 2022
Git Re-Basin: Merging Models modulo Permutation Symmetries Samuel K. Ainsworth J. Hayase S. Srinivasa MoMe 280 328 0 11 Sep 2022
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 72 229 0 12 Oct 2021
Sparse Quadratic Optimisation over the Stiefel Manifold with Application to Permutation Synchronisation Florian Bernard Daniel Cremers J. Thunberg 110 8 0 30 Sep 2021
Flower: A Friendly Federated Learning Research Framework Daniel J. Beutel Taner Topal Akhil Mathur Xinchi Qiu Javier Fernandez-Marques ... Lorenzo Sani Kwing Hei Li Titouan Parcollet Pedro Porto Buarque de Gusmão Nicholas D. Lane FedML 105 804 0 28 Jul 2020
Model Fusion via Optimal Transport Sidak Pal Singh Martin Jaggi MoMe FedML 92 232 0 12 Oct 2019
Essentially No Barriers in Neural Network Energy Landscape Felix Dräxler K. Veschgini M. Salmhofer Fred Hamprecht MoMe 105 432 0 02 Mar 2018
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 330 10,467 0 21 Jul 2016
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 409 43,234 0 11 Feb 2015
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.3K 100,213 0 04 Sep 2014