Proving Linear Mode Connectivity of Neural Networks via Optimal
Transport

Proving Linear Mode Connectivity of Neural Networks via Optimal Transport

29 October 2023

Baptiste Goujaud

Aymeric Dieuleveut

Papers citing "Proving Linear Mode Connectivity of Neural Networks via Optimal Transport"

17 / 17 papers shown

Title
Understanding Mode Connectivity via Parameter Space Symmetry B. Zhao Nima Dehmamy Robin Walters Rose Yu 124 7 0 29 May 2025
Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusion Binchi Zhang Zaiyi Zheng Zhengzhang Chen Wenlin Yao 125 0 0 01 Feb 2025
Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods Akira Ito Masanori Yamada Atsutoshi Kumagai MoMe 88 5 0 06 Feb 2024
Layer-wise Linear Mode Connectivity Linara Adilova Maksym Andriushchenko Michael Kamp Asja Fischer Martin Jaggi FedML FAtt MoMe 67 15 0 13 Jul 2023
Mechanistic Mode Connectivity Ekdeep Singh Lubana Eric J. Bigelow Robert P. Dick David M. Krueger Hidenori Tanaka 70 45 0 15 Nov 2022
Git Re-Basin: Merging Models modulo Permutation Symmetries Samuel K. Ainsworth J. Hayase S. Srinivasa MoMe 268 326 0 11 Sep 2022
The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks R. Entezari Hanie Sedghi O. Saukh Behnam Neyshabur MoMe 65 226 0 12 Oct 2021
Analyzing Monotonic Linear Interpolation in Neural Network Loss Landscapes James Lucas Juhan Bae Michael Ruogu Zhang Stanislav Fort R. Zemel Roger C. Grosse MoMe 195 28 0 22 Apr 2021
What is being transferred in transfer learning? Behnam Neyshabur Hanie Sedghi Chiyuan Zhang 68 513 0 26 Aug 2020
Optimal Lottery Tickets via SubsetSum: Logarithmic Over-Parameterization is Sufficient Ankit Pensia Shashank Rajput Alliot Nagle Harit Vishwakarma Dimitris Papailiopoulos 48 103 0 14 Jun 2020
Proving the Lottery Ticket Hypothesis: Pruning is All You Need Eran Malach Gilad Yehudai Shai Shalev-Shwartz Ohad Shamir 96 272 0 03 Feb 2020
Model Fusion via Optimal Transport Sidak Pal Singh Martin Jaggi MoMe FedML 78 231 0 12 Oct 2019
Essentially No Barriers in Neural Network Energy Landscape Felix Dräxler K. Veschgini M. Salmhofer Fred Hamprecht MoMe 97 430 0 02 Mar 2018
Sharp asymptotic and finite-sample rates of convergence of empirical measures in Wasserstein distance Jonathan Niles-Weed Francis R. Bach 139 417 0 01 Jul 2017
Topology and Geometry of Half-Rectified Network Optimization C. Freeman Joan Bruna 147 235 0 04 Nov 2016
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 371 2,922 0 15 Sep 2016
Qualitatively characterizing neural network optimization problems Ian Goodfellow Oriol Vinyals Andrew M. Saxe ODL 90 519 0 19 Dec 2014