Soup to go: mitigating forgetting during continual learning with model averaging

9 January 2025

Papers citing "Soup to go: mitigating forgetting during continual learning with model averaging"

3 / 3 papers shown

Title
Context-Free Synthetic Data Mitigates Forgetting Parikshit Bansal Sujay Sanghavi CLL 139 0 0 20 May 2025
Arcee's MergeKit: A Toolkit for Merging Large Language Models Charles Goddard Shamane Siriwardhana Malikeh Ehghaghi Luke Meyers Vladimir Karpukhin Brian Benedict Mark McQuade Jacob Solawetz MoMe KELM 205 103 0 20 Mar 2024
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning Yun Luo Zhen Yang Fandong Meng Yafu Li Jie Zhou Yue Zhang CLL KELM 221 319 0 17 Aug 2023