ResearchTrend.AI
Soup to go: mitigating forgetting during continual learning with model averaging

Soup to go: mitigating forgetting during continual learning with model averaging

Anat Kleiman
Gintare Karolina Dziugaite
Jonathan Frankle
Sham Kakade
Mansheej Paul
ArXiv (abs)PDFHTML

Papers citing "Soup to go: mitigating forgetting during continual learning with model averaging"

3 / 3 papers shown
Title
Context-Free Synthetic Data Mitigates Forgetting
Context-Free Synthetic Data Mitigates Forgetting
Parikshit Bansal
Sujay Sanghavi
CLL
139
0
0
20 May 2025
Arcee's MergeKit: A Toolkit for Merging Large Language Models
Arcee's MergeKit: A Toolkit for Merging Large Language Models
Charles Goddard
Shamane Siriwardhana
Malikeh Ehghaghi
Luke Meyers
Vladimir Karpukhin
Brian Benedict
Mark McQuade
Jacob Solawetz
MoMeKELM
202
103
0
20 Mar 2024
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
Yun Luo
Zhen Yang
Fandong Meng
Yafu Li
Jie Zhou
Yue Zhang
CLLKELM
221
319
0
17 Aug 2023

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.