Context-Free Synthetic Data Mitigates Forgetting

20 May 2025

Papers citing "Context-Free Synthetic Data Mitigates Forgetting"

14 / 14 papers shown

Title
MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphs Juncheng Wu Wenlong Deng Xiaochen Li Sheng Liu Taomian Mi ... Yihan Cao Hui Ren Xuzhao Li Xiaoxiao Li Yuyin Zhou AI4MH LRM 96 8 0 01 Apr 2025
Upweighting Easy Samples in Fine-Tuning Mitigates Forgetting Sunny Sanyal Hayden Prairie Rudrajit Das Ali Kavis Sujay Sanghavi 105 1 0 05 Feb 2025
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning DeepSeek-AI Daya Guo Dejian Yang Haowei Zhang Junxiao Song ... Shiyu Wang S. Yu Shunfeng Zhou Shuting Pan S.S. Li ReLM VLM OffRL AI4TS LRM 303 1,503 0 22 Jan 2025
Soup to go: mitigating forgetting during continual learning with model averaging Anat Kleiman Gintare Karolina Dziugaite Jonathan Frankle Sham Kakade Mansheej Paul MoMe CLL KELM 79 1 0 09 Jan 2025
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 129 3 0 30 Jul 2024
Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research Luca Soldaini Rodney Michael Kinney Akshita Bhagia Dustin Schwenk David Atkinson ... Hanna Hajishirzi Iz Beltagy Dirk Groeneveld Jesse Dodge Kyle Lo 78 265 0 31 Jan 2024
Mitigating the Alignment Tax of RLHF Yong Lin Hangyu Lin Wei Xiong Shizhe Diao Zeming Zheng ... Han Zhao Nan Jiang Heng Ji Yuan Yao Tong Zhang MoMe CLL 50 75 0 12 Sep 2023
Maintaining Plasticity in Continual Learning via Regenerative Regularization Saurabh Kumar Henrik Marklund Benjamin Van Roy CLL KELM 64 20 0 23 Aug 2023
Editing Models with Task Arithmetic Gabriel Ilharco Marco Tulio Ribeiro Mitchell Wortsman Suchin Gururangan Ludwig Schmidt Hannaneh Hajishirzi Ali Farhadi KELM MoMe MU 152 474 0 08 Dec 2022
Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learning James Smith Yen-Chang Hsu John C. Balloch Yilin Shen Hongxia Jin Z. Kira CLL 93 165 0 17 Jun 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 312 10,099 0 17 Jun 2021
Experience Replay for Continual Learning David Rolnick Arun Ahuja Jonathan Richard Schwarz Timothy Lillicrap Greg Wayne CLL 108 1,139 0 28 Nov 2018
FearNet: Brain-Inspired Model for Incremental Learning Ronald Kemker Christopher Kanan CLL 85 476 0 28 Nov 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 298 7,410 0 02 Dec 2016