MUSCLE: A Model Update Strategy for Compatible LLM Evolution

MUSCLE: A Model Update Strategy for Compatible LLM Evolution

12 July 2024

Jessica Echterhoff

Raviteja Vemulapalli

Hadi Pouransari

Papers citing "MUSCLE: A Model Update Strategy for Compatible LLM Evolution"

8 / 8 papers shown

Title
X-Adapter: Adding Universal Compatibility of Plugins for Upgraded Diffusion Model L. Ran Xiaodong Cun Jia-Wei Liu Rui Zhao Song Zijie Xintao Wang Jussi Keppo Mike Zheng Shou 50 12 0 04 Dec 2023
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model Karsten Roth Lukas Thede Almut Sophia Koepke Oriol Vinyals Olivier J. Hénaff Zeynep Akata AAML 50 12 0 26 Oct 2023
Recyclable Tuning for Continual Pre-training Yujia Qin Cheng Qian Xu Han Yankai Lin Huadong Wang Ruobing Xie Zhiyuan Liu Maosong Sun Jie Zhou CLL 41 11 0 15 May 2023
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 173 9,946 0 17 Jun 2021
Regression Bugs Are In Your Model! Measuring, Reducing and Analyzing Regressions In NLP Model Updates Yuqing Xie Yi-An Lai Yuanjun Xiong Yi Zhang Stefano Soatto UQCV 30 16 0 07 May 2021
An Empirical Analysis of Backward Compatibility in Machine Learning Systems Megha Srivastava Besmira Nushi Ece Kamar S. Shah Eric Horvitz AAML 66 44 0 11 Aug 2020
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems Alex Jinpeng Wang Yada Pruksachatkun Nikita Nangia Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 150 2,287 0 02 May 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 171 5,668 0 21 Apr 2019