Distillation Scaling Laws

12 February 2025

Papers citing "Distillation Scaling Laws"

4 / 4 papers shown

Title
Improving Respiratory Sound Classification with Architecture-Agnostic Knowledge Distillation from Ensembles Miika Toikkanen June-Woo Kim 7 0 0 28 May 2025
Scalable Strategies for Continual Learning with Replay Truman Hickok CLL 71 0 0 18 May 2025
Scaling Laws for Data-Efficient Visual Transfer Learning Wenxuan Yang Qingqu Wei Chenxi Ma Weimin Tan Bo Yan 36 0 0 17 Apr 2025
Scaling Laws of Synthetic Data for Language Models Zeyu Qin Qingxiu Dong Xingxing Zhang Li Dong Xiaolong Huang ... Hany Awadalla Yi R. Fung Weizhu Chen Minhao Cheng Furu Wei SyDa 110 5 0 25 Mar 2025