High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws

24 October 2024

Papers citing "High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws"

1 / 1 papers shown

Title
Weak-to-Strong Generalization Even in Random Feature Networks, Provably Marko Medvedev Kaifeng Lyu Dingli Yu Sanjeev Arora Zhiyuan Li Nathan Srebro 107 0 0 04 Mar 2025