39
0

Bezier Distillation

Abstract

In Rectified Flow, by obtaining the rectified flow several times, the mapping relationship between distributions can be distilled into a neural network, and the target distribution can be directly predicted by the straight lines of the flow. However, during the pairing process of the mapping relationship, a large amount of error accumulation will occur, resulting in a decrease in performance after multiple rectifications. In the field of flow models, knowledge distillation of multi - teacher diffusion models is also a problem worthy of discussion in accelerating sampling. I intend to combine multi - teacher knowledge distillation with Bezier curves to solve the problem of error accumulation. Currently, the related paper is being written by myself.

View on arXiv
@article{feng2025_2503.16562,
  title={ Bezier Distillation },
  author={ Ling Feng and SK Yang },
  journal={arXiv preprint arXiv:2503.16562},
  year={ 2025 }
}
Comments on this paper