A Comprehensive Survey on Knowledge Distillation of Diffusion Models

9 April 2023

Papers citing "A Comprehensive Survey on Knowledge Distillation of Diffusion Models"

26 / 26 papers shown

Title
Rewards Are Enough for Fast Photo-Realistic Text-to-image Generation Yihong Luo Tianyang Hu Weijian Luo Kenji Kawaguchi Jing Tang EGVM 133 0 0 17 Mar 2025
MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation Yuxiang Fu Qi Yan Lele Wang Ke Li Renjie Liao AI4TS 41 1 0 13 Mar 2025
A Survey on Diffusion Models for Anomaly Detection J. Liu Zhenchao Ma Zepu Wang Y. Liu Zehua Wang Peng Sun Liang Song Bo Hu Azzedine Boukerche Victor C.M. Leung DiffM MedIm 39 2 0 20 Jan 2025
LS-GAN: Human Motion Synthesis with Latent-space GANs Avinash Amballa Gayathri Akkinapalli Vinitra Muralikrishnan 28 1 0 30 Dec 2024
Schedule On the Fly: Diffusion Time Prediction for Faster and Better Image Generation Zilyu Ye Zhiyang Chen Tiancheng Li Zemin Huang Weijian Luo Guo-jun Qi DiffM 78 5 0 02 Dec 2024
Diff-Instruct*: Towards Human-Preferred One-step Text-to-image Generative Models Weijian Luo C. Zhang Debing Zhang Zhengyang Geng 26 3 0 28 Oct 2024
Beyond Autoregression: Fast LLMs via Self-Distillation Through Time Justin Deschenaux Çağlar Gülçehre 39 2 0 28 Oct 2024
Flow Generator Matching Zemin Huang Zhengyang Geng Weijian Luo Guo-jun Qi 33 8 0 25 Oct 2024
Diff-Instruct++: Training One-step Text-to-image Generator Model to Align with Human Preferences Weijian Luo EGVM 36 6 0 24 Oct 2024
One-Step Diffusion Distillation through Score Implicit Matching Weijian Luo Zemin Huang Zhengyang Geng J. Zico Kolter Guo-jun Qi DiffM 24 13 0 22 Oct 2024
One Step Diffusion via Shortcut Models Kevin Frans Danijar Hafner Sergey Levine Pieter Abbeel VLM DiffM 31 20 0 16 Oct 2024
Applications of Knowledge Distillation in Remote Sensing: A Survey Yassine Himeur N. Aburaed O. Elharrouss Iraklis Varlamis Shadi Atalla W. Mansoor Hussain Al Ahmad 34 4 0 18 Sep 2024
StyleTTS-ZS: Efficient High-Quality Zero-Shot Text-to-Speech Synthesis with Distilled Time-Varying Style Diffusion Yinghao Aaron Li Xilin Jiang Cong Han N. Mesgarani DiffM 29 4 0 16 Sep 2024
Consistency Flow Matching: Defining Straight Flows with Velocity Consistency Ling Yang Zixiang Zhang Zhilong Zhang Xingchao Liu Minkai Xu Wentao Zhang Chenlin Meng Stefano Ermon Bin Cui 44 18 0 02 Jul 2024
Subtractive Training for Music Stem Insertion using Latent Diffusion Models Ivan Villa-Renteria Mason L. Wang Zachary Shah Zhe Li Soohyun Kim Neelesh Ramachandran Mert Pilanci 34 0 0 27 Jun 2024
To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation Abdul Waheed Karima Kadaoui Muhammad Abdul-Mageed VLM 38 3 0 06 Jun 2024
Grounded Compositional and Diverse Text-to-3D with Pretrained Multi-View Diffusion Model Xiaolong Li Jiawei Mo Ying Wang Chethan Parameshwara Xiaohan Fei Ashwin Swaminathan C. Taylor Zhuowen Tu Paolo Favaro Stefano Soatto 53 4 0 28 Apr 2024
FlashSpeech: Efficient Zero-Shot Speech Synthesis Zhen Ye Zeqian Ju Haohe Liu Xu Tan Jianyi Chen ... Weizhen Bian Shulin He Qi-fei Liu Yi-Ting Guo Wei Xue 38 16 0 23 Apr 2024
LogicalDefender: Discovering, Extracting, and Utilizing Common-Sense Knowledge Yuhe Liu Mengxue Kang Zengchang Qin Xiangxiang Chu NAI VLM 33 0 0 18 Mar 2024
On the Design Fundamentals of Diffusion Models: A Survey Ziyi Chang G. Koulieris Hubert P. H. Shum DiffM 29 53 0 07 Jun 2023
Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models Weijian Luo Tianyang Hu Shifeng Zhang Jiacheng Sun Zhenguo Li Zhihua Zhang 27 105 0 29 May 2023
Label-Efficient Semantic Segmentation with Diffusion Models Dmitry Baranchuk Ivan Rubachev A. Voynov Valentin Khrulkov Artem Babenko DiffM VLM 195 513 0 06 Dec 2021
Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed Eric Luhman Troy Luhman DiffM 184 258 0 07 Jan 2021
Densely Connected Convolutional Networks Gao Huang Zhuang Liu L. V. D. van der Maaten Kilian Q. Weinberger PINN 3DV 249 36,356 0 25 Aug 2016
Pixel Recurrent Neural Networks Aaron van den Oord Nal Kalchbrenner Koray Kavukcuoglu SSeg GAN 227 2,545 0 25 Jan 2016
MCMC using Hamiltonian dynamics Radford M. Neal 173 3,260 0 09 Jun 2012