Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed

7 January 2021

Papers citing "Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed"

50 / 59 papers shown

Title
Distilling Two-Timed Flow Models by Separately Matching Initial and Terminal Velocities Pramook Khungurn Pratch Piyawongwisal Sira Sriswadi Supasorn Suwajanakorn 32 0 0 02 May 2025
SoccerDiffusion: Toward Learning End-to-End Humanoid Robot Soccer from Gameplay Recordings Florian Vahl Jörn Griepenburg Jan Gutsche Jasper Güldenstein Jianwei Zhang VGen 39 0 0 29 Apr 2025
Integration Flow Models Jingjing Wang Dan Zhang Joshua Luo Yin Yang Feng Luo 125 0 0 28 Apr 2025
Fast Autoregressive Models for Continuous Latent Generation Tiankai Hang Jianmin Bao Fangyun Wei Dong Chen DiffM 77 0 0 24 Apr 2025
Unleashing Vecset Diffusion Model for Fast Shape Generation Zeqiang Lai Yunfei Zhao Zibo Zhao Haolin Liu Fuyun Wang ... Jinwei Huang Yuhong Liu Jie Jiang Chunchao Guo Xiangyu Yue DiffM 144 0 0 20 Mar 2025
Learning Few-Step Diffusion Models by Trajectory Distribution Matching Yihong Luo Tianyang Hu Jiacheng Sun Yujun Cai Jing Tang DiffM 80 1 0 13 Mar 2025
Adding Additional Control to One-Step Diffusion with Joint Distribution Matching Yihong Luo Tianyang Hu Yifan Song Jiacheng Sun Z. Li Jing Tang DiffM 78 1 0 13 Mar 2025
RayFlow: Instance-Aware Diffusion Acceleration via Adaptive Flow Trajectories Huiyang Shao Xin Xia Y. Yang Yuxi Ren Xing Wang Xuefeng Xiao 56 1 0 10 Mar 2025
Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Text-to-Image Generation Quan Dao Hao Phung T. Dao Dimitris Metaxas Anh Tran 90 1 0 22 Dec 2024
Beyond Autoregression: Fast LLMs via Self-Distillation Through Time Justin Deschenaux Çağlar Gülçehre 44 2 0 28 Oct 2024
Truncated Consistency Models Sangyun Lee Yilun Xu Tomas Geffner Giulia Fanti Karsten Kreis Arash Vahdat Weili Nie 49 3 0 18 Oct 2024
Distillation of Discrete Diffusion through Dimensional Correlations Satoshi Hayakawa Yuhta Takida Masaaki Imaizumi Hiromi Wakaki Yuki Mitsufuji DiffM 61 0 0 11 Oct 2024
Text2PDE: Latent Diffusion Models for Accessible Physics Simulation Anthony Y. Zhou Zijie Li Michael Schneier John R Buchanan Jr Amir Barati Farimani AI4CE DiffM 60 5 0 02 Oct 2024
DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture Qianlong Xiang Miao Zhang Yuzhang Shang Jianlong Wu Yan Yan Liqiang Nie DiffM 60 10 0 05 Sep 2024
Adaptive Planning with Generative Models under Uncertainty Pascal Jutras-Dubé Ruqi Zhang Aniket Bera 30 2 0 02 Aug 2024
Temporal Feature Matters: A Framework for Diffusion Model Quantization Yushi Huang Ruihao Gong Xianglong Liu Jing Liu Yuhang Li Jiwen Lu Dacheng Tao DiffM MQ 49 0 0 28 Jul 2024
Maximum Entropy Inverse Reinforcement Learning of Diffusion Models with Energy-Based Models Sangwoong Yoon Himchan Hwang Dohyun Kwon Yung-Kyun Noh Frank C. Park 31 3 0 30 Jun 2024
Improving the Training of Rectified Flows Sangyun Lee Zinan Lin Giulia Fanti 36 19 0 30 May 2024
Hierarchical Uncertainty Exploration via Feedforward Posterior Trees E. Nehme Rotem Mulayoff T. Michaeli UQCV 36 2 0 24 May 2024
Bidirectional Consistency Models Liangchen Li Jiajun He DiffM 54 11 0 26 Mar 2024
Trajectory Consistency Distillation: Improved Latent Consistency Distillation by Semi-Linear Consistency Function with Trajectory Mapping Jianbin Zheng Minghui Hu Zhongyi Fan Chaoyue Wang Changxing Ding Dacheng Tao Tat-Jen Cham 43 26 0 29 Feb 2024
Uncertainty Visualization via Low-Dimensional Posterior Projections Omer Yair E. Nehme T. Michaeli UQCV 32 2 0 12 Dec 2023
SMaRt: Improving GANs with Score Matching Regularity Mengfei Xia Yujun Shen Ceyuan Yang Ran Yi Wenping Wang Yong-jin Liu 28 5 0 30 Nov 2023
Continual Learning of Diffusion Models with Generative Distillation Sergi Masip Pau Rodriguez Tinne Tuytelaars Gido M. van de Ven VLM DiffM 34 7 0 23 Nov 2023
Improved DDIM Sampling with Moment Matching Gaussian Mixtures Prasad Gabbur DiffM 22 1 0 08 Nov 2023
Bespoke Solvers for Generative Flow Models Neta Shaul Juan C. Pérez Ricky T. Q. Chen Ali K. Thabet Albert Pumarola Y. Lipman 20 23 0 29 Oct 2023
Purify++: Improving Diffusion-Purification with Advanced Diffusion Models and Control of Randomness Boya Zhang Weijian Luo Zhihua Zhang 29 10 0 28 Oct 2023
Towards More Accurate Diffusion Model Acceleration with A Timestep Aligner Mengfei Xia Yujun Shen Changsong Lei Yu Zhou Ran Yi Deli Zhao Wenping Wang Yong-jin Liu 19 5 0 14 Oct 2023
Efficient Integrators for Diffusion Generative Models Kushagra Pandey Maja R. Rudolph Stephan Mandt DiffM 21 10 0 11 Oct 2023
Diffusion Sampling with Momentum for Mitigating Divergence Artifacts Suttisak Wizadwongsa Worameth Chinchuthakun Pramook Khungurn Amit Raj Supasorn Suwajanakorn DiffM 37 2 0 20 Jul 2023
Catch-Up Distillation: You Only Need to Train Once for Accelerating Sampling Shitong Shao Xu Dai Shouyi Yin Lujun Li Huanran Chen Yang Hu 22 17 0 18 May 2023
PTQD: Accurate Post-Training Quantization for Diffusion Models Yefei He Luping Liu Jing Liu Weijia Wu Hong Zhou Bohan Zhuang DiffM MQ 26 101 0 18 May 2023
Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models A. Blattmann Robin Rombach Huan Ling Tim Dockhorn Seung Wook Kim Sanja Fidler Karsten Kreis 3DGS VGen 81 1,011 0 18 Apr 2023
A Comprehensive Survey on Knowledge Distillation of Diffusion Models Weijian Luo DiffM MedIm 52 33 0 09 Apr 2023
Minimizing Trajectory Curvature of ODE-based Generative Models Sangyun Lee Beomsu Kim Jong Chul Ye 32 53 0 27 Jan 2023
Accelerating Guided Diffusion Sampling with Splitting Numerical Methods Suttisak Wizadwongsa Supasorn Suwajanakorn DiffM 34 12 0 27 Jan 2023
Fast Inference in Denoising Diffusion Models via MMD Finetuning Emanuele Aiello D. Valsesia E. Magli DiffM 20 4 0 19 Jan 2023
Post-training Quantization on Diffusion Models Yuzhang Shang Zhihang Yuan Bin Xie Bingzhe Wu Yan Yan DiffM MQ 15 157 0 28 Nov 2022
Fast Sampling of Diffusion Models via Operator Learning Hongkai Zheng Weili Nie Arash Vahdat Kamyar Azizzadenesheli Anima Anandkumar DiffM 46 131 0 24 Nov 2022
Accelerating Diffusion Sampling with Classifier-based Feature Distillation Wujie Sun Defang Chen Can Wang Deshi Ye Yan Feng Chun-Yen Chen 35 16 0 22 Nov 2022
Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy Michael J. Smith James E. Geach 27 32 0 07 Nov 2022
From Points to Functions: Infinite-dimensional Representations in Diffusion Models Sarthak Mittal Guillaume Lajoie Stefan Bauer Arash Mehrjou DiffM 31 30 0 25 Oct 2022
Deep Equilibrium Approaches to Diffusion Models Ashwini Pokle Zhengyang Geng Zico Kolter DiffM 24 39 0 23 Oct 2022
GENIE: Higher-Order Denoising Diffusion Solvers Tim Dockhorn Arash Vahdat Karsten Kreis DiffM 49 104 0 11 Oct 2022
Efficient Diffusion Models for Vision: A Survey Anwaar Ulhaq Naveed Akhtar MedIm 32 60 0 07 Oct 2022
OCD: Learning to Overfit with Conditional Diffusion Models Shahar Lutati Lior Wolf DiffM 20 8 0 02 Oct 2022
Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow Xingchao Liu Chengyue Gong Qiang Liu OOD 33 842 0 07 Sep 2022
Diffusion Models: A Comprehensive Survey of Methods and Applications Ling Yang Zhilong Zhang Yingxia Shao Shenda Hong Runsheng Xu Yue Zhao Wentao Zhang Bin Cui Ming-Hsuan Yang DiffM MedIm 224 1,300 0 02 Sep 2022
Entropy-driven Sampling and Training Scheme for Conditional Diffusion Generation Sheng-liang Li Guangcong Zheng Haibo Wang Taiping Yao Yang Chen Shoudong Ding Xi Li DiffM 19 22 0 23 Jun 2022
Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models Fan Bao Chongxuan Li Jiacheng Sun Jun Zhu Bo Zhang DiffM 21 72 0 15 Jun 2022