v1v2v3v4 (latest)

Distillation of Discrete Diffusion through Dimensional Correlations

11 October 2024

Papers citing "Distillation of Discrete Diffusion through Dimensional Correlations"

50 / 58 papers shown

Title
Beyond Masked and Unmasked: Discrete Diffusion Models via Partial Masking Chen-Hao Chao Wei-Fang Sun Hanwen Liang Chun-Yi Lee Rahul G. Krishnan DiffM 409 0 0 24 May 2025
Variational Autoencoding Discrete Diffusion with Enhanced Dimensional Correlations Modeling Tianyu Xie Shuchen Xue Zijin Feng Tianyang Hu Jiacheng Sun Zhenguo Li Cheng Zhang DiffM 779 0 0 23 May 2025
Simplified and Generalized Masked Diffusion for Discrete Data Jiaxin Shi Kehang Han Zehao Wang Arnaud Doucet Michalis K. Titsias DiffM 227 105 0 17 Jan 2025
Beyond Autoregression: Fast LLMs via Self-Distillation Through Time Justin Deschenaux Çağlar Gülçehre 131 5 0 28 Oct 2024
Energy-Based Diffusion Language Models for Text Generation Minkai Xu Tomas Geffner Karsten Kreis Weili Nie Yilun Xu J. Leskovec Stefano Ermon Arash Vahdat DiffM 117 19 0 28 Oct 2024
$$\textit{Jump Your Steps}$: Optimizing Sampling Schedule of Discrete Diffusion Models$ $\textit{Jump Your Steps}$ : Optimizing Sampling Schedule of Discrete Diffusion Models Yong-Hyun Park Chieh-Hsin Lai Satoshi Hayakawa Yuhta Takida Yuki Mitsufuji 93 7 0 10 Oct 2024
Discrete Copula Diffusion Hoang Trung-Dung Oliver Broadrick Mathias Niepert Guy Van den Broeck DiffM 202 15 0 02 Oct 2024
SpecMaskGIT: Masked Generative Modeling of Audio Spectrograms for Efficient Audio Synthesis and Beyond Marco Comunità Zhi-Wei Zhong Akira Takahashi Shiqi Yang Mengjie Zhao Koichi Saito Yukara Ikemiya Takashi Shibuya Shusuke Takahashi Yuki Mitsufuji 112 6 0 25 Jun 2024
Simple and Effective Masked Diffusion Language Models Subham Sekhar Sahoo Marianne Arriola Yair Schiff Aaron Gokaslan Edgar Marroquin Justin T Chiu Alexander M. Rush Volodymyr Kuleshov DiffM 118 122 0 11 Jun 2024
Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data Jingyang Ou Shen Nie Kaiwen Xue Fengqi Zhu Jiacheng Sun Zhenguo Li Chongxuan Li DiffM 156 54 0 06 Jun 2024
Fast Timing-Conditioned Latent Audio Diffusion Zach Evans CJ Carr Josiah Taylor Scott H. Hawley Jordi Pons DiffM 142 117 0 07 Feb 2024
Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets A. Blattmann Tim Dockhorn Sumith Kulal Daniel Mendelevitch Maciej Kilian ... Zion English Vikram S. Voleti Adam Letts Varun Jampani Robin Rombach VGen 327 1,190 0 25 Nov 2023
Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution Aaron Lou Chenlin Meng Stefano Ermon DiffM 102 116 0 25 Oct 2023
A Pytorch Reproduction of Masked Generative Image Transformer Victor Besnier Mickael Chen ViT 111 12 0 22 Oct 2023
Improved Techniques for Training Consistency Models Yang Song Prafulla Dhariwal 85 182 0 22 Oct 2023
DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics Kaiwen Zheng Cheng Lu Jianfei Chen Jun Zhu DiffM 132 92 0 20 Oct 2023
Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion Dongjun Kim Chieh-Hsin Lai Wei-Hsiang Liao Naoki Murata Yuhta Takida Toshimitsu Uesaka Yutong He Yuki Mitsufuji Stefano Ermon DiffM 138 197 0 01 Oct 2023
Soft Mixture Denoising: Beyond the Expressive Bottleneck of Diffusion Models Yangming Li B. V. Breugel M. Schaar DiffM 59 3 0 25 Sep 2023
On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes Rishabh Agarwal Nino Vieillard Yongchao Zhou Piotr Stańczyk Sabela Ramos Matthieu Geist Olivier Bachem 105 105 0 23 Jun 2023
On the Equivalence of Consistency-Type Models: Consistency Models, Consistent Diffusion Models, and Fokker-Planck Regularization Chieh-Hsin Lai Yuhta Takida Toshimitsu Uesaka Naoki Murata Yuki Mitsufuji Stefano Ermon DiffM 80 10 0 01 Jun 2023
FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model Jiwen Yu Yinhuai Wang Chen Zhao Guohao Li Jian Zhang DiffM 81 190 0 17 Mar 2023
Consistency Models Yang Song Prafulla Dhariwal Mark Chen Ilya Sutskever VLM DiffM 119 982 0 02 Mar 2023
Consistent Diffusion Models: Mitigating Sampling Drift by Learning to be Consistent Giannis Daras Y. Dagan A. Dimakis C. Daskalakis DiffM 130 48 0 17 Feb 2023
Universal Guidance for Diffusion Models Arpit Bansal Hong-Min Chu Avi Schwarzschild Soumyadip Sengupta Micah Goldblum Jonas Geiping Tom Goldstein VLM 109 277 0 14 Feb 2023
Score-based Continuous-time Discrete Diffusion Models Haoran Sun Lijun Yu Bo Dai Dale Schuurmans H. Dai DiffM 135 87 0 30 Nov 2022
Fast Sampling of Diffusion Models via Operator Learning Hongkai Zheng Weili Nie Arash Vahdat Kamyar Azizzadenesheli Anima Anandkumar DiffM 133 152 0 24 Nov 2022
DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models Cheng Lu Yuhao Zhou Fan Bao Jianfei Chen Chongxuan Li Jun Zhu DiffM 249 616 0 02 Nov 2022
On Distillation of Guided Diffusion Models Chenlin Meng Robin Rombach Ruiqi Gao Diederik P. Kingma Stefano Ermon Jonathan Ho Tim Salimans VLM DiffM 89 536 0 06 Oct 2022
Diffusion Posterior Sampling for General Noisy Inverse Problems Hyungjin Chung Jeongsol Kim Michael T. McCann M. Klasky J. C. Ye DiffM 131 865 0 29 Sep 2022
DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps Cheng Lu Yuhao Zhou Fan Bao Jianfei Chen Chongxuan Li Jun Zhu DiffM 290 1,472 0 02 Jun 2022
Improved Vector Quantized Diffusion Models Zhicong Tang Shuyang Gu Jianmin Bao Dong Chen Fang Wen DiffM 246 63 0 31 May 2022
A Continuous Time Framework for Discrete Denoising Models Andrew Campbell Joe Benton Valentin De Bortoli Tom Rainforth George Deligiannidis Arnaud Doucet DiffM 292 168 0 30 May 2022
Flexible Diffusion Modeling of Long Videos William Harvey Saeid Naderiparizi Vaden Masrani Christian D. Weilbach Frank Wood DiffM BDL VGen 234 298 0 23 May 2022
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang ... Raphael Gontijo-Lopes Tim Salimans Jonathan Ho David J Fleet Mohammad Norouzi VLM 570 6,102 0 23 May 2022
Fast Sampling of Diffusion Models with Exponential Integrator Qinsheng Zhang Yongxin Chen DiffM 114 439 0 29 Apr 2022
Video Diffusion Models Jonathan Ho Tim Salimans Alexey A. Gritsenko William Chan Mohammad Norouzi David J. Fleet DiffM VGen 252 1,648 0 07 Apr 2022
A short note on an inequality between KL and TV C. Canonne 64 42 0 15 Feb 2022
MaskGIT: Masked Generative Image Transformer Huiwen Chang Han Zhang Lu Jiang Ce Liu William T. Freeman ViT 158 695 0 08 Feb 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 606 15,845 0 20 Dec 2021
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models Alex Nichol Prafulla Dhariwal Aditya A. Ramesh Pranav Shyam Pamela Mishkin Bob McGrew Ilya Sutskever Mark Chen 465 3,641 0 20 Dec 2021
Tackling the Generative Learning Trilemma with Denoising Diffusion GANs Zhisheng Xiao Karsten Kreis Arash Vahdat DiffM 126 561 0 15 Dec 2021
Vector Quantized Diffusion Model for Text-to-Image Synthesis Shuyang Gu Dong Chen Jianmin Bao Fang Wen Bo Zhang Dongdong Chen Lu Yuan B. Guo DiffM 214 800 0 29 Nov 2021
Structured Denoising Diffusion Models in Discrete State-Spaces Jacob Austin Daniel D. Johnson Jonathan Ho Daniel Tarlow Rianne van den Berg DiffM 282 950 0 07 Jul 2021
Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions Emiel Hoogeboom Didrik Nielsen P. Jaini Patrick Forré Max Welling DiffM 308 427 0 10 Feb 2021
MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui 156 364 0 02 Feb 2021
Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed Eric Luhman Troy Luhman DiffM 244 282 0 07 Jan 2021
Taming Transformers for High-Resolution Image Synthesis Patrick Esser Robin Rombach Bjorn Ommer ViT 141 3,015 0 17 Dec 2020
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song Jascha Narain Sohl-Dickstein Diederik P. Kingma Abhishek Kumar Stefano Ermon Ben Poole DiffM SyDa 516 6,599 0 26 Nov 2020
Denoising Diffusion Implicit Models Jiaming Song Chenlin Meng Stefano Ermon VLM DiffM 334 7,525 0 06 Oct 2020
DiffWave: A Versatile Diffusion Model for Audio Synthesis Zhifeng Kong Ming-Yu Liu Jiaji Huang Kexin Zhao Bryan Catanzaro DiffM BDL 216 1,471 0 21 Sep 2020