Beyond Masked and Unmasked: Discrete Diffusion Models via Partial Masking

24 May 2025

Papers citing "Beyond Masked and Unmasked: Discrete Diffusion Models via Partial Masking"

25 / 25 papers shown

Title
Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models Marianne Arriola Aaron Gokaslan Justin T Chiu Zhihan Yang Zhixuan Qi Jiaqi Han Subham Sekhar Sahoo Volodymyr Kuleshov DiffM 146 11 0 12 Mar 2025
Remasking Discrete Diffusion Models with Inference-Time Scaling Guanghan Wang Yair Schiff Subham Sekhar Sahoo Volodymyr Kuleshov DiffM 104 9 0 01 Mar 2025
Large Language Diffusion Models Shen Nie Fengqi Zhu Zebin You Xiaolu Zhang Jingyang Ou Jun Hu Jun Zhou Yankai Lin Ji-Rong Wen Chongxuan Li 152 38 0 14 Feb 2025
Simplified and Generalized Masked Diffusion for Discrete Data Jiaxin Shi Kehang Han Zehao Wang Arnaud Doucet Michalis K. Titsias DiffM 117 89 0 17 Jan 2025
Beyond Autoregression: Fast LLMs via Self-Distillation Through Time Justin Deschenaux Çağlar Gülçehre 69 3 0 28 Oct 2024
Energy-Based Diffusion Language Models for Text Generation Minkai Xu Tomas Geffner Karsten Kreis Weili Nie Yilun Xu J. Leskovec Stefano Ermon Arash Vahdat DiffM 74 14 0 28 Oct 2024
Distillation of Discrete Diffusion through Dimensional Correlations Satoshi Hayakawa Yuhta Takida Masaaki Imaizumi Hiromi Wakaki Yuki Mitsufuji DiffM 78 3 0 11 Oct 2024
Discrete Copula Diffusion Hoang Trung-Dung Oliver Broadrick Mathias Niepert Guy Van den Broeck DiffM 107 9 0 02 Oct 2024
Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data Jingyang Ou Shen Nie Kaiwen Xue Fengqi Zhu Jiacheng Sun Zhenguo Li Chongxuan Li DiffM 72 44 0 06 Jun 2024
Unlocking Guidance for Discrete State-Space Diffusion and Flow Models Hunter Nisonoff Junhao Xiong Stephan Allenspach Jennifer Listgarten 93 37 0 03 Jun 2024
Improved Techniques for Maximum Likelihood Estimation for Diffusion ODEs Kaiwen Zheng Cheng Lu Jianfei Chen Jun Zhu DiffM 61 30 0 06 May 2023
Continuous diffusion for categorical data Sander Dieleman Laurent Sartran Arman Roshannai Nikolay Savinov Yaroslav Ganin ... Conor Durkan Curtis Hawthorne Rémi Leblond Will Grathwohl J. Adler DiffM 61 104 0 28 Nov 2022
Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning Ting-Li Chen Ruixiang Zhang Geoffrey E. Hinton DiffM 62 300 0 08 Aug 2022
Structured Denoising Diffusion Models in Discrete State-Spaces Jacob Austin Daniel D. Johnson Jonathan Ho Daniel Tarlow Rianne van den Berg DiffM 109 900 0 07 Jul 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 139 2,307 0 20 Apr 2021
Perceiver: General Perception with Iterative Attention Andrew Jaegle Felix Gimeno Andrew Brock Andrew Zisserman Oriol Vinyals João Carreira VLM ViT MDE 135 1,003 0 04 Mar 2021
Maximum Likelihood Training of Score-Based Diffusion Models Yang Song Conor Durkan Iain Murray Stefano Ermon DiffM 96 648 0 22 Jan 2021
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 299 17,550 0 19 Jun 2020
Training Generative Adversarial Networks with Limited Data Tero Karras M. Aittala Janne Hellsten S. Laine J. Lehtinen Timo Aila GAN 120 1,873 0 11 Jun 2020
Generative Modeling by Estimating Gradients of the Data Distribution Yang Song Stefano Ermon SyDa DiffM 178 3,803 0 12 Jul 2019
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents Arman Cohan Franck Dernoncourt Doo Soon Kim Trung Bui Seokhwan Kim W. Chang Nazli Goharian 265 752 0 16 Apr 2018
A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets P. Chrabaszcz I. Loshchilov Frank Hutter SSeg OOD 101 642 0 27 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 453 129,831 0 12 Jun 2017
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 168 2,814 0 26 Sep 2016
Faster Eigenvector Computation via Shift-and-Invert Preconditioning Dan Garber Laurent Dinh Chi Jin Jascha Narain Sohl-Dickstein Samy Bengio Praneeth Netrapalli Aaron Sidford 185 3,681 0 26 May 2016