Bigger Isn't Always Memorizing: Early Stopping Overparameterized Diffusion Models

22 May 2025

Papers citing "Bigger Isn't Always Memorizing: Early Stopping Overparameterized Diffusion Models"

31 / 31 papers shown

Title
Learning curves theory for hierarchically compositional data with power-law distributed features Francesco Cagnetta Hyunmo Kang Matthieu Wyart 117 1 0 11 May 2025
On the Generalization Properties of Diffusion Models Puheng Li Zhong Li Huishuai Zhang Jiang Bian 204 38 0 13 Mar 2025
On Memorization in Diffusion Models Xiangming Gu Chao Du Tianyu Pang Chongxuan Li Min Lin Ye Wang DiffM TDI 337 55 0 21 Feb 2025
How Compositional Generalization and Creativity Improve as Diffusion Models are Trained Alessandro Favero Antonio Sclocchi Francesco Cagnetta Pascal Frossard Matthieu Wyart DiffM CoGe 83 6 0 17 Feb 2025
Large Language Diffusion Models Shen Nie Fengqi Zhu Zebin You Xiaolu Zhang Jingyang Ou Jun Hu Jun Zhou Yankai Lin Ji-Rong Wen Chongxuan Li 235 55 0 14 Feb 2025
Denoising Score Matching with Random Features: Insights on Diffusion Models from Precise Learning Curves Anand Jerry George Rodrigo Veiga Nicolas Macris DiffM 33 3 0 01 Feb 2025
Simplified and Generalized Masked Diffusion for Discrete Data Jiaxin Shi Kehang Han Zehao Wang Arnaud Doucet Michalis K. Titsias DiffM 172 105 0 17 Jan 2025
An analytic theory of creativity in convolutional diffusion models Mason Kamb Surya Ganguli DiffM 69 18 0 28 Dec 2024
Probing the Latent Hierarchical Structure of Data via Diffusion Models Antonio Sclocchi Alessandro Favero Noam Itzhak Levi Matthieu Wyart DiffM 98 5 0 17 Oct 2024
How transformers learn structured data: insights from hierarchical filtering Jerome Garnier-Brun Marc Mézard Emanuele Moscato Luca Saglietti 134 6 0 27 Aug 2024
Replication in Visual Diffusion Models: A Survey and Outlook Wenhao Wang Yifan Sun Zongxin Yang Zhengdong Hu Zhentao Tan Yi Yang 174 9 0 07 Jul 2024
Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalization Yinbin Han Meisam Razaviyayn Renyuan Xu DiffM 105 16 0 28 Jan 2024
The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instability Luca Ambrogioni AI4CE DiffM 85 20 0 26 Oct 2023
Analysis of learning a flow-based generative model from limited sample complexity Hugo Cui Florent Krzakala Eric Vanden-Eijnden Lenka Zdeborová DRL 63 20 0 05 Oct 2023
Membership Inference of Diffusion Models Hailong Hu Jun Pang 77 39 0 24 Jan 2023
LAION-5B: An open large-scale dataset for training next generation image-text models Christoph Schuhmann Romain Beaumont Richard Vencu Cade Gordon Ross Wightman ... Srivatsa Kundurthy Katherine Crowson Ludwig Schmidt R. Kaczmarczyk J. Jitsev VLM MLLM CLIP 200 3,502 0 16 Oct 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 413 6,916 0 13 Apr 2022
Video Diffusion Models Jonathan Ho Tim Salimans Alexey A. Gritsenko William Chan Mohammad Norouzi David J. Fleet DiffM VGen 211 1,642 0 07 Apr 2022
A Self-Supervised Descriptor for Image Copy Detection Ed Pizzi Sreya . Dutta Roy Sugosh Nagavara Ravindra Priya Goyal Matthijs Douze SSL 93 126 0 21 Feb 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 496 15,788 0 20 Dec 2021
Structured Denoising Diffusion Models in Discrete State-Spaces Jacob Austin Daniel D. Johnson Jonathan Ho Daniel Tarlow Rianne van den Berg DiffM 188 948 0 07 Jul 2021
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal Alex Nichol 271 7,958 0 11 May 2021
Improved Denoising Diffusion Probabilistic Models Alex Nichol Prafulla Dhariwal DiffM 352 3,728 0 18 Feb 2021
Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions Emiel Hoogeboom Didrik Nielsen P. Jaini Patrick Forré Max Welling DiffM 297 426 0 10 Feb 2021
Feature Learning in Infinite-Width Neural Networks Greg Yang J. E. Hu MLT 93 156 0 30 Nov 2020
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song Jascha Narain Sohl-Dickstein Diederik P. Kingma Abhishek Kumar Stefano Ermon Ben Poole DiffM SyDa 353 6,586 0 26 Nov 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 736 18,364 0 19 Jun 2020
Generative Modeling by Estimating Gradients of the Data Distribution Yang Song Stefano Ermon SyDa DiffM 258 3,961 0 12 Jul 2019
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 798 132,454 0 12 Jun 2017
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.9K 77,441 0 18 May 2015
Deep Unsupervised Learning using Nonequilibrium Thermodynamics Jascha Narain Sohl-Dickstein Eric A. Weiss Niru Maheswaranathan Surya Ganguli SyDa DiffM 312 7,031 0 12 Mar 2015