Enhanced Controllability of Diffusion Models via Feature Disentanglement and Realism-Enhanced Sampling Methods

28 February 2023

David I. Inouye

Papers citing "Enhanced Controllability of Diffusion Models via Feature Disentanglement and Realism-Enhanced Sampling Methods"

48 / 48 papers shown

Title
CoInD: Enabling Logical Compositions in Diffusion Models Sachit Gaudi Gautam Sreekumar Vishnu Boddeti CoGe 96 0 0 03 Mar 2025
Diff3Dformer: Leveraging Slice Sequence Diffusion for Enhanced 3D CT Classification with Transformer Networks Zihao Jin Yingying Fang Jiahao Huang Caiwen Xu Simon Walsh Guang Yang MedIm 97 0 0 24 Jun 2024
DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representations Tianhao Qi Shancheng Fang Yanze Wu Hongtao Xie Jiawei Liu Lang Chen Qian He Yongdong Zhang DiffM 44 37 0 11 Mar 2024
IMPUS: Image Morphing with Perceptually-Uniform Sampling Using Diffusion Models Zhaoyuan Yang Zhengyang Yu Zhiwei Xu Jaskirat Singh Jing Zhang Dylan Campbell Peter Tu Richard Hartley 52 11 0 12 Nov 2023
VoiceLDM: Text-to-Speech with Environmental Context Yeong-Won Lee In-won Yeon Juhan Nam Joon Son Chung VLM DiffM 49 10 0 24 Sep 2023
Dance with You: The Diversity Controllable Dancer Generation via Diffusion Models Siyue Yao Mingjie Sun Bingliang Li Fengyu Yang Junle Wang Ruimao Zhang DiffM 106 18 0 23 Aug 2023
Unsupervised Compositional Concepts Discovery with Text-to-Image Generative Models Nan Liu Yilun Du Shuang Li J. Tenenbaum Antonio Torralba DiffM CoGe 39 27 0 08 Jun 2023
T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models Chong Mou Xintao Wang Liangbin Xie Yanze Wu Shuai Liu Zhongang Qi Ying Shan Xiaohu Qie DiffM 54 999 0 16 Feb 2023
Adding Conditional Control to Text-to-Image Diffusion Models Lvmin Zhang Anyi Rao Maneesh Agrawala AI4CE 70 4,015 1 10 Feb 2023
InstructPix2Pix: Learning to Follow Image Editing Instructions Tim Brooks Aleksander Holynski Alexei A. Efros DiffM 152 1,745 0 17 Nov 2022
eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers Yogesh Balaji Seungjun Nah Xun Huang Arash Vahdat Jiaming Song ... Timo Aila S. Laine Bryan Catanzaro Tero Karras Xuan Li VLM MoE 138 817 0 02 Nov 2022
MagicMix: Semantic Mixing with Diffusion Models Jun Hao Liew Hanshu Yan Daquan Zhou Jiashi Feng DiffM 207 61 0 28 Oct 2022
Imagic: Text-Based Real Image Editing with Diffusion Models Bahjat Kawar Shiran Zada Oran Lang Omer Tov Hui-Tang Chang Tali Dekel Inbar Mosseri Michal Irani 51 1,064 0 17 Oct 2022
Diffusion-based Image Translation using Disentangled Style and Content Representation Gihyun Kwon Jong Chul Ye DiffM 176 157 0 30 Sep 2022
DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation Nataniel Ruiz Yuanzhen Li Varun Jampani Yael Pritch Michael Rubinstein Kfir Aberman 193 2,789 0 25 Aug 2022
Prompt-to-Prompt Image Editing with Cross Attention Control Amir Hertz Ron Mokady J. Tenenbaum Kfir Aberman Yael Pritch Daniel Cohen-Or DiffM 128 1,746 0 02 Aug 2022
An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion Rinon Gal Yuval Alaluf Yuval Atzmon Or Patashnik Amit H. Bermano Gal Chechik Daniel Cohen-Or 86 1,837 0 02 Aug 2022
Classifier-Free Diffusion Guidance Jonathan Ho Tim Salimans FaML 86 3,830 0 26 Jul 2022
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation Jiahui Yu Yuanzhong Xu Jing Yu Koh Thang Luong Gunjan Baid ... Zarana Parekh Xin Li Han Zhang Jason Baldridge Yonghui Wu EGVM 158 1,089 0 22 Jun 2022
Compositional Visual Generation with Composable Diffusion Models Nan Liu Shuang Li Yilun Du Antonio Torralba J. Tenenbaum DiffM CoGe 118 510 0 03 Jun 2022
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang ... Raphael Gontijo-Lopes Tim Salimans Jonathan Ho David J Fleet Mohammad Norouzi VLM 286 5,904 0 23 May 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 282 6,768 0 13 Apr 2022
Perception Prioritized Training of Diffusion Models Jooyoung Choi Jungbeom Lee Chaehun Shin Sungwon Kim Hyunwoo J. Kim Sung-Hoon Yoon DiffM 53 239 0 01 Apr 2022
Splicing ViT Features for Semantic Appearance Transfer Narek Tumanyan Omer Bar-Tal Shai Bagon Tali Dekel DiffM 54 177 0 02 Jan 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 265 15,081 0 20 Dec 2021
Diffusion Autoencoders: Toward a Meaningful and Decodable Representation Konpat Preechakul Nattanat Chatthee Suttisak Wizadwongsa Supasorn Suwajanakorn SyDa DiffM 99 423 0 30 Nov 2021
DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation Gwanghyun Kim Taesung Kwon Jong Chul Ye DiffM 130 634 0 06 Oct 2021
ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models Jooyoung Choi Sungwon Kim Yonghyun Jeong Youngjune Gwon Sungroh Yoon DiffM 112 706 0 06 Aug 2021
SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations Chenlin Meng Yutong He Yang Song Jiaming Song Jiajun Wu Jun-Yan Zhu Stefano Ermon DiffM 107 1,467 0 02 Aug 2021
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal Alex Nichol 148 7,639 0 11 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 587 5,920 0 29 Apr 2021
Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translation Gihyun Kwon Jong Chul Ye 84 52 0 30 Mar 2021
Improved Denoising Diffusion Probabilistic Models Alex Nichol Prafulla Dhariwal DiffM 184 3,621 0 18 Feb 2021
Taming Transformers for High-Resolution Image Synthesis Patrick Esser Robin Rombach Bjorn Ommer ViT 97 2,890 0 17 Dec 2020
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song Jascha Narain Sohl-Dickstein Diederik P. Kingma Abhishek Kumar Stefano Ermon Ben Poole DiffM SyDa 266 6,293 0 26 Nov 2020
Denoising Diffusion Implicit Models Jiaming Song Chenlin Meng Stefano Ermon VLM DiffM 147 7,166 0 06 Oct 2020
Swapping Autoencoder for Deep Image Manipulation Taesung Park Jun-Yan Zhu Oliver Wang Jingwan Lu Eli Shechtman Alexei A. Efros Richard Y. Zhang 79 335 0 01 Jul 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 299 17,550 0 19 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 500 41,106 0 28 May 2020
GANSpace: Discovering Interpretable GAN Controls Erik Härkönen Aaron Hertzmann J. Lehtinen Sylvain Paris 99 900 0 06 Apr 2020
StarGAN v2: Diverse Image Synthesis for Multiple Domains Yunjey Choi Youngjung Uh Jaejun Yoo Jung-Woo Ha 3DH 94 1,732 0 04 Dec 2019
Image-to-Image Translation via Group-wise Deep Whitening-and-Coloring Transformation Wonwoong Cho Sungha Choi D. Park Inkyu Shin Jaegul Choo 36 131 0 24 Dec 2018
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 508 10,500 0 12 Dec 2018
Diverse Image-to-Image Translation via Disentangled Representations Hsin-Ying Lee Hung-Yu Tseng Jia-Bin Huang M. Singh Ming-Hsuan Yang DRL 46 907 0 02 Aug 2018
Multimodal Unsupervised Image-to-Image Translation Xun Huang Ming-Yuan Liu Serge J. Belongie Jan Kautz 115 2,479 0 12 Apr 2018
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop Feng Yu Ari Seff Yinda Zhang Shuran Song Thomas Funkhouser Jianxiong Xiao 52 2,320 0 10 Jun 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.2K 76,547 0 18 May 2015
Deep Unsupervised Learning using Nonequilibrium Thermodynamics Jascha Narain Sohl-Dickstein Eric A. Weiss Niru Maheswaranathan Surya Ganguli SyDa DiffM 181 6,780 0 12 Mar 2015