Joint Generative Modeling of Scene Graphs and Images via Diffusion Models

2 January 2024

Papers citing "Joint Generative Modeling of Scene Graphs and Images via Diffusion Models"

50 / 62 papers shown

Title
Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis Nithin Gopalakrishnan Nair A. Cherian Suhas Lohit Ye Wang T. Koike-Akino Vishal M. Patel Tim K. Marks DiffM 56 18 0 30 Sep 2023
SwinGNN: Rethinking Permutation Invariance in Diffusion Models for Graph Generation Qi Yan Zhen-Long Liang Yang Song Renjie Liao Lele Wang DiffM 69 18 0 04 Jul 2023
LayoutDM: Transformer-based Diffusion Model for Layout Generation Shang Chai Liansheng Zhuang Feng Yan DiffM 58 55 0 04 May 2023
Devil's on the Edges: Selective Quad Attention for Scene Graph Generation Deunsol Jung Sanghyun Kim Wonhui Kim Minsu Cho 3DPC GNN 48 34 0 07 Apr 2023
LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation Guangcong Zheng Xianpan Zhou Xuewei Li Zhongang Qi Ying Shan Xi Li DiffM 57 182 0 30 Mar 2023
Conditional Image-to-Video Generation with Latent Flow Diffusion Models Haomiao Ni Changhao Shi Kaican Li Sharon X. Huang Martin Renqiang Min VGen DiffM 61 171 0 24 Mar 2023
LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models Junyi Zhang Jiaqi Guo Shizhao Sun Jian-Guang Lou Dongmei Zhang DiffM 42 34 0 21 Mar 2023
LayoutDM: Discrete Diffusion Model for Controllable Layout Generation Naoto Inoue Kotaro Kikuchi E. Simo-Serra Mayu Otani Kota Yamaguchi DiffM 70 105 0 14 Mar 2023
Prototype-based Embedding Network for Scene Graph Generation Chao Zheng Xinyu Lyu Lianli Gao Bo Dai Jingkuan Song 42 42 0 13 Mar 2023
Unifying Layout Generation with a Decoupled Diffusion Model Mude Hui Zhizheng Zhang Xiaoyi Zhang Wenxuan Xie Yuwang Wang Yan Lu DiffM 36 39 0 09 Mar 2023
DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer Elad Levi Eli Brosh Mykola Mykhailych Meir Perez DiffM 77 16 0 07 Mar 2023
Video Probabilistic Diffusion Models in Projected Latent Space Sihyun Yu Kihyuk Sohn Subin Kim Jinwoo Shin VGen DiffM 73 163 0 15 Feb 2023
Adding Conditional Control to Text-to-Image Diffusion Models Lvmin Zhang Anyi Rao Maneesh Agrawala AI4CE 84 4,015 1 10 Feb 2023
Structure and Content-Guided Video Synthesis with Diffusion Models Patrick Esser Johnathan Chiu Parmida Atighehchian Jonathan Granskog Anastasis Germanidis DiffM VGen 140 517 0 06 Feb 2023
GLIGEN: Open-Set Grounded Text-to-Image Generation Yuheng Li Haotian Liu Qingyang Wu Fangzhou Mu Jianwei Yang Jianfeng Gao Chunyuan Li Yong Jae Lee VLM 104 584 1 17 Jan 2023
Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise Zheng-Wen Lin Yeyun Gong Yelong Shen Tong Wu Zhihao Fan Chen Lin Nan Duan Weizhu Chen AI4CE DiffM VLM 45 65 0 22 Dec 2022
Multi-Concept Customization of Text-to-Image Diffusion Nupur Kumari Bin Zhang Richard Y. Zhang Eli Shechtman Jun-Yan Zhu 120 855 0 08 Dec 2022
Iterative Scene Graph Generation with Generative Transformers Sanjoy Kundu Sathyanarayanan N. Aakur ViT 56 27 0 30 Nov 2022
InstructPix2Pix: Learning to Follow Image Editing Instructions Tim Brooks Aleksander Holynski Alexei A. Efros DiffM 165 1,745 0 17 Nov 2022
Imagic: Text-Based Real Image Editing with Diffusion Models Bahjat Kawar Shiran Zada Oran Lang Omer Tov Hui-Tang Chang Tali Dekel Inbar Mosseri Michal Irani 57 1,064 0 17 Oct 2022
DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models Shansan Gong Mukai Li Jiangtao Feng Zhiyong Wu Lingpeng Kong 81 325 0 17 Oct 2022
DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation Nataniel Ruiz Yuanzhen Li Varun Jampani Yael Pritch Michael Rubinstein Kfir Aberman 220 2,789 0 25 Aug 2022
LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restriction Zhaoyun Jiang Jiaqi Guo Shizhao Sun Huayu Deng Zhongkai Wu V. Mijović Z. Yang Jian-Guang Lou Dongmei Zhang 55 37 0 17 Aug 2022
Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning Ting-Li Chen Ruixiang Zhang Geoffrey E. Hinton DiffM 64 300 0 08 Aug 2022
Elucidating the Design Space of Diffusion-Based Generative Models Tero Karras M. Aittala Timo Aila S. Laine DiffM 145 1,907 0 01 Jun 2022
Diffusion-LM Improves Controllable Text Generation Xiang Lisa Li John Thickstun Ishaan Gulrajani Percy Liang Tatsunori B. Hashimoto AI4CE 216 802 0 27 May 2022
Flexible Diffusion Modeling of Long Videos William Harvey Saeid Naderiparizi Vaden Masrani Christian D. Weilbach Frank Wood DiffM BDL VGen 200 293 0 23 May 2022
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang ... Raphael Gontijo-Lopes Tim Salimans Jonathan Ho David J Fleet Mohammad Norouzi VLM 304 5,904 0 23 May 2022
Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equations Jaehyeong Jo Seul Lee Sung Ju Hwang DiffM 51 220 0 05 Feb 2022
RePaint: Inpainting using Denoising Diffusion Probabilistic Models Andreas Lugmayr Martin Danelljan Andrés Romero Feng Yu Radu Timofte Luc Van Gool DiffM 317 1,385 0 24 Jan 2022
SGTR: End-to-end Scene Graph Generation with Transformer Rongjie Li Songyang Zhang Xuming He ViT 76 117 0 24 Dec 2021
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 298 15,081 0 20 Dec 2021
Weisfeiler and Leman go Machine Learning: The Story so far Christopher Morris Y. Lipman Haggai Maron Bastian Rieck Nils M. Kriege Martin Grohe Matthias Fey Karsten Borgwardt GNN 72 114 0 18 Dec 2021
BLT: Bidirectional Layout Transformer for Controllable Layout Generation X. Kong Lu Jiang Huiwen Chang Han Zhang Yuan Hao Haifeng Gong Irfan Essa 53 78 0 09 Dec 2021
Structured Denoising Diffusion Models in Discrete State-Spaces Jacob Austin Daniel D. Johnson Jonathan Ho Daniel Tarlow Rianne van den Berg DiffM 109 900 0 07 Jul 2021
Variational Transformer Networks for Layout Generation Diego Martin Arroyo Janis Postels F. Tombari ViT DRL 33 129 0 06 Apr 2021
Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generation Rongjie Li Songyang Zhang Bo Wan Xuming He 225 217 0 01 Apr 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 367 21,175 0 25 Mar 2021
Understanding the Role of Scene Graphs in Visual Question Answering Vinay Damodaran Sharanya Chakravarthy Akshay Kumar Anjana Umapathy Teruko Mitamura Yuta Nakashima Noa Garcia Chenhui Chu GNN 116 33 0 14 Jan 2021
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song Jascha Narain Sohl-Dickstein Diederik P. Kingma Abhishek Kumar Stefano Ermon Ben Poole DiffM SyDa 279 6,293 0 26 Nov 2020
Comprehensive Image Captioning via Scene Graph Decomposition Yiwu Zhong Liwei Wang Jianshu Chen Dong Yu Yin Li 99 125 0 23 Jul 2020
LayoutTransformer: Layout Generation and Completion with Self-attention Kamal Gupta Justin Lazarow Alessandro Achille Larry S. Davis Vijay Mahadevan Abhinav Shrivastava ViT 58 136 0 25 Jun 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 386 17,550 0 19 Jun 2020
Learning Layout and Style Reconfigurable GANs for Controllable Image Synthesis Wei Sun Tianfu Wu 44 82 0 25 Mar 2020
Unbiased Scene Graph Generation from Biased Training Kaihua Tang Yulei Niu Jianqiang Huang Jiaxin Shi Hanwang Zhang CML 74 689 0 27 Feb 2020
Neural Design Network: Graphic Layout Generation with Constraints Hsin-Ying Lee Lu Jiang Irfan Essa Madison Le Haifeng Gong Ming-Hsuan Yang Weilong Yang 132 138 0 19 Dec 2019
Image Synthesis From Reconfigurable Layout and Style Wei Sun Tianfu Wu 69 140 0 20 Aug 2019
PubLayNet: largest dataset ever for document layout analysis Xu Zhong Jianbin Tang Antonio Jimeno Yepes 41 454 0 16 Aug 2019
LayoutVAE: Stochastic Scene Layout Generation From a Label Set Akash Abdu Jyothi Thibaut Durand Jiawei He Leonid Sigal Greg Mori DRL 52 156 0 24 Jul 2019
Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regression S. Hamid Rezatofighi Deyuan Li JunYoung Gwak Amir Sadeghian Ian Reid Silvio Savarese 136 4,114 0 25 Feb 2019