NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models

19 April 2023

Katja Schwarz

Antonio Torralba

Sanja Fidler

VGen

ArXiv PDF HTML

Papers citing "NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models"

50 / 53 papers shown

Title
Wonderland: Navigating 3D Scenes from a Single Image Hanwen Liang Junli Cao Vidit Goel Guocheng Qian Sergei Korolev Demetri Terzopoulos Konstantinos N. Plataniotis Sergey Tulyakov Jian Ren VGen 190 12 0 16 Dec 2024
Diffusion Models in 3D Vision: A Survey Zhen Wang Dongyuan Li Xue Liu Tianyu He Jiang Bian Renhe Jiang MedIm 195 4 0 07 Oct 2024
LT3SD: Latent Trees for 3D Scene Diffusion Quan Meng Lei Li Matthias Nießner Angela Dai 138 12 0 12 Sep 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 167 46 0 17 Jul 2024
LION: Latent Point Diffusion Models for 3D Shape Generation Fangyin Wei Arash Vahdat Francis Williams Zan Gojcic Or Litany Sanja Fidler Karsten Kreis DiffM 110 498 0 12 Oct 2022
GAUDI: A Neural Architect for Immersive 3D Scene Generation Miguel Angel Bautista Pengsheng Guo Samira Abnar Walter A. Talbott Alexander Toshev ... Shuangfei Zhai Hanlin Goh Daniel Ulbricht Afshin Dehghan J. Susskind SyDa 3DGS 54 137 0 27 Jul 2022
Classifier-Free Diffusion Guidance Jonathan Ho Tim Salimans FaML 147 3,858 0 26 Jul 2022
VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids Katja Schwarz Axel Sauer Michael Niemeyer Yiyi Liao Andreas Geiger 84 148 0 15 Jun 2022
Flexible Diffusion Modeling of Long Videos William Harvey Saeid Naderiparizi Vaden Masrani Christian D. Weilbach Frank Wood DiffM BDL VGen 214 295 0 23 May 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 339 6,830 0 13 Apr 2022
Video Diffusion Models Jonathan Ho Tim Salimans Alexey A. Gritsenko William Chan Mohammad Norouzi David J. Fleet DiffM VGen 163 1,597 0 07 Apr 2022
NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction Xiaoshuai Zhang Sai Bi Kalyan Sunkavalli Hao Su Zexiang Xu AI4CE 41 114 0 21 Mar 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 227 30,089 0 01 Mar 2022
StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets Axel Sauer Katja Schwarz Andreas Geiger 238 508 0 01 Feb 2022
BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotations Daiqing Li Huan Ling Seung Wook Kim Karsten Kreis Adela Barriuso Sanja Fidler Antonio Torralba 104 107 0 12 Jan 2022
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models Alex Nichol Prafulla Dhariwal Aditya A. Ramesh Pranav Shyam Pamela Mishkin Bob McGrew Ilya Sutskever Mark Chen 286 3,582 0 20 Dec 2021
Score-Based Generative Modeling with Critically-Damped Langevin Diffusion Tim Dockhorn Arash Vahdat Karsten Kreis DiffM 74 232 0 14 Dec 2021
Urban Radiance Fields Konstantinos Rematas An Liu Pratul P. Srinivasan Jonathan T. Barron Andrea Tagliasacchi Thomas Funkhouser V. Ferrari 48 287 0 29 Nov 2021
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction Cheng Sun Min Sun Hwann-Tzong Chen 115 1,070 0 22 Nov 2021
EditGAN: High-Precision Semantic Image Editing Huan Ling Karsten Kreis Daiqing Li Seung Wook Kim Antonio Torralba Sanja Fidler DiffM GAN 47 203 0 04 Nov 2021
Score-based Generative Modeling in Latent Space Arash Vahdat Karsten Kreis Jan Kautz DiffM 45 677 0 10 Jun 2021
Cascaded Diffusion Models for High Fidelity Image Generation Jonathan Ho Chitwan Saharia William Chan David J. Fleet Mohammad Norouzi Tim Salimans 136 1,213 0 30 May 2021
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal Alex Nichol 178 7,765 0 11 May 2021
DriveGAN: Towards a Controllable High-Quality Neural Simulation S. Kim Jonah Philion Antonio Torralba Sanja Fidler 50 113 0 30 Apr 2021
Unconstrained Scene Generation with Locally Conditioned Radiance Fields Terrance Devries Miguel Angel Bautista Nitish Srivastava Graham W. Taylor J. Susskind 75 155 0 01 Apr 2021
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields Jonathan T. Barron B. Mildenhall Matthew Tancik Peter Hedman Ricardo Martín Brualla Pratul P. Srinivasan 94 1,961 0 24 Mar 2021
Diffusion Probabilistic Models for 3D Point Cloud Generation Shitong Luo Wei Hu 3DPC 247 740 0 02 Mar 2021
pixelNeRF: Neural Radiance Fields from One or Few Images Alex Yu Vickie Ye Matthew Tancik Angjoo Kanazawa 171 1,730 0 03 Dec 2020
pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis E. R. Chan M. Monteiro Petr Kellnhofer Jiajun Wu Gordon Wetzstein GAN 101 852 0 02 Dec 2020
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song Jascha Narain Sohl-Dickstein Diederik P. Kingma Abhishek Kumar Stefano Ermon Ben Poole DiffM SyDa 292 6,409 0 26 Nov 2020
GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields Michael Niemeyer Andreas Geiger OCL 138 960 0 24 Nov 2020
Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering Yuxuan Zhang Wenzheng Chen Huan Ling Jun Gao Yinan Zhang Antonio Torralba Sanja Fidler DRL 130 139 0 18 Oct 2020
NeRF++: Analyzing and Improving Neural Radiance Fields Kai Zhang Gernot Riegler Noah Snavely V. Koltun 78 1,038 0 15 Oct 2020
Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3D Jonah Philion Sanja Fidler 79 1,039 0 13 Aug 2020
Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation Elad Richardson Yuval Alaluf Or Patashnik Yotam Nitzan Yaniv Azar Stav Shapiro Daniel Cohen-Or 122 1,107 0 03 Aug 2020
NVAE: A Deep Hierarchical Variational Autoencoder Arash Vahdat Jan Kautz BDL 67 908 0 08 Jul 2020
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis Katja Schwarz Yiyi Liao Michael Niemeyer Andreas Geiger VGen 127 870 0 05 Jul 2020
Learning to Simulate Dynamic Environments with GameGAN Seung Wook Kim Yuhao Zhou Jonah Philion Antonio Torralba Sanja Fidler GAN 66 102 0 25 May 2020
In-Domain GAN Inversion for Real Image Editing Jiapeng Zhu Yujun Shen Deli Zhao Bolei Zhou DiffM 64 641 0 31 Mar 2020
Towards Unsupervised Learning of Generative Models for 3D Controllable Image Synthesis Yiyi Liao Katja Schwarz L. Mescheder Andreas Geiger 3DV 65 158 0 11 Dec 2019
Analyzing and Improving the Image Quality of StyleGAN Tero Karras S. Laine M. Aittala Janne Hellsten J. Lehtinen Timo Aila GAN 260 5,797 0 03 Dec 2019
Interpreting the Latent Space of GANs for Semantic Face Editing Yujun Shen Jinjin Gu Xiaoou Tang Bolei Zhou CVBM GAN 115 1,120 0 25 Jul 2019
The Replica Dataset: A Digital Replica of Indoor Spaces Julian Straub Thomas Whelan Lingni Ma Yufan Chen Erik Wijmans ... H. Strasdat R. D. Nardi Michael Goesele S. Lovegrove Richard Newcombe 3DV 126 851 0 13 Jun 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 129 18,058 0 28 May 2019
Group Normalization Yuxin Wu Kaiming He 196 3,644 0 22 Mar 2018
Which Training Methods for GANs do actually Converge? L. Mescheder Andreas Geiger Sebastian Nowozin 73 1,464 0 13 Jan 2018
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Y. Zhang Phillip Isola Alexei A. Efros Eli Shechtman Oliver Wang EGVM 327 11,734 0 11 Jan 2018
CARLA: An Open Urban Driving Simulator Alexey Dosovitskiy G. Ros Felipe Codevilla Antonio M. López V. Koltun VLM 133 5,146 0 10 Nov 2017
Neural Discrete Representation Learning Aaron van den Oord Oriol Vinyals Koray Kavukcuoglu BDL SSL OCL 208 4,989 0 02 Nov 2017
Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning Stefan Elfwing E. Uchibe Kenji Doya 114 1,717 0 10 Feb 2017