NeRF-VAE: A Geometry Aware 3D Scene Generative Model

1 April 2021

Danilo Jimenez Rezende

DRL

ArXiv PDF HTML

Papers citing "NeRF-VAE: A Geometry Aware 3D Scene Generative Model"

42 / 42 papers shown

Title
SAR3D: Autoregressive 3D Object Generation and Understanding via Multi-scale 3D VQVAE Yongwei Chen Yushi Lan Shangchen Zhou Tengfei Wang Xingang Pan 102 5 0 25 Nov 2024
Bringing NeRFs to the Latent Space: Inverse Graphics Autoencoder Antoine Schnepf Karim Kassab Jean-Yves Franceschi Laurent Caraffa Flavian Vasile Jeremie Mary Andrew Comport Valérie Gouet-Brunet 42 2 0 30 Oct 2024
Textured-GS: Gaussian Splatting with Spatially Defined Color and Opacity Zhentao Huang Minglun Gong 3DGS 34 5 0 13 Jul 2024
NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer Meng You Zhiyu Zhu Hui Liu Junhui Hou VGen DiffM 31 23 0 24 May 2024
DiSR-NeRF: Diffusion-Guided View-Consistent Super-Resolution NeRF Jie Long Lee Chen Li Gim Hee Lee 34 6 0 01 Apr 2024
CVT-xRF: Contrastive In-Voxel Transformer for 3D Consistent Radiance Fields from Sparse Inputs Yingji Zhong Lanqing Hong Zhenguo Li Dan Xu 38 9 0 25 Mar 2024
NITO: Neural Implicit Fields for Resolution-free Topology Optimization Amin Heyrani Nobari Giorgio Giannone Lyle Regenwetter Faez Ahmed AI4CE 43 3 0 07 Feb 2024
DyST: Towards Dynamic Neural Scene Representations on Real-World Videos Maximilian Seitzer Sjoerd van Steenkiste Thomas Kipf Klaus Greff Mehdi S. M. Sajjadi VGen ViT 34 8 0 09 Oct 2023
Generating Transferable Adversarial Simulation Scenarios for Self-Driving via Neural Rendering Yasasa Abeysirigoonawardena Kevin Xie Chuhan Chen Salar Hosseini Ruiting Chen Ruiqi Wang Florian Shkurti 36 2 0 27 Sep 2023
AI-Generated Content (AIGC) for Various Data Modalities: A Survey Lin Geng Foo Hossein Rahmani Jun Liu 78 31 0 27 Aug 2023
Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision A. Tewari Tianwei Yin George Cazenavette Semon Rezchikov J. Tenenbaum F. Durand William T. Freeman Vincent Sitzmann DiffM 48 88 0 20 Jun 2023
Physics-Informed Computer Vision: A Review and Perspectives C. Banerjee Kien Nguyen Clinton Fookes G. Karniadakis PINN AI4CE 39 30 0 29 May 2023
ReLight My NeRF: A Dataset for Novel View Synthesis and Relighting of Real World Objects Marco Toschi Riccardo De Matteo Riccardo Spezialetti Daniele De Gregorio Luigi Di Stefano Samuele Salti 33 33 0 20 Apr 2023
Likelihood-Based Generative Radiance Field with Latent Space Energy-Based Model for 3D-Aware Disentangled Image Representation Y. Zhu Jianwen Xie Ping Li MedIm 25 4 0 16 Apr 2023
Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Images Jiatao Gu Qingzhe Gao Shuangfei Zhai Baoquan Chen Lingjie Liu J. Susskind 41 29 0 13 Apr 2023
RePAST: Relative Pose Attention Scene Representation Transformer Aleksandr Safin Daniel Durckworth Mehdi S. M. Sajjadi 37 3 0 03 Apr 2023
NeRF-Supervised Deep Stereo Fabio Tosi A. Tonioni Daniele De Gregorio Matteo Poggi MDE 21 42 0 30 Mar 2023
Variational Autoencoding Neural Operators Jacob H. Seidman Georgios Kissas George J. Pappas P. Perdikaris DRL AI4CE 27 7 0 20 Feb 2023
Laser: Latent Set Representations for 3D Generative Modeling Pol Moreno Adam R. Kosiorek Heiko Strathmann Daniel Zoran Rosália G. Schneider Bjorn Winckler L. Markeeva T. Weber Danilo Jimenez Rezende BDL 3DV DRL 38 4 0 13 Jan 2023
Point-E: A System for Generating 3D Point Clouds from Complex Prompts Alex Nichol Heewoo Jun Prafulla Dhariwal Pamela Mishkin Mark Chen DiffM 47 586 0 16 Dec 2022
3D Neural Field Generation using Triplane Diffusion J. Shue E. R. Chan Ryan Po Zachary Ankner Jiajun Wu Gordon Wetzstein DiffM 61 232 0 30 Nov 2022
RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation Titas Anciukevicius Zexiang Xu Matthew Fisher Paul Henderson Hakan Bilen Niloy J. Mitra Paul Guerrero 53 155 0 17 Nov 2022
Mixed Reality Interface for Digital Twin of Plant Factory Byunghyun Ban AI4CE 29 3 0 29 Oct 2022
ProbNeRF: Uncertainty-Aware Inference of 3D Shapes from 2D Images Matthew D. Hoffman T. Le Pavel Sountsov Christopher Suter Ben Lee Vikash K. Mansinghka Rif A. Saurous BDL 31 12 0 27 Oct 2022
Compressing Explicit Voxel Grid Representations: fast NeRFs become also small C. Deng Enzo Tartaglione GNN 34 52 0 23 Oct 2022
Cross-Spectral Neural Radiance Fields Matteo Poggi Pierluigi Zama Ramirez Fabio Tosi Samuele Salti S. Mattoccia Luigi Di Stefano 21 30 0 01 Sep 2022
Object Scene Representation Transformer Mehdi S. M. Sajjadi Daniel Duckworth Aravindh Mahendran Sjoerd van Steenkiste Filip Pavetić Mario Luvcić Leonidas J. Guibas Klaus Greff Thomas Kipf ViT OCL 33 91 0 14 Jun 2022
Points2NeRF: Generating Neural Radiance Fields from 3D point cloud D. Zimny Joanna Waczyñska Tomasz Trzciñski Przemysław Spurek 34 18 0 02 Jun 2022
Ray Priors through Reprojection: Improving Neural Radiance Fields for Novel View Extrapolation Jian Zhang Yuanqing Zhang Huan Fu Xiao-bin Zhou Bowen Cai Jinchi Huang Rongfei Jia Binqiang Zhao Xing Tang 33 33 0 12 May 2022
Transframer: Arbitrary Frame Prediction with Generative Models C. Nash João Carreira Jacob Walker Iain Barr Andrew Jaegle Mateusz Malinowski Peter W. Battaglia ViT 27 37 0 17 Mar 2022
Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks Sihyun Yu Jihoon Tack Sangwoo Mo Hyunsu Kim Junho Kim Jung-Woo Ha Jinwoo Shin DiffM VGen 40 199 0 21 Feb 2022
StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2 Ivan Skorokhodov Sergey Tulyakov Mohamed Elhoseiny VGen 40 279 0 29 Dec 2021
Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations Mehdi S. M. Sajjadi H. Meyer Etienne Pot Urs M. Bergmann Klaus Greff ... Daniel Duckworth Alexey Dosovitskiy Jakob Uszkoreit Thomas Funkhouser Andrea Tagliasacchi ViT 49 184 0 25 Nov 2021
Neural Fields in Visual Computing and Beyond Yiheng Xie Towaki Takikawa Shunsuke Saito Or Litany Shiqin Yan Numair Khan Federico Tombari James Tompkin Vincent Sitzmann Srinath Sridhar 3DH 53 616 0 22 Nov 2021
ClevrTex: A Texture-Rich Benchmark for Unsupervised Multi-Object Segmentation Laurynas Karazija Iro Laina Christian Rupprecht 3DV VOS 47 84 0 19 Nov 2021
Advances in Neural Rendering A. Tewari Justus Thies B. Mildenhall P. Srinivasan E. Tretschk ... S. Fanello Jun Zhu Gordon Wetzstein Michael Zollhoefer D. B. Goldman 3DH AI4CE 71 445 0 10 Nov 2021
Stochastic Neural Radiance Fields: Quantifying Uncertainty in Implicit 3D Representations Jianxiong Shen Adria Ruiz Antonio Agudo Francesc Moreno-Noguer BDL 36 68 0 05 Sep 2021
Unsupervised Discovery of Object Radiance Fields Hong-Xing Yu Leonidas J. Guibas Jiajun Wu OCL 27 122 0 16 Jul 2021
Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering Vincent Sitzmann Semon Rezchikov William T. Freeman J. Tenenbaum F. Durand 3DV 51 288 0 04 Jun 2021
Learning to Stylize Novel Views Hsin-Ping Huang Hung-Yu Tseng Saurabh Saini M. Singh Ming-Hsuan Yang 30 77 0 27 May 2021
Bottleneck Transformers for Visual Recognition A. Srinivas Nayeon Lee Niki Parmar Jonathon Shlens Pieter Abbeel Ashish Vaswani SLR 290 980 0 27 Jan 2021
A Learned Representation For Artistic Style Vincent Dumoulin Jonathon Shlens M. Kudlur GAN 214 1,156 0 24 Oct 2016