RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion

10 April 2024

Papers citing "RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion"

50 / 114 papers shown

Title
Constructing a 3D Town from a Single Image Kaizhi Zheng Ruijian Zhang Jing Gu Jie Yang Xin Eric Wang 80 0 0 21 May 2025
Digital Twin Generation from Visual Data: A Survey Andrew Melnik Benjamin Alt Giang Hoang Nguyen Artur Wilkowski Maciej Stefańczyk Qirui Wu Sinan Harms Helge Rhodin Manolis Savva Michael Beetz 3DGS VGen 112 0 0 17 Apr 2025
GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting Junlin Hao Peiheng Wang Haoyang Wang Zongming Guo Xinggong Zhang 3DGS VGen 91 0 0 14 Apr 2025
Flash Sculptor: Modular 3D Worlds from Objects Yujia Hu Songhua Liu Xingyi Yang Xinchao Wang 62 0 0 08 Apr 2025
WonderTurbo: Generating Interactive 3D World in 0.72 Seconds Chaojun Ni Xiaofeng Wang Zheng Zhu Wei Wang Haoyun Li Guosheng Zhao Jie Li Wenkang Qin Guan Huang Wenjun Mei 3DGS ViT VGen 349 1 0 03 Apr 2025
Scene Splatter: Momentum 3D Scene Generation from Single Image with Video Diffusion Model Shengjun Zhang Jinzhao Li Xin Fei Hao Liu Yueqi Duan DiffM 3DGS VGen 90 0 0 03 Apr 2025
WorldPrompter: Traversable Text-to-Scene Generation Zhaoyang Zhang Yannick Hold-Geoffroy Miloš Hašan Chen Ziwen Fujun Luan Julie Dorsey Yiwei Hu VGen 91 0 0 02 Apr 2025
Scene4U: Hierarchical Layered 3D Scene Reconstruction from Single Panoramic Image for Your Immerse Exploration Zilong Huang Jun-Jian He Junyan Ye Lihan Jiang Weijia Li Yuxiao Chen Ting Han 97 0 0 01 Apr 2025
SuperDec: 3D Scene Decomposition with Superquadric Primitives Elisabetta Fedele Boyang Sun Leonidas Guibas Marc Pollefeys Francis Engelmann 3DPC 71 1 0 01 Apr 2025
ExScene: Free-View 3D Scene Reconstruction with Gaussian Splatting from a Single Image Tianyi Gong Boyan Li Yifei Zhong Fangxin Wang 3DGS VGen 60 0 0 31 Mar 2025
VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modeling Hyojun Go Byeongjun Park Hyelin Nam Byung-Hoon Kim Hyungjin Chung Changick Kim 3DGS VGen 115 1 0 20 Mar 2025
A Recipe for Generating 3D Worlds From a Single Image Katja Schwarz Denys Rozumnyi Samuel Rota Buló Lorenzo Porzi Peter Kontschieder VGen 91 1 0 20 Mar 2025
NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenes Han-Hung Lee Qinghong Han Angel X. Chang 101 0 0 20 Mar 2025
SynCity: Training-Free Generation of 3D Worlds Paul Engstler Aleksandar Shtedritski Iro Laina Christian Rupprecht Andrea Vedaldi 3DGS 134 2 0 20 Mar 2025
Bolt3D: Generating 3D Scenes in Seconds Stanislaw Szymanowicz Jason Y. Zhang P. Srinivasan Ruiqi Gao Arthur Brussee Aleksander Holynski Ricardo Martín Brualla Jonathan T. Barron Philipp Henzler 104 5 0 18 Mar 2025
Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors Katja Schwarz Norman Mueller Peter Kontschieder 3DGS 108 2 0 17 Mar 2025
Towards Affordance-Aware Articulation Synthesis for Rigged Objects Yu-Chu Yu C. Lin Hsin-Ying Lee Chaoyang Wang Yansen Wang Ming-Hsuan Yang DiffM AI4CE 63 0 0 21 Jan 2025
Survey on Monocular Metric Depth Estimation Jiuling Zhang VLM 135 0 0 21 Jan 2025
A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation S. Landgraf Rongjun Qin Markus Ulrich UQCV 96 0 0 14 Jan 2025
Pointmap-Conditioned Diffusion for Consistent Novel View Synthesis Thang-Anh-Quan Nguyen Nathan Piasco Luis Roldão Moussâb Bennehar D. Tsishkou Laurent Caraffa J. Tarel R. Brémond DiffM 93 1 0 06 Jan 2025
Wonderland: Navigating 3D Scenes from a Single Image Hanwen Liang Junli Cao Vidit Goel Guocheng Qian Sergei Korolev Demetri Terzopoulos Konstantinos N. Plataniotis Sergey Tulyakov Jian Ren VGen 175 12 0 16 Dec 2024
You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale Baorui Ma Huachen Gao Haoge Deng Zhengxiong Luo Tiejun Huang Lulu Tang Xinlong Wang DiffM VGen 143 14 0 09 Dec 2024
FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation Yunpeng Bai Qixing Huang DiffM 119 0 0 01 Dec 2024
MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Model Chenjie Cao Chaohui Yu Shang Liu Fan Wang Xiangyang Xue Yanwei Fu 116 1 0 25 Nov 2024
SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis Hyojun Go Byeongjun Park Jiho Jang Jin-Young Kim Soonwoo Kwon Changick Kim 3DGS 131 2 0 25 Nov 2024
SCube: Instant Large-Scale Scene Reconstruction using VoxSplats Xuanchi Ren Y. Lu Hanxue Liang Zhangjie Wu Huan Ling Mike Chen Sanja Fidler Francis Williams Jiahui Huang 3DGS 67 9 0 26 Oct 2024
VistaDream: Sampling multiview consistent images for single-view scene reconstruction Haiping Wang Yuan Liu Ziwei Liu Wenping Wang Z. Dong Bisheng Yang 69 13 0 22 Oct 2024
ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis Wangbo Yu Jinbo Xing Li Yuan Wenbo Hu Xiaoyu Li Zhipeng Huang Xiangjun Gao T. Wong Ying Shan Yonghong Tian VGen DiffM 67 83 0 03 Sep 2024
SceneDreamer360: Text-Driven 3D-Consistent Scene Generation with Panoramic Gaussian Splatting Wenrui Li Yapeng Mi Fucheng Cai Zhe Yang Wangmeng Zuo Xingtao Wang Xiaopeng Fan 3DGS 79 7 0 25 Aug 2024
Diffusion-Based Visual Art Creation: A Survey and New Perspectives Bingyuan Wang Qifeng Chen Zeyu Wang 72 7 0 22 Aug 2024
Pano2Room: Novel View Synthesis from a Single Indoor Panorama Guo Pu Yiming Zhao Zhouhui Lian 3DV 62 4 0 21 Aug 2024
Scene123: One Prompt to 3D Scene Generation via Video-Assisted and Consistency-Enhanced MAE Yiying Yang Fukun Yin Jiayuan Fan Xin Chen Wanzhang Li Gang Yu VGen 79 1 0 10 Aug 2024
Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketches Yongzhi Xu Yonhon Ng Yifu Wang Inkyu Sa Yunfei Duan Yang Li Pan Ji Hongdong Li VGen 3DV 72 6 0 08 Aug 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 157 42 0 17 Jul 2024
HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Model Hieu T. Nguyen Yiwen Chen Vikram S. Voleti Varun Jampani Huaizu Jiang 66 0 0 28 Jun 2024
Director3D: Real-world Camera Trajectory and 3D Scene Generation from Text Xinyang Li Zhangyu Lai Linning Xu Yansong Qu Liujuan Cao Shengchuan Zhang Bo Dai Rongrong Ji VGen 71 10 0 25 Jun 2024
4K4DGen: Panoramic 4D Generation at 4K Resolution Renjie Li Panwang Pan Bangbang Yang Dejia Xu Shijie Zhou Xuanyang Zhang Zeming Li A. Kadambi Zhangyang Wang Zhiwen Fan VGen 70 19 0 19 Jun 2024
Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models Paul Henderson Melonie de Almeida D. Ivanova Titas Anciukevicius 3DGS 90 4 0 18 Jun 2024
Depth Anything V2 Lihe Yang Bingyi Kang Zilong Huang Zhen Zhao Xiaogang Xu Jiashi Feng Hengshuang Zhao DiffM VLM MDE 91 377 0 13 Jun 2024
WonderWorld: Interactive 3D Scene Generation from a Single Image Hong-Xing Yu Haoyi Duan Charles Herrmann William T. Freeman Jiajun Wu 3DGS VGen 89 40 0 13 Jun 2024
GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping Junyoung Seo Kazumi Fukuda Takashi Shibuya Takuya Narihira Naoki Murata Shoukang Hu Chieh-Hsin Lai Seungryong Kim Yuki Mitsufuji 73 18 0 27 May 2024
CAT3D: Create Anything in 3D with Multi-View Diffusion Models Ruiqi Gao Aleksander Holynski Philipp Henzler Arthur Brussee Ricardo Martín Brualla Pratul P. Srinivasan Jonathan T. Barron Ben Poole 79 161 0 16 May 2024
DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling Xuening Yuan Hongyu Yang Yueming Zhao Di Huang 3DGS 75 3 0 14 Apr 2024
Recent Advances in 3D Gaussian Splatting Tong Wu Yu-Jie Yuan Ling-Xiao Zhang Jie Yang Yan-Pei Cao Ling-Qi Yan Lin Gao 3DGS 96 94 0 17 Mar 2024
LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation Jiaxiang Tang Zhaoxi Chen Xiaokang Chen Tengfei Wang Gang Zeng Ziwei Liu 3DGS 3DV 114 360 0 07 Feb 2024
Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data Lihe Yang Bingyi Kang Zilong Huang Xiaogang Xu Jiashi Feng Hengshuang Zhao VLM 179 744 0 19 Jan 2024
LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes Jaeyoung Chung Suyoung Lee Hyeongjin Nam Jaerin Lee Kyoung Mu Lee 3DGS 50 121 0 22 Nov 2023
LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matching Yixun Liang Xin Yang Jiantao Lin Haodong Li Xiaogang Xu Yingcong Chen 3DGS 54 193 0 19 Nov 2023
iNVS: Repurposing Diffusion Inpainters for Novel View Synthesis Yash Kant Aliaksandr Siarohin Michael Vasilkovsky R. A. Guler Jian Ren Sergey Tulyakov Igor Gilitschenski DiffM 50 12 0 24 Oct 2023
Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model Ruoxi Shi Hansheng Chen Zhuoyang Zhang Minghua Liu Chao Xu Xinyue Wei Linghao Chen Chong Zeng Hao Su VLM 43 351 0 23 Oct 2023