Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior

14 March 2024

Cheng Chen

Chengzeng Feng

Guosheng Lin

Fayao Liu

ArXiv PDF HTML

Papers citing "Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior"

41 / 41 papers shown

Title
CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images Cheng Chen Jiacheng Wei Tianrun Chen Chi Zhang Xiaofeng Yang ... Bingchen Yang Chuan-Sheng Foo Guosheng Lin Qixing Huang Fayao Liu 79 2 0 07 Apr 2025
Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting Xiaofeng Yang Yiwen Chen Cheng Chen Chi Zhang Yi Tian Xu Xulei Yang Fayao Liu Guosheng Lin 3DGS DiffM 45 18 0 08 Dec 2023
AttriHuman-3D: Editable 3D Human Avatar Generation with Attribute Decomposition and Indexing Fan Yang Tianyi Chen Xiaosheng He Zhongang Cai Lei Yang Si Wu Guosheng Lin 51 9 0 03 Dec 2023
Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model Ruoxi Shi Hansheng Chen Zhuoyang Zhang Minghua Liu Chao Xu Xinyue Wei Linghao Chen Chong Zeng Hao Su VLM 58 364 0 23 Oct 2023
Wonder3D: Single Image to 3D using Cross-Domain Diffusion Xiaoxiao Long Yuanchen Guo Cheng Lin Yuan Liu Zhiyang Dou ... Yuexin Ma Song-Hai Zhang Marc Habermann Christian Theobalt Wenping Wang 85 433 0 23 Oct 2023
T $^3$ Bench: Benchmarking Current Progress in Text-to-3D Generation Yuze He Yushi Bai Matthieu Lin Wang Zhao Yubin Hu Jenny Sheng Ran Yi Juanzi Li Yong Liu 72 32 0 04 Oct 2023
SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D Weiyu Li Rui Chen Xuelin Chen Ping Tan 49 120 0 04 Oct 2023
SyncDreamer: Generating Multiview-consistent Images from a Single-view Image Yuan Liu Chu-Hsing Lin Zijiao Zeng Xiaoxiao Long Lingjie Liu Taku Komura Wenping Wang DiffM 90 437 0 07 Sep 2023
MVDream: Multi-view Diffusion for 3D Generation Yichun Shi Peng Wang Jianglong Ye Mai Long Kejie Li Xiaohu Yang 88 620 0 31 Aug 2023
IT3D: Improved Text-to-3D Generation with Explicit View Synthesis Yiwen Chen Chi Zhang Xiaofeng Yang Zhongang Cai Gang Yu Lei Yang Guo-Shing Lin DiffM 67 63 0 22 Aug 2023
IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models Hu Ye Jun Zhang Siyi Liu Xiao Han Wei Yang DiffM 88 790 0 13 Aug 2023
Objaverse-XL: A Universe of 10M+ 3D Objects Matt Deitke Ruoshi Liu Matthew Wallingford Huong Ngo Oscar Michel ... Carl Vondrick Georgia Gkioxari Kiana Ehsani Ludwig Schmidt Ali Farhadi 72 408 0 11 Jul 2023
StyleAvatar3D: Leveraging Image-Text Diffusion Models for High-Fidelity 3D Avatar Generation Chi Zhang Yiwen Chen Yijun Fu Zheng-Yang Zhou YU Gang Billzb Wang Bin-Bin Fu Tao Chen Guosheng Lin Chunhua Shen DiffM 72 29 0 30 May 2023
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation Zhengyi Wang Cheng Lu Yikai Wang Fan Bao Chongxuan Li Hang Su Jun Zhu DiffM 171 863 0 25 May 2023
OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understanding Minghua Liu Ruoxi Shi Kaiming Kuang Yinhao Zhu Xuanlin Li Shizhong Han H. Cai Fatih Porikli Hao Su 3DPC 82 123 0 18 May 2023
MoDA: Modeling Deformable 3D Objects from Casual Videos Chaoyue Song Jiacheng Wei Tianyi Chen Yiwen Chen Chuan-Sheng Foo Fayao Liu Guo-Shing Lin 62 11 0 17 Apr 2023
Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation Rui Chen Yuxiao Chen Ningxin Jiao Kui Jia DiffM 105 587 0 24 Mar 2023
TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervision Jiacheng Wei Hao Wang Jiashi Feng Guosheng Lin Kim-Hui Yap 61 30 0 23 Mar 2023
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions Ayaan Haque Matthew Tancik Alexei A. Efros Aleksander Holynski Angjoo Kanazawa VGen DiffM 81 371 0 22 Mar 2023
Zero-1-to-3: Zero-shot One Image to 3D Object Ruoshi Liu Rundi Wu Basile Van Hoorick P. Tokmakov Sergey Zakharov Carl Vondrick DiffM 139 1,092 0 20 Mar 2023
RealFusion: 360° Reconstruction of Any Object from a Single Image Luke Melas-Kyriazi Christian Rupprecht Iro Laina Andrea Vedaldi 156 298 0 21 Feb 2023
T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models Chong Mou Xintao Wang Liangbin Xie Yanze Wu Shuai Liu Zhongang Qi Ying Shan Xiaohu Qie DiffM 91 1,018 0 16 Feb 2023
Adding Conditional Control to Text-to-Image Diffusion Models Lvmin Zhang Anyi Rao Maneesh Agrawala AI4CE 143 4,113 1 10 Feb 2023
NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors Congyue Deng C. Jiang C. Qi Xinchen Yan Yin Zhou Leonidas Guibas Drago Anguelov DiffM 80 164 0 06 Dec 2022
Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation Haochen Wang Xiaodan Du Jiahao Li Raymond A. Yeh Gregory Shakhnarovich DiffM 117 550 0 01 Dec 2022
Magic3D: High-Resolution Text-to-3D Content Creation Chen-Hsuan Lin Jun Gao Luming Tang Towaki Takikawa Fangyin Wei Xun Huang Karsten Kreis Sanja Fidler Ming-Yuan Liu Nayeon Lee 178 1,161 0 18 Nov 2022
Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstruction Chaoyue Song Jiacheng Wei Ruibo Li Fayao Liu Guosheng Lin 3DPC 66 22 0 18 Nov 2022
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures G. Metzer Elad Richardson Or Patashnik Raja Giryes Daniel Cohen-Or DiffM 122 467 0 14 Nov 2022
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole Ajay Jain Jonathan T. Barron B. Mildenhall 144 2,410 0 29 Sep 2022
Re-Imagen: Retrieval-Augmented Text-to-Image Generator Wenhu Chen Hexiang Hu Chitwan Saharia William W. Cohen VLM 164 173 0 29 Sep 2022
Diffusion Models in Vision: A Survey Florinel-Alin Croitoru Vlad Hondru Radu Tudor Ionescu M. Shah DiffM VLM MedIm 249 1,219 0 10 Sep 2022
DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation Nataniel Ruiz Yuanzhen Li Varun Jampani Yael Pritch Michael Rubinstein Kfir Aberman 279 2,854 0 25 Aug 2022
UTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialog Cheng Chen Yudong Zhu Zhenshan Tan Qingrong Cheng Xin Jiang Qun Liu X. Gu 55 39 0 01 May 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 416 15,515 0 20 Dec 2021
Improving language models by retrieving from trillions of tokens Sebastian Borgeaud A. Mensch Jordan Hoffmann Trevor Cai Eliza Rutherford ... Simon Osindero Karen Simonyan Jack W. Rae Erich Elsen Laurent Sifre KELM RALM 242 1,085 0 08 Dec 2021
Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis Tianchang Shen Jun Gao K. Yin Xuan Li Sanja Fidler 3DV 88 463 0 08 Nov 2021
3D Pose Transfer with Correspondence Learning and Mesh Refinement Chaoyue Song Jiacheng Wei Ruibo Li Fayao Liu Guosheng Lin 3DH 116 29 0 30 Sep 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 433 10,328 0 17 Jun 2021
Retrieval Augmentation Reduces Hallucination in Conversation Kurt Shuster Spencer Poff Moya Chen Douwe Kiela Jason Weston HILM 95 733 0 15 Apr 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 925 29,436 0 26 Feb 2021
REALM: Retrieval-Augmented Language Model Pre-Training Kelvin Guu Kenton Lee Zora Tung Panupong Pasupat Ming-Wei Chang RALM 129 2,102 0 10 Feb 2020