Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models

28 December 2022

Ying Shan

Papers citing "Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models"

50 / 90 papers shown

Title
Maximum Entropy Reinforcement Learning with Diffusion Policy Xiaoyi Dong Jian Cheng Xinsong Zhang 91 1 0 17 Feb 2025
TweedieMix: Improving Multi-Concept Fusion for Diffusion-based Image/Video Generation Gihyun Kwon Jong Chul Ye DiffM 84 5 0 08 Oct 2024
Adapting Pre-Trained Vision Models for Novel Instance Detection and Segmentation Ya Lu Jishnu Jaykumar Yunhui Guo Nicholas Ruozzi Yu Xiang VLM ISeg 100 5 0 28 May 2024
X-Diffusion: Generating Detailed 3D MRI Volumes From a Single Image Using Cross-Sectional Diffusion Models Emmanuelle Bourigault Abdullah Hamdi Amir Jamaludin MedIm 79 2 0 30 Apr 2024
IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognition Xiaomeng Yang Zhi Qiao Yu Zhou DiffM 119 1 0 19 Dec 2023
Optimized View and Geometry Distillation from Multi-view Diffuser Youjia Zhang Zikai Song Junqing Yu Yawei Luo Wei Yang 66 0 0 11 Dec 2023
Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation Haochen Wang Xiaodan Du Jiahao Li Raymond A. Yeh Gregory Shakhnarovich DiffM 113 549 0 01 Dec 2022
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures G. Metzer Elad Richardson Or Patashnik Raja Giryes Daniel Cohen-Or DiffM 117 467 0 14 Nov 2022
LAION-5B: An open large-scale dataset for training next generation image-text models Christoph Schuhmann Romain Beaumont Richard Vencu Cade Gordon Ross Wightman ... Srivatsa Kundurthy Katherine Crowson Ludwig Schmidt R. Kaczmarczyk J. Jitsev VLM MLLM CLIP 152 3,444 0 16 Oct 2022
LION: Latent Point Diffusion Models for 3D Shape Generation Fangyin Wei Arash Vahdat Francis Williams Zan Gojcic Or Litany Sanja Fidler Karsten Kreis DiffM 125 501 0 12 Oct 2022
Understanding Pure CLIP Guidance for Voxel Grid NeRF Models Han-Hung Lee Angel X. Chang 50 63 0 30 Sep 2022
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole Ajay Jain Jonathan T. Barron B. Mildenhall 139 2,410 0 29 Sep 2022
GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images Jun Gao Tianchang Shen Zian Wang Wenzheng Chen K. Yin Daiqing Li Or Litany Zan Gojcic Sanja Fidler 66 450 0 22 Sep 2022
ISS: Image as Stepping Stone for Text-Guided 3D Shape Generation Zhengzhe Liu Peng Dai Ruihui Li Xiaojuan Qi Chi-Wing Fu DiffM 209 25 0 09 Sep 2022
DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation Nataniel Ruiz Yuanzhen Li Varun Jampani Yael Pritch Michael Rubinstein Kfir Aberman 271 2,854 0 25 Aug 2022
Learning to Generate 3D Shapes from a Single Example Rundi Wu Changxi Zheng GAN 3DV 68 34 0 05 Aug 2022
An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion Rinon Gal Yuval Alaluf Yuval Atzmon Or Patashnik Amit H. Bermano Gal Chechik Daniel Cohen-Or 141 1,874 0 02 Aug 2022
Classifier-Free Diffusion Guidance Jonathan Ho Tim Salimans FaML 188 3,885 0 26 Jul 2022
Cross-Modal 3D Shape Generation and Manipulation Zezhou Cheng Menglei Chai Jian Ren Hsin-Ying Lee Kyle Olszewski Zeng Huang Subhransu Maji Sergey Tulyakov 62 32 0 24 Jul 2022
SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generation Xin-Yang Zheng Yang Liu Peng-Shuai Wang Xin Tong 55 97 0 24 Jun 2022
DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes Jia-Wei Liu Yan-Pei Cao Weijia Mao Wenqiao Zhang David Junhao Zhang Jussi Keppo Ying Shan Xiaohu Qie Mike Zheng Shou 201 118 0 31 May 2022
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang ... Raphael Gontijo-Lopes Tim Salimans Jonathan Ho David J Fleet Mohammad Norouzi VLM 400 6,012 0 23 May 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 377 6,859 0 13 Apr 2022
GIRAFFE HD: A High-Resolution 3D-aware Generative Model Yang Xue Yuheng Li Krishna Kumar Singh Yong Jae Lee 72 99 0 28 Mar 2022
Towards Implicit Text-Guided 3D Shape Generation Zhengzhe Liu Yi Wang Xiaojuan Qi Chi-Wing Fu 53 92 0 28 Mar 2022
CLIP-Mesh: Generating textured meshes from text using pretrained image-text models N. Khalid Tianhao Xie Eugene Belilovsky Tiberiu Popa CLIP 70 296 0 24 Mar 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 267 30,123 0 01 Mar 2022
CLIP-GEN: Language-Free Training of a Text-to-Image Generator with CLIP Zihao Wang Wei Liu Qian He Xin-ru Wu Zili Yi CLIP VLM 244 75 0 01 Mar 2022
Snowflake Point Deconvolution for Point Cloud Completion and Generation with Skip-Transformer Peng Xiang Xin Wen Yu-Shen Liu Yaru Cao Pengfei Wan Wen Zheng Zhizhong Han 3DPC 59 66 0 18 Feb 2022
SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminators Andrew F. Luo Tianqin Li Wenhao Zhang T. Lee GAN 3DV 60 32 0 01 Jan 2022
StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generation Roy Or-El Xuan Luo Mengyi Shan Eli Shechtman Jeong Joon Park Ira Kemelmacher-Shlizerman 3DH 3DV 93 354 0 21 Dec 2021
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 403 15,486 0 20 Dec 2021
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models Alex Nichol Prafulla Dhariwal Aditya A. Ramesh Pranav Shyam Pamela Mishkin Bob McGrew Ilya Sutskever Mark Chen 328 3,594 0 20 Dec 2021
GRAM: Generative Radiance Manifolds for 3D-Aware Image Generation Yu Deng Jiaolong Yang Jianfeng Xiang Xin Tong 3DH 54 249 0 16 Dec 2021
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 258 358 0 06 Dec 2021
Zero-Shot Text-Guided Object Generation with Dream Fields Ajay Jain B. Mildenhall Jonathan T. Barron Pieter Abbeel Ben Poole 70 565 0 02 Dec 2021
LAFITE: Towards Language-Free Training for Text-to-Image Generation Yufan Zhou Ruiyi Zhang Changyou Chen Chunyuan Li Chris Tensmeyer Tong Yu Jiuxiang Gu Jinhui Xu Tong Sun VLM 72 168 0 27 Nov 2021
Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields Jonathan T. Barron B. Mildenhall Dor Verbin Pratul P. Srinivasan Peter Hedman 176 1,677 0 23 Nov 2021
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction Cheng Sun Min Sun Hwann-Tzong Chen 119 1,074 0 22 Nov 2021
LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs Christoph Schuhmann Richard Vencu Romain Beaumont R. Kaczmarczyk Clayton Mullis Aarush Katta Theo Coombes J. Jitsev Aran Komatsuzaki VLM MLLM CLIP 212 1,425 0 03 Nov 2021
Generative Occupancy Fields for 3D Surface-Aware Image Synthesis Xudong Xu Xingang Pan Dahua Lin Bo Dai 3DH AI4CE 64 61 0 01 Nov 2021
StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis Jiatao Gu Lingjie Liu Peng Wang Christian Theobalt VGen 67 557 0 18 Oct 2021
CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation Aditya Sanghi Hang Chu Joseph G. Lambourne Ye Wang Chin-Yi Cheng Marco Fumero Kamal Rahimi Malekshan CLIP 98 293 0 06 Oct 2021
DAE-GAN: Dynamic Aspect-aware GAN for Text-to-Image Synthesis Shulan Ruan Yong Zhang Kun Zhang Yanbo Fan Fan Tang Qi Liu Enhong Chen 71 90 0 27 Aug 2021
Volume Rendering of Neural Implicit Surfaces Lior Yariv Jiatao Gu Yoni Kasten Y. Lipman 3DV 81 1,041 0 22 Jun 2021
CogView: Mastering Text-to-Image Generation via Transformers Ming Ding Zhuoyi Yang Wenyi Hong Wendi Zheng Chang Zhou ... Junyang Lin Xu Zou Zhou Shao Hongxia Yang Jie Tang ViT VLM 99 779 0 26 May 2021
3D Shape Generation and Completion through Point-Voxel Diffusion Linqi Zhou Yilun Du Jiajun Wu DiffM 99 524 0 08 Apr 2021
Learning Generative Models of Textured 3D Meshes from Real-World Images Dario Pavllo Jonas Köhler Thomas Hofmann Aurelien Lucchi 3DV 3DH 87 50 0 29 Mar 2021
Diffusion Probabilistic Models for 3D Point Cloud Generation Shitong Luo Wei Hu 3DPC 255 744 0 02 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 897 29,372 0 26 Feb 2021