Challenges and Opportunities in 3D Content Generation

24 May 2024

Papers citing "Challenges and Opportunities in 3D Content Generation"

50 / 68 papers shown

Title
ART3D: 3D Gaussian Splatting for Text-Guided Artistic Scenes Generation Pengzhi Li Chengshuai Tang Qinxuan Huang Zhiheng Li 3DGS 60 12 0 17 May 2024
Generating Daylight-driven Architectural Design via Diffusion Models Pengzhi Li Baijuan Li AI4CE DiffM 55 11 0 20 Apr 2024
Sketch-to-Architecture: Generative AI-aided Architectural Design Pengzhi Li Baijuan Li Zhiheng Li 3DV AI4CE LM&Ro 49 19 0 29 Mar 2024
Tuning-Free Image Customization with Image and Text Guidance Pengzhi Li Qiang Nie Ying Chen Xi Jiang Kai Wu Yuhuan Lin Yong-Jin Liu Jinlong Peng Chengjie Wang Feng Zheng DiffM 53 20 0 19 Mar 2024
Gaussian Shell Maps for Efficient 3D Human Generation Rameen Abdal Wang Yifan Zifan Shi Yinghao Xu Ryan Po Zhengfei Kuang Qifeng Chen Dit-Yan Yeung Gordon Wetzstein 3DGS 3DH 62 44 0 29 Nov 2023
HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting Xian Liu Xiaohang Zhan Jiaxiang Tang Ying Shan Gang Zeng Dahua Lin Xihui Liu Ziwei Liu 3DGS 92 77 0 28 Nov 2023
DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior Jingxiang Sun Bo Zhang Ruizhi Shao Lizhen Wang Wen Liu Zhenda Xie Yebin Liu 92 135 0 25 Oct 2023
Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model Ruoxi Shi Hansheng Chen Zhuoyang Zhang Minghua Liu Chao Xu Xinyue Wei Linghao Chen Chong Zeng Hao Su VLM 60 366 0 23 Oct 2023
HiFi-123: Towards High-fidelity One Image to 3D Content Generation Wangbo Yu Li-ming Yuan Yan-Pei Cao Xiangjun Gao Xiaoyu Li Wenbo Hu Long Quan Ying Shan Yonghong Tian DiffM 69 31 0 10 Oct 2023
SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D Weiyu Li Rui Chen Xuelin Chen Ping Tan 51 120 0 04 Oct 2023
DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation Jiaxiang Tang Jiawei Ren Hang Zhou Ziwei Liu Gang Zeng 3DGS 133 631 0 28 Sep 2023
Text-to-3D using Gaussian Splatting Manish Sharma Moitreya Chatterjee Yikai Wang Huaping Liu 3DGS 72 242 0 28 Sep 2023
3D Gaussian Splatting for Real-Time Radiance Field Rendering Bernhard Kerbl Georgios Kopanas Thomas Leimkuehler G. Drettakis 3DGS 231 3,770 0 08 Aug 2023
Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors Guocheng Qian Jinjie Mai Abdullah Hamdi Jian Ren Aliaksandr Siarohin ... Hsin-Ying Lee Ivan Skorokhodov Peter Wonka Sergey Tulyakov Guohao Li DiffM 117 364 0 30 Jun 2023
LayerDiffusion: Layered Controlled Image Editing with Diffusion Models Pengzhi Li Qinxuan Huang Yikang Ding Zhiheng Li DiffM 62 38 0 30 May 2023
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation Zhengyi Wang Cheng Lu Yikai Wang Fan Bao Chongxuan Li Hang Su Jun Zhu DiffM 173 870 0 25 May 2023
Shap-E: Generating Conditional 3D Implicit Functions Heewoo Jun Alex Nichol DiffM 255 317 0 03 May 2023
Generative Novel View Synthesis with 3D-Aware Diffusion Models E. R. Chan Koki Nagano Matthew A. Chan Alexander W. Bergman Jeong Joon Park Axel Levy M. Aittala Shalini De Mello Tero Karras Gordon Wetzstein DiffM 91 238 0 05 Apr 2023
Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior Junshu Tang Tengfei Wang Bo Zhang Ting Zhang Ran Yi Lizhuang Ma Dong Chen DiffM 253 314 0 24 Mar 2023
DreamBooth3D: Subject-Driven Text-to-3D Generation Amit Raj S. Kaza Ben Poole Michael Niemeyer Nataniel Ruiz ... Kfir Aberman Michael Rubinstein Jonathan T. Barron Yuanzhen Li Varun Jampani DiffM 79 227 0 23 Mar 2023
Zero-1-to-3: Zero-shot One Image to 3D Object Ruoshi Liu Rundi Wu Basile Van Hoorick P. Tokmakov Sergey Zakharov Carl Vondrick DiffM 143 1,092 0 20 Mar 2023
MeshDiffusion: Score-based Generative 3D Mesh Modeling Zhen Liu Yao Feng Michael J. Black Derek Nowrouzezahrai Liam Paull Wei-yu Liu DiffM 73 158 0 14 Mar 2023
RealFusion: 360° Reconstruction of Any Object from a Single Image Luke Melas-Kyriazi Christian Rupprecht Iro Laina Andrea Vedaldi 159 298 0 21 Feb 2023
Point-E: A System for Generating 3D Point Clouds from Complex Prompts Alex Nichol Heewoo Jun Prafulla Dhariwal Pamela Mishkin Mark Chen DiffM 97 607 0 16 Dec 2022
NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors Congyue Deng C. Jiang C. Qi Xinchen Yan Yin Zhou Leonidas Guibas Drago Anguelov DiffM 84 164 0 06 Dec 2022
NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360° Views Dejia Xu Yi Ding Peihao Wang Zhiwen Fan Yi Wang Zhangyang Wang DiffM 82 144 0 29 Nov 2022
High-fidelity Facial Avatar Reconstruction from Monocular Video with Generative Priors Yun-Hao Bai Yanbo Fan Xuanxia Wang Yong Zhang Jingxiang Sun Chun Yuan Ying Shan 3DH 51 27 0 28 Nov 2022
DynIBaR: Neural Dynamic Image-Based Rendering Zhengqi Li Qianqian Wang Forrester Cole Richard Tucker Noah Snavely VGen 83 189 0 20 Nov 2022
Magic3D: High-Resolution Text-to-3D Content Creation Chen-Hsuan Lin Jun Gao Luming Tang Towaki Takikawa Fangyin Wei Xun Huang Karsten Kreis Sanja Fidler Ming-Yuan Liu Nayeon Lee 183 1,164 0 18 Nov 2022
InstructPix2Pix: Learning to Follow Image Editing Instructions Tim Brooks Aleksander Holynski Alexei A. Efros DiffM 207 1,813 0 17 Nov 2022
NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fields Kaiwen Jiang Shu-Yu Chen Feng-Lin Liu Hongbo Fu Lin Gao 3DH CVBM 45 40 0 15 Nov 2022
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures G. Metzer Elad Richardson Or Patashnik Raja Giryes Daniel Cohen-Or DiffM 132 468 0 14 Nov 2022
DiffEdit: Diffusion-based semantic image editing with mask guidance Guillaume Couairon Jakob Verbeek Holger Schwenk Matthieu Cord DiffM 143 507 0 20 Oct 2022
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole Ajay Jain Jonathan T. Barron B. Mildenhall 155 2,429 0 29 Sep 2022
DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation Nataniel Ruiz Yuanzhen Li Varun Jampani Yael Pritch Michael Rubinstein Kfir Aberman 279 2,861 0 25 Aug 2022
Prompt-to-Prompt Image Editing with Cross Attention Control Amir Hertz Ron Mokady J. Tenenbaum Kfir Aberman Yael Pritch Daniel Cohen-Or DiffM 200 1,773 0 02 Aug 2022
VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids Katja Schwarz Axel Sauer Michael Niemeyer Yiyi Liao Andreas Geiger 93 151 0 15 Jun 2022
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang ... Raphael Gontijo-Lopes Tim Salimans Jonathan Ho David J Fleet Mohammad Norouzi VLM 437 6,023 0 23 May 2022
Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors Oran Gafni Adam Polyak Oron Ashual Shelly Sheynin Devi Parikh Yaniv Taigman DiffM 79 523 0 24 Mar 2022
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding Thomas Müller Alex Evans Christoph Schied A. Keller 330 4,037 0 16 Jan 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 460 15,665 0 20 Dec 2021
Plenoxels: Radiance Fields without Neural Networks Alex Yu Sara Fridovich-Keil Matthew Tancik Qinhong Chen Benjamin Recht Angjoo Kanazawa 275 1,658 0 09 Dec 2021
Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields Dor Verbin Peter Hedman B. Mildenhall Todd E. Zickler Jonathan T. Barron Pratul P. Srinivasan 96 601 0 07 Dec 2021
Zero-Shot Text-Guided Object Generation with Dream Fields Ajay Jain B. Mildenhall Jonathan T. Barron Pieter Abbeel Ben Poole 76 567 0 02 Dec 2021
Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields Jonathan T. Barron B. Mildenhall Dor Verbin Pratul P. Srinivasan Peter Hedman 196 1,691 0 23 Nov 2021
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction Cheng Sun Min Sun Hwann-Tzong Chen 125 1,079 0 22 Nov 2021
Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis Tianchang Shen Jun Gao K. Yin Xuan Li Sanja Fidler 3DV 91 464 0 08 Nov 2021
CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation Aditya Sanghi Hang Chu Joseph G. Lambourne Ye Wang Chin-Yi Cheng Marco Fumero Kamal Rahimi Malekshan CLIP 108 294 0 06 Oct 2021
Point-Based Neural Rendering with Per-View Optimization Georgios Kopanas Julien Philip Thomas Leimkuhler G. Drettakis 81 209 0 06 Sep 2021
MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo Anpei Chen Zexiang Xu Fuqiang Zhao Xiaoshuai Zhang Fanbo Xiang Jingyi Yu Hao Su 126 801 0 29 Mar 2021