Zero-1-to-3: Zero-shot One Image to 3D Object

20 March 2023

Carl Vondrick

Papers citing "Zero-1-to-3: Zero-shot One Image to 3D Object"

50 / 143 papers shown

Title
Single Image, Any Face: Generalisable 3D Face Generation Wenqing Wang Haosen Yang Josef Kittler Xiatian Zhu 3DH 116 0 0 25 Sep 2024
SDFit: 3D Object Pose and Shape by Fitting a Morphable SDF to a Single Image Dimitrije Antić Sai Kumar Dwivedi Shashank Tripathi Theo Gevers Dimitrios Tzionas Dimitrios Tzionas 98 2 0 24 Sep 2024
MaterialFusion: Enhancing Inverse Rendering with Material Diffusion Priors Yehonathan Litman Or Patashnik Kangle Deng Aviral Agrawal Rushikesh Zawar Fernando de la Torre Shubham Tulsiani 122 7 0 23 Sep 2024
GroundingBooth: Grounding Text-to-Image Customization Zhexiao Xiong Wei Xiong Jing Shi He Zhang Yizhi Song Nathan Jacobs DiffM 96 9 0 13 Sep 2024
GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers Lorenza Prospero Abdullah Hamdi João F. Henriques Christian Rupprecht 3DGS 68 3 0 06 Sep 2024
View-Invariant Policy Learning via Zero-Shot Novel View Synthesis Stephen Tian Blake Wulfe Kyle Sargent Katherine Liu Sergey Zakharov Vitor Campagnolo Guizilini Jiajun Wu 117 12 0 05 Sep 2024
Generic Objects as Pose Probes for Few-shot View Synthesis Zhirui Gao Renjiao Yi Chenyang Zhu Ke Zhuang Wei Chen K. Xu 99 2 0 29 Aug 2024
MeshUp: Multi-Target Mesh Deformation via Blended Score Distillation Hyunwoo Kim Itai Lang Noam Aigerman Thibault Groueix Vladimir G. Kim Rana Hanocka AI4CE 73 3 0 27 Aug 2024
Latent Feature and Attention Dual Erasure Attack against Multi-View Diffusion Models for 3D Assets Protection Jingwei Sun Xuchong Zhang Changfeng Sun Qicheng Bai Hongbin Sun AAML DiffM 79 0 0 21 Aug 2024
Deep Geometric Moments Promote Shape Consistency in Text-to-3D Generation Utkarsh Nath Rajeev Goel Eun Som Jeon Changhoon Kim Kyle Min Yezhou Yang Yingzhen Yang Pavan Turaga 116 1 0 12 Aug 2024
SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency Yiming Xie Chun-Han Yao Vikram S. Voleti Huaizu Jiang Varun Jampani VGen 104 46 0 24 Jul 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 167 46 0 17 Jul 2024
Exploring the Potentials and Challenges of Deep Generative Models in Product Design Conception Phillip Mueller Lars Mikelsons AI4CE 77 3 0 15 Jul 2024
Controlling Space and Time with Diffusion Models Daniel Watson Saurabh Saxena Lala Li Andrea Tagliasacchi David J. Fleet VGen 120 30 0 10 Jul 2024
DreamBench++: A Human-Aligned Benchmark for Personalized Image Generation Yuang Peng Yuxin Cui Haomiao Tang Zekun Qi Runpei Dong Jing Bai Chunrui Han Zheng Ge Xiangyu Zhang Shu-Tao Xia EGVM 127 35 0 24 Jun 2024
LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Control Delin Qu Qizhi Chen Pingrui Zhang Xianqiang Gao Bin Zhao Bin Zhao Dong Wang Xuelong Li AI4CE 73 8 0 23 Jun 2024
A3D: Does Diffusion Dream about 3D Alignment? Savva Ignatyev Nina Konovalova Daniil Selikhanovych Nikolay Patakin Nikolay Patakin ... Anton Konushin Peter Wonka Alexander Filippov Peter Wonka Evgeny Burnaev DiffM 97 0 0 21 Jun 2024
Duoduo CLIP: Efficient 3D Understanding with Multi-View Images Han-Hung Lee Yiming Zhang Angel X. Chang 3DPC 114 4 0 17 Jun 2024
Generalizable Human Gaussians from Single-View Image Jinnan Chen Chen Li Jianfeng Zhang Lingting Zhu Buzhen Huang Hanlin Chen G. Lee DiffM 3DGS 78 11 0 10 Jun 2024
The 3D-PC: a benchmark for visual perspective taking in humans and machines Drew Linsley Peisen Zhou A. Ashok Akash Nagaraj Gaurav Gaonkar Francis E Lewis Zygmunt Pizlo Thomas Serre 108 6 0 06 Jun 2024
Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusion Hao Wen Zehuan Huang Yaohui Wang Xinyuan Chen Yu Qiao 138 9 0 05 Jun 2024
Dream-in-Style: Text-to-3D Generation Using Stylized Score Distillation Hubert Kompanowski Binh-Son Hua DiffM 85 3 0 05 Jun 2024
TetSphere Splatting: Representing High-Quality Geometry with Lagrangian Volumetric Meshes Minghao Guo Bohan Wang Kaiming He Wojciech Matusik 3DGS 105 7 0 30 May 2024
Diff3DS: Generating View-Consistent 3D Sketch via Differentiable Curve Rendering Yibo Zhang Lihong Wang Changqing Zou Tieru Wu Rui Ma DiffM 76 2 0 24 May 2024
MagicPose4D: Crafting Articulated Models with Appearance and Motion Control Hao Zhang Di Chang Fang Li Mohammad Soleymani Narendra Ahuja 77 6 0 22 May 2024
Images that Sound: Composing Images and Sounds on a Single Canvas Ziyang Chen Daniel Geng Andrew Owens DiffM 85 9 0 20 May 2024
X-Diffusion: Generating Detailed 3D MRI Volumes From a Single Image Using Cross-Sectional Diffusion Models Emmanuelle Bourigault Abdullah Hamdi Amir Jamaludin MedIm 79 2 0 30 Apr 2024
MaPa: Text-driven Photorealistic Material Painting for 3D Shapes Shangzhan Zhang Sida Peng Tao Xu Yuanbo Yang Tianrun Chen Nan Xue Yujun Shen Hujun Bao Ruizhen Hu Xiaowei Zhou DiffM 59 10 0 26 Apr 2024
DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling Xuening Yuan Hongyu Yang Yueming Zhao Di Huang 3DGS 83 3 0 14 Apr 2024
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion Jaidev Shriram Alex Trevithick Lingjie Liu Ravi Ramamoorthi DiffM 3DGS 125 58 0 10 Apr 2024
Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single View Andreea Dogaru M. Ozer Bernhard Egger 3DGS 84 6 0 04 Apr 2024
Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting Zhiqi Li Yiming Chen Lingzhe Zhao Peidong Liu DiffM 3DGS 93 18 0 15 Mar 2024
Optimized View and Geometry Distillation from Multi-view Diffuser Youjia Zhang Zikai Song Junqing Yu Yawei Luo Wei Yang 66 0 0 11 Dec 2023
Expressive Text-to-Image Generation with Rich Text Songwei Ge Taesung Park Jun-Yan Zhu Jia-Bin Huang DiffM 106 82 0 13 Apr 2023
RealFusion: 360° Reconstruction of Any Object from a Single Image Luke Melas-Kyriazi Christian Rupprecht Iro Laina Andrea Vedaldi 143 298 0 21 Feb 2023
Structure and Content-Guided Video Synthesis with Diffusion Models Patrick Esser Johnathan Chiu Parmida Atighehchian Jonathan Granskog Anastasis Germanidis DiffM VGen 142 532 0 06 Feb 2023
Multiview Compressive Coding for 3D Reconstruction Chaozheng Wu Justin Johnson Jitendra Malik Christoph Feichtenhofer Georgia Gkioxari 74 73 0 19 Jan 2023
MVTN: Learning Multi-View Transformations for 3D Understanding Abdullah Hamdi Faisal AlZahrani Silvio Giancola Guohao Li 3DV 3DPC 98 6 0 27 Dec 2022
Point-E: A System for Generating 3D Point Clouds from Complex Prompts Alex Nichol Heewoo Jun Prafulla Dhariwal Pamela Mishkin Mark Chen DiffM 81 607 0 16 Dec 2022
Objaverse: A Universe of Annotated 3D Objects Matt Deitke Dustin Schwenk Jordi Salvador Luca Weihs Oscar Michel Eli VanderBilt Ludwig Schmidt Kiana Ehsani Aniruddha Kembhavi Ali Farhadi 80 945 0 15 Dec 2022
Multi-View Mesh Reconstruction with Neural Deferred Shading Markus Worchel Rodrigo Diaz Weiwen Hu O. Schreer I. Feldmann Peter Eisert 3DV AI4CE 83 46 0 08 Dec 2022
NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors Congyue Deng C. Jiang C. Qi Xinchen Yan Yin Zhou Leonidas Guibas Drago Anguelov DiffM 69 164 0 06 Dec 2022
SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction Zhizhuo Zhou Shubham Tulsiani DiffM 77 214 0 01 Dec 2022
Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation Haochen Wang Xiaodan Du Jiahao Li Raymond A. Yeh Gregory Shakhnarovich DiffM 111 548 0 01 Dec 2022
NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360° Views Dejia Xu Yi Ding Peihao Wang Zhiwen Fan Yi Wang Zhangyang Wang DiffM 64 144 0 29 Nov 2022
Magic3D: High-Resolution Text-to-3D Content Creation Chen-Hsuan Lin Jun Gao Luming Tang Towaki Takikawa Fangyin Wei Xun Huang Karsten Kreis Sanja Fidler Ming-Yuan Liu Nayeon Lee 159 1,159 0 18 Nov 2022
InstructPix2Pix: Learning to Follow Image Editing Instructions Tim Brooks Aleksander Holynski Alexei A. Efros DiffM 185 1,792 0 17 Nov 2022
LAION-5B: An open large-scale dataset for training next generation image-text models Christoph Schuhmann Romain Beaumont Richard Vencu Cade Gordon Ross Wightman ... Srivatsa Kundurthy Katherine Crowson Ludwig Schmidt R. Kaczmarczyk J. Jitsev VLM MLLM CLIP 139 3,438 0 16 Oct 2022
Novel View Synthesis with Diffusion Models Daniel Watson William Chan Ricardo Martín Brualla Jonathan Ho Andrea Tagliasacchi Mohammad Norouzi DiffM 124 270 0 06 Oct 2022
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole Ajay Jain Jonathan T. Barron B. Mildenhall 124 2,407 0 29 Sep 2022