HoloDiffusion: Training a 3D Diffusion Model using 2D Images

29 March 2023

Animesh Karnewar

Andrea Vedaldi

David Novotny

Niloy Mitra

ArXiv PDF HTML

Papers citing "HoloDiffusion: Training a 3D Diffusion Model using 2D Images"

47 / 97 papers shown

Title
SPAD : Spatially Aware Multiview Diffusers Yash Kant Ziyi Wu Michael Vasilkovsky Guocheng Qian Jian Ren R. A. Guler Guohao Li Sergey Tulyakov Igor Gilitschenski Aliaksandr Siarohin DiffM 24 35 0 07 Feb 2024
Denoising Diffusion via Image-Based Rendering Titas Anciukevicius Fabian Manhardt Federico Tombari Paul Henderson 47 11 0 05 Feb 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 52 40 0 31 Jan 2024
TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion Yu-Ying Yeh Jia-Bin Huang Changil Kim Lei Xiao Thu Nguyen-Phuoc ... Cheng Zhang Manmohan Chandraker Carl S. Marshall Zhao Dong Zhengqin Li DiffM 32 30 0 17 Jan 2024
AGG: Amortized Generative 3D Gaussians for Single Image to 3D Dejia Xu Ye Yuan Morteza Mardani Sifei Liu Jiaming Song Zhangyang Wang Arash Vahdat 3DGS 46 44 0 08 Jan 2024
What You See is What You GAN: Rendering Every Pixel for High-Fidelity Geometry in 3D GANs Alex Trevithick Matthew Chan Towaki Takikawa Umar Iqbal Shalini De Mello Manmohan Chandraker Ravi Ramamoorthi Koki Nagano 3DV 61 6 0 04 Jan 2024
iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views Chin-Hsuan Wu Yen-Chun Chen Bolivar Solarte Lu Yuan Min Sun 24 9 0 28 Dec 2023
VolumeDiffusion: Flexible Text-to-3D Generation with Efficient Volumetric Encoder Zhicong Tang Shuyang Gu Chunyu Wang Ting Zhang Jianmin Bao Dongdong Chen Baining Guo DiffM 35 23 0 18 Dec 2023
Text2Immersion: Generative Immersive Scene with 3D Gaussians Ouyang Hao Kathryn Heal Stephen Lombardi Tiancheng Sun 3DGS 33 27 0 14 Dec 2023
Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers Zi-Xin Zou Zhipeng Yu Yuanchen Guo Yangguang Li Ding Liang Yan-Pei Cao Song-Hai Zhang 3DGS 42 173 0 14 Dec 2023
PI3D: Efficient Text-to-3D Generation with Pseudo-Image Diffusion Ying-Tian Liu Yuanchen Guo Guan Luo Heyi Sun Wei Yin Song-Hai Zhang 29 18 0 14 Dec 2023
GOEmbed: Gradient Origin Embeddings for Representation Agnostic 3D Feature Learning Animesh Karnewar Roman Shapovalov Tom Monnier Andrea Vedaldi Niloy J. Mitra David Novotny 47 0 0 14 Dec 2023
NViST: In the Wild New View Synthesis from a Single Image with Transformers Wonbong Jang Lourdes Agapito ViT 32 10 0 13 Dec 2023
NVS-Adapter: Plug-and-Play Novel View Synthesis from a Single Image Yoonwoo Jeong Jinwoo Lee Chiheon Kim Minsu Cho Doyup Lee 21 3 0 12 Dec 2023
Disentangled Clothed Avatar Generation from Text Descriptions Jiong-Qi Wang Yuan Liu Zhiyang Dou Zhengming Yu Yongqing Liang Xin Li Wenping Wang Rong Xie Li-Na Song 25 22 0 08 Dec 2023
Free3D: Consistent Novel View Synthesis without 3D Representation Chuanxia Zheng Andrea Vedaldi 3DV 42 48 0 07 Dec 2023
Multi-View Unsupervised Image Generation with Cross Attention Guidance L. Cerkezi A. Davtyan Sepehr Sameni Paolo Favaro DiffM 30 0 0 07 Dec 2023
ReconFusion: 3D Reconstruction with Diffusion Priors Rundi Wu B. Mildenhall Philipp Henzler Keunhong Park Ruiqi Gao ... Pratul P. Srinivasan Dor Verbin Jonathan T. Barron Ben Poole Aleksander Holynski 81 172 0 05 Dec 2023
ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation Peng Wang Yichun Shi 16 165 0 02 Dec 2023
FSGS: Real-Time Few-shot View Synthesis using Gaussian Splatting Zehao Zhu Zhiwen Fan Yi Ding Zhangyang Wang 3DGS 38 144 0 01 Dec 2023
GeoDream: Disentangling 2D and Geometric Priors for High-Fidelity and Consistent 3D Generation Baorui Ma Haoge Deng Junsheng Zhou Yu-Shen Liu Tiejun Huang Xinlong Wang DiffM 32 28 0 29 Nov 2023
DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model Yinghao Xu Hao Tan Fujun Luan Sai Bi Peng Wang ... Zifan Shi Kalyan Sunkavalli Gordon Wetzstein Zexiang Xu Kai Zhang 43 153 0 15 Nov 2023
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion Minghua Liu Ruoxi Shi Linghao Chen Zhuoyang Zhang Chao Xu Xinyue Wei Hansheng Chen Chong Zeng Jiayuan Gu Hao Su 36 188 0 14 Nov 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 33 102 0 11 Oct 2023
LLMR: Real-time Prompting of Interactive Worlds using Large Language Models Fernanda De La Torre Cathy Mengying Fang Han Huang Andrzej Banburski-Fahey Judith Amores Fernandez Jaron Lanier 40 45 0 21 Sep 2023
Light Field Diffusion for Single-View Novel View Synthesis Yifeng Xiong Haoyu Ma Shanlin Sun Kun Han Hao Tang Xiaohui Xie DiffM 46 2 0 20 Sep 2023
$360$^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting$ 360 $^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting Nuri Ryu Minsu Gong Geon-Yeong Kim Joo-Haeng Lee Sunghyun Cho 3DGS 27 1 0 19 Sep 2023
Viewpoint Textual Inversion: Unleashing Novel View Synthesis with Pretrained 2D Diffusion Models James Burgess Kuan-Chieh Wang Serena Yeung-Levy DiffM 38 6 0 14 Sep 2023
SyncDreamer: Generating Multiview-consistent Images from a Single-view Image Yuan Liu Chu-Hsing Lin Zijiao Zeng Xiaoxiao Long Lingjie Liu Taku Komura Wenping Wang DiffM 52 416 0 07 Sep 2023
MVDream: Multi-view Diffusion for 3D Generation Yichun Shi Peng Wang Jianglong Ye Mai Long Kejie Li X. Yang 22 589 0 31 Aug 2023
HoloFusion: Towards Photo-realistic 3D Generative Modeling Animesh Karnewar Niloy J. Mitra Andrea Vedaldi David Novotny DiffM 45 31 0 28 Aug 2023
FreeDrag: Feature Dragging for Reliable Point-based Image Editing Pengyang Ling Lin Chen Pan Zhang H. Chen Yi Jin Jinjin Zheng DiffM 34 14 0 10 Jul 2023
Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision A. Tewari Tianwei Yin George Cazenavette Semon Rezchikov J. Tenenbaum F. Durand William T. Freeman Vincent Sitzmann DiffM 43 88 0 20 Jun 2023
Edit-DiffNeRF: Editing 3D Neural Radiance Fields using 2D Diffusion Model Lu Yu Weikang Xiang Kang Han DiffM 20 15 0 15 Jun 2023
Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data Stanislaw Szymanowicz Christian Rupprecht Andrea Vedaldi 38 99 0 13 Jun 2023
Towards Visual Foundational Models of Physical Scenes Chethan Parameshwara Alessandro Achille Matthew Trager Xiaolong Li Jiawei Mo ... A. Swaminathan C. Taylor D. Venkatraman Xiaohan Fei Stefano Soatto DiffM 35 4 0 06 Jun 2023
Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shape Rundi Wu Ruoshi Liu Carl Vondrick Changxi Zheng DiffM 27 24 0 24 May 2023
Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction Xinhang Liu Jiaben Chen Shiu-hong Kao Yu-Wing Tai Chi-Keung Tang DiffM 27 15 0 24 May 2023
Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond Mohammadreza Armandpour A. Sadeghian Huangjie Zheng Amir Sadeghian Mingyuan Zhou DiffM 18 123 0 11 Apr 2023
3D-aware Image Generation using 2D Diffusion Models Jianfeng Xiang Jiaolong Yang Binbin Huang Xin Tong DiffM 42 65 0 31 Mar 2023
A Survey on Deep Generative 3D-aware Image Synthesis Weihao Xia Jing-Hao Xue 3DV 31 20 0 25 Oct 2022
Neural Wavelet-domain Diffusion for 3D Shape Generation Ka-Hei Hui Ruihui Li Jingyu Hu Chi-Wing Fu DiffM 56 123 0 19 Sep 2022
ReLU Fields: The Little Non-linearity That Could Animesh Karnewar Tobias Ritschel Oliver Wang Niloy J. Mitra 133 100 0 22 May 2022
BANMo: Building Animatable 3D Neural Models from Many Casual Videos Gengshan Yang Minh Vo Natalia Neverova Deva Ramanan Andrea Vedaldi Hanbyul Joo 3DH 129 184 0 23 Dec 2021
Palette: Image-to-Image Diffusion Models Chitwan Saharia William Chan Huiwen Chang Chris A. Lee Jonathan Ho Tim Salimans David J. Fleet Mohammad Norouzi DiffM VLM 342 1,591 0 10 Nov 2021
Diffusion Probabilistic Models for 3D Point Cloud Generation Shitong Luo Wei Hu 3DPC 180 721 0 02 Mar 2021
Image-to-Image Translation with Conditional Adversarial Networks Phillip Isola Jun-Yan Zhu Tinghui Zhou Alexei A. Efros SSeg 212 19,450 0 21 Nov 2016