Novel View Synthesis with Diffusion Models

6 October 2022

Daniel Watson

William Chan

Ricardo Martín Brualla

Papers citing "Novel View Synthesis with Diffusion Models"

50 / 229 papers shown

Title
Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models Jianglong Ye Peng Wang Kejie Li Yichun Shi Heng Wang DiffM 43 72 0 04 Oct 2023
Efficient-3DiM: Learning a Generalizable Single-image Novel-view Synthesizer in One Day Yi Ding Hao Tang Jen-Hao Rick Chang Liangchen Song Zhangyang Wang Liangliang Cao DiffM 31 10 0 04 Oct 2023
SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D Weiyu Li Rui Chen Xuelin Chen Ping Tan 18 115 0 04 Oct 2023
Dream the Impossible: Outlier Imagination with Diffusion Models Xuefeng Du Yiyou Sun Xiaojin Zhu Yixuan Li 25 54 0 23 Sep 2023
Light Field Diffusion for Single-View Novel View Synthesis Yifeng Xiong Haoyu Ma Shanlin Sun Kun Han Hao Tang Xiaohui Xie DiffM 46 2 0 20 Sep 2023
ReShader: View-Dependent Highlights for Single Image View-Synthesis Avinash Paliwal Brandon Nguyen Andrii Tsarov N. Kalantari 35 3 0 19 Sep 2023
$360$^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting$ 360 $^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting Nuri Ryu Minsu Gong Geon-Yeong Kim Joo-Haeng Lee Sunghyun Cho 3DGS 27 1 0 19 Sep 2023
Breathing New Life into 3D Assets with Generative Repainting Tianfu Wang Menelaos Kanakis Konrad Schindler Luc Van Gool Anton Obukhov AI4CE 21 13 0 15 Sep 2023
Viewpoint Textual Inversion: Unleashing Novel View Synthesis with Pretrained 2D Diffusion Models James Burgess Kuan-Chieh Wang Serena Yeung-Levy DiffM 38 6 0 14 Sep 2023
Generative Image Dynamics Zhengqi Li Richard Tucker Noah Snavely Aleksander Holynski DiffM 46 63 0 14 Sep 2023
Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clips Yufei Ye Poorvi Hebbar Abhinav Gupta Shubham Tulsiani DiffM 31 42 0 11 Sep 2023
SimNP: Learning Self-Similarity Priors Between Neural Points Christopher Wewer Eddy Ilg Bernt Schiele J. E. Lenssen 3DPC 30 10 0 07 Sep 2023
SyncDreamer: Generating Multiview-consistent Images from a Single-view Image Yuan Liu Chu-Hsing Lin Zijiao Zeng Xiaoxiao Long Lingjie Liu Taku Komura Wenping Wang DiffM 52 416 0 07 Sep 2023
SMPLitex: A Generative Model and Dataset for 3D Human Texture Estimation from Single Image Dan Casas M. C. Trinidad 3DH 3DGS 27 20 0 04 Sep 2023
VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation Xin Li Wenqing Chu Ye Wu Weihang Yuan Fanglong Liu Qi Zhang Fu Li Haocheng Feng Errui Ding Jingdong Wang VGen 45 52 0 01 Sep 2023
MVDream: Multi-view Diffusion for 3D Generation Yichun Shi Peng Wang Jianglong Ye Mai Long Kejie Li X. Yang 22 589 0 31 Aug 2023
HoloFusion: Towards Photo-realistic 3D Generative Modeling Animesh Karnewar Niloy J. Mitra Andrea Vedaldi David Novotny DiffM 45 31 0 28 Aug 2023
TADA! Text to Animatable Digital Avatars Tingting Liao Hongwei Yi Yuliang Xiu Jiaxaing Tang Yangyi Huang Justus Thies Michael J. Black 76 94 0 21 Aug 2023
HumanLiff: Layer-wise 3D Human Generation with Diffusion Model Shou-Yong Hu Fangzhou Hong Tao Hu Liang Pan Haiyi Mei Weiye Xiao Lei Yang Ziwei Liu 30 19 0 18 Aug 2023
TeCH: Text-guided Reconstruction of Lifelike Clothed Humans Yangyi Huang Hongwei Yi Yuliang Xiu Tingting Liao Jiaxiang Tang Deng Cai Justus Thies DiffM 63 81 0 16 Aug 2023
CLE Diffusion: Controllable Light Enhancement Diffusion Model Yuyang Yin Dejia Xu Chuangchuang Tan P. Liu Yao-Min Zhao Yunchao Wei DiffM 37 40 0 13 Aug 2023
RGB-D-Fusion: Image Conditioned Depth Diffusion of Humanoid Subjects Sascha Kirch Valeria Olyunina Jan Ondřej Rafael Pagés Sergio Martín Clara Pérez-Molina 22 2 0 29 Jul 2023
Car-Studio: Learning Car Radiance Fields from Single-View and Endless In-the-wild Images Tianyu Liu Hao Zhao Yang Yu Guyue Zhou Ming-Yu Liu 39 3 0 26 Jul 2023
Reference-based Painterly Inpainting via Diffusion: Crossing the Wild Reference Domain Gap Dejia Xu Xingqian Xu Wenyan Cong Humphrey Shi Zhangyang Wang DiffM 29 4 0 20 Jul 2023
Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animation Tserendorj Adiya Jae Shin Yoon Jungeun Lee Sang-hyeon Kim Hwasup Lim DiffM 31 0 0 02 Jul 2023
Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors Guocheng Qian Jinjie Mai Abdullah Hamdi Jian Ren Aliaksandr Siarohin ... Hsin-Ying Lee Ivan Skorokhodov Peter Wonka Sergey Tulyakov Guohao Li DiffM 36 355 0 30 Jun 2023
Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision A. Tewari Tianwei Yin George Cazenavette Semon Rezchikov J. Tenenbaum F. Durand William T. Freeman Vincent Sitzmann DiffM 43 88 0 20 Jun 2023
TryOnDiffusion: A Tale of Two UNets Luyang Zhu Dawei Yang Tyler Lixuan Zhu F. Reda William Chan Chitwan Saharia Mohammad Norouzi Ira Kemelmacher-Shlizerman DiffM 35 102 0 14 Jun 2023
DORSal: Diffusion for Object-centric Representations of Scenes et al Allan Jabri Sjoerd van Steenkiste Emiel Hoogeboom Mehdi S. M. Sajjadi Thomas Kipf 27 17 0 13 Jun 2023
Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data Stanislaw Szymanowicz Christian Rupprecht Andrea Vedaldi 44 99 0 13 Jun 2023
DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Views Paul D. Yoo Jiaxian Guo Yutaka Matsuo S. Gu 16 24 0 06 Jun 2023
Guided Motion Diffusion for Controllable Human Motion Synthesis Korrawe Karunratanakul Konpat Preechakul Supasorn Suwajanakorn Siyu Tang DiffM 34 123 0 21 May 2023
Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models Byungjun Kim Patrick Kwon K. Lee Myunggi Lee Sookwan Han Daesik Kim Hanbyul Joo DiffM 43 20 0 19 May 2023
Shap-E: Generating Conditional 3D Implicit Functions Heewoo Jun Alex Nichol DiffM 203 310 0 03 May 2023
Ray Conditioning: Trading Photo-consistency for Photo-realism in Multi-view Image Generation Eric Chen Sidhanth Holalkere Ruyu Yan Kai Zhang Abe Davis 24 5 0 26 Apr 2023
Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models Jason J. Yu Fereshteh Forghani Konstantinos G. Derpanis Marcus A. Brubaker DiffM 29 45 0 21 Apr 2023
Expressive Text-to-Image Generation with Rich Text Songwei Ge Taesung Park Jun-Yan Zhu Jia-Bin Huang DiffM 79 79 0 13 Apr 2023
Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction Hansheng Chen Jiatao Gu Anpei Chen Wei Tian Z. Tu Lingjie Liu Haoran Su VGen DiffM 56 146 0 13 Apr 2023
Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Images Jiatao Gu Qingzhe Gao Shuangfei Zhai Baoquan Chen Lingjie Liu J. Susskind 36 29 0 13 Apr 2023
DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion J. Karras Aleksander Holynski Ting-Chun Wang Ira Kemelmacher-Shlizerman DiffM VGen 35 138 0 12 Apr 2023
Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond Mohammadreza Armandpour A. Sadeghian Huangjie Zheng Amir Sadeghian Mingyuan Zhou DiffM 18 123 0 11 Apr 2023
Generative Novel View Synthesis with 3D-Aware Diffusion Models E. R. Chan Koki Nagano Matthew A. Chan Alexander W. Bergman Jeong Joon Park A. Levy M. Aittala Shalini De Mello Tero Karras Gordon Wetzstein DiffM 24 233 0 05 Apr 2023
3D-aware Image Generation using 2D Diffusion Models Jianfeng Xiang Jiaolong Yang Binbin Huang Xin Tong DiffM 42 65 0 31 Mar 2023
Consistent View Synthesis with Pose-Guided Diffusion Models Hung-Yu Tseng Qinbo Li Changil Kim Suhib Alsisan Jia-Bin Huang Johannes Kopf DiffM 43 101 0 30 Mar 2023
HoloDiffusion: Training a 3D Diffusion Model using 2D Images Animesh Karnewar Andrea Vedaldi David Novotny Niloy Mitra 46 109 0 29 Mar 2023
Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior Junshu Tang Tengfei Wang Bo Zhang Ting Zhang Ran Yi Lizhuang Ma Dong Chen DiffM 192 307 0 24 Mar 2023
TEGLO: High Fidelity Canonical Texture Mapping from Single-View Images Vishal Vinod Tanmay Shah Dmitry Lagun 35 4 0 24 Mar 2023
NOPE: Novel Object Pose Estimation from a Single Image Van Nguyen Nguyen Thibault Groueix Yinlin Hu Mathieu Salzmann Vincent Lepetit 48 25 0 23 Mar 2023
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models Lukas Höllein Ang Cao Andrew Owens Justin Johnson Matthias Nießner DiffM 38 177 0 21 Mar 2023
Few-shot Neural Radiance Fields Under Unconstrained Illumination Seok-Kun Lee Jun-woo Choi Seungryong Kim Ig-Jae Kim Junghyun Cho 30 7 0 21 Mar 2023