Novel View Synthesis with Diffusion Models

6 October 2022

Daniel Watson

William Chan

Ricardo Martín Brualla

Papers citing "Novel View Synthesis with Diffusion Models"

50 / 229 papers shown

Title
GVDIFF: Grounded Text-to-Video Generation with Diffusion Models Huanzhang Dou Ruixiang Li Wei Su Xi Li DiffM 42 1 0 02 Jul 2024
MultiDiff: Consistent Novel View Synthesis from a Single Image Norman Muller Katja Schwarz Barbara Roessle Lorenzo Porzi Samuel Rota Buló Matthias Nießner Peter Kontschieder DiffM 49 22 0 26 Jun 2024
Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models Paul Henderson Melonie de Almeida D. Ivanova Titas Anciukevicius 3DGS 51 4 0 18 Jun 2024
Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Models Ziyi Wu Yulia Rubanova Rishabh Kabra Drew A. Hudson Igor Gilitschenski Yusuf Aytar Sjoerd van Steenkiste Kelsey R. Allen Thomas Kipf VGen DiffM 49 10 0 13 Jun 2024
ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Models Meng-Li Shih Wei-Chiu Ma Aleksander Holyñski Forrester Cole Brian L. Curless Janne Kontkanen 32 3 0 10 Jun 2024
Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Image Stanislaw Szymanowicz Eldar Insafutdinov Chuanxia Zheng Dylan Campbell João F. Henriques Christian Rupprecht Andrea Vedaldi 3DGS 39 49 0 06 Jun 2024
A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation Ruihe Wang Yukang Cao Kai Han Kwan-Yee K. Wong 58 5 0 06 Jun 2024
Learning to Approximate Particle Smoothing Trajectories via Diffusion Generative Models Ella Tamir Arno Solin DiffM 33 0 0 01 Jun 2024
Zero-to-Hero: Enhancing Zero-Shot Novel View Synthesis via Attention Map Filtering Ido Sobol Chenfeng Xu Or Litany DiffM 43 1 0 29 May 2024
GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping Junyoung Seo Kazumi Fukuda Takashi Shibuya Takuya Narihira Naoki Murata Shoukang Hu Chieh-Hsin Lai Seungryong Kim Yuki Mitsufuji 60 17 0 27 May 2024
NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer Meng You Zhiyu Zhu Hui Liu Junhui Hou VGen DiffM 31 23 0 24 May 2024
CAT3D: Create Anything in 3D with Multi-View Diffusion Models Ruiqi Gao Aleksander Holynski Philipp Henzler Arthur Brussee Ricardo Martín Brualla Pratul P. Srinivasan Jonathan T. Barron Ben Poole 43 150 0 16 May 2024
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion Jaidev Shriram Alex Trevithick Lingjie Liu Ravi Ramamoorthi DiffM 3DGS 77 55 0 10 Apr 2024
The More You See in 2D, the More You Perceive in 3D Xinyang Han Zelin Gao Angjoo Kanazawa Shubham Goel Yossi Gandelsman DiffM 56 3 0 04 Apr 2024
MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space Armand Comas Massague Di Qiu Menglei Chai Marcel C. Bühler Amit Raj ... Mark Matthews Paulo F. U. Gotardo Octavia Camps Sergio Orts Thabo Beeler 55 1 0 01 Apr 2024
Video Interpolation with Diffusion Models Siddhant Jain Daniel Watson Eric Tabellion Aleksander Holyñski Ben Poole Janne Kontkanen SupR VGen DiffM 44 33 0 01 Apr 2024
Enhance Image Classification via Inter-Class Image Mixup with Diffusion Model Zhicai Wang Longhui Wei Tan Wang Heyu Chen Yanbin Hao Xiang Wang Xiangnan He Qi Tian VLM DiffM 37 17 0 28 Mar 2024
CVT-xRF: Contrastive In-Voxel Transformer for 3D Consistent Radiance Fields from Sparse Inputs Yingji Zhong Lanqing Hong Zhenguo Li Dan Xu 38 9 0 25 Mar 2024
latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction Christopher Wewer Kevin Raj Eddy Ilg Bernt Schiele J. E. Lenssen 3DGS 64 59 0 24 Mar 2024
DragAPart: Learning a Part-Level Motion Prior for Articulated Objects Ruining Li Chuanxia Zheng Christian Rupprecht Andrea Vedaldi DiffM 37 18 0 22 Mar 2024
Generic 3D Diffusion Adapter Using Controlled Multi-View Editing Hansheng Chen Ruoxi Shi Yulin Liu Bokui Shen Jiayuan Gu Gordon Wetzstein Hao Su Leonidas J. Guibas DiffM 50 19 0 18 Mar 2024
VideoMV: Consistent Multi-View Generation Based on Large Video Generative Model Qi Zuo Xiaodong Gu Lingteng Qiu Yuan Dong Zhengyi Zhao ... Rui Peng Siyu Zhu Zilong Dong Liefeng Bo Qixing Huang DiffM VGen 39 25 0 18 Mar 2024
Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors Ruicheng Wang Jianfeng Xiang Jiaolong Yang Xin Tong DiffM 40 4 0 18 Mar 2024
Envision3D: One Image to 3D with Anchor Views Interpolation Yatian Pang Tanghui Jia Yujun Shi Zhenyu Tang Junwu Zhang Xinhua Cheng Xing Zhou Francis E. H. Tay Li-xin Yuan 55 8 0 13 Mar 2024
V3D: Video Diffusion Models are Effective 3D Generators Zilong Chen Yikai Wang Feng Wang Zhengyi Wang Huaping Liu VGen 40 61 0 11 Mar 2024
FSViewFusion: Few-Shots View Generation of Novel Objects Rukhshanda Hussain Hui Xian Grace Lim Borchun Chen Mubarak Shah Ser Nam Lim DiffM 50 0 0 11 Mar 2024
Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos Mi Luo Zihui Xue Alex Dimakis Kristen Grauman EgoV DiffM 49 12 0 11 Mar 2024
Enhancing Texture Generation with High-Fidelity Using Advanced Texture Priors Kuo Xu Maoyu Wang Muyu Wang Lincong Feng Tianhui Zhang Xiaoli Liu 44 1 0 08 Mar 2024
Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation Xiao Ma Sumit Patidar Iain Haughton Stephen James 46 49 0 06 Mar 2024
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models Lukas Höllein Aljavz Bovzivc Norman Muller David Novotny Hung-Yu Tseng Christian Richardt Michael Zollhöfer Matthias Nießner DiffM 49 39 0 04 Mar 2024
ViewFusion: Towards Multi-View Consistency via Interpolated Denoising Xianghui Yang Yan Zuo Sameera Ramasinghe Loris Bazzani Gil Avraham Anton Van Den Hengel DiffM 35 6 0 29 Feb 2024
PolyOculus: Simultaneous Multi-view Image-based Novel View Synthesis Jason J. Yu Tristan Aumentado-Armstrong Fereshteh Forghani Konstantinos G. Derpanis Marcus A. Brubaker 41 5 0 28 Feb 2024
Diffusion Meets DAgger: Supercharging Eye-in-hand Imitation Learning Xiaoyu Zhang Matthew Chang Pranav Kumar Saurabh Gupta DiffM OffRL 51 14 0 27 Feb 2024
CharNeRF: 3D Character Generation from Concept Art Eddy Chu Yiyang Chen Chedy Raissi Anand Bhojan 3DH 27 1 0 27 Feb 2024
Cameras as Rays: Pose Estimation via Ray Diffusion Jason Y. Zhang Amy Lin Moneish Kumar Tzu-Hsuan Yang Deva Ramanan Shubham Tulsiani DiffM 42 55 0 22 Feb 2024
Consolidating Attention Features for Multi-view Image Editing Or Patashnik Rinon Gal Daniel Cohen-Or Jun-Yan Zhu Fernando de la Torre 32 6 0 22 Feb 2024
DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generation Chong Zeng Yue Dong Pieter Peers Youkang Kong Hongzhi Wu Xin Tong 36 28 0 19 Feb 2024
SPAD : Spatially Aware Multiview Diffusers Yash Kant Ziyi Wu Michael Vasilkovsky Guocheng Qian Jian Ren R. A. Guler Guohao Li Sergey Tulyakov Igor Gilitschenski Aliaksandr Siarohin DiffM 24 35 0 07 Feb 2024
Denoising Diffusion via Image-Based Rendering Titas Anciukevicius Fabian Manhardt Federico Tombari Paul Henderson 47 11 0 05 Feb 2024
Retrieval-Augmented Score Distillation for Text-to-3D Generation Junyoung Seo Susung Hong Wooseok Jang Ines Hyeonsu Kim Minseop Kwak Doyup Lee Seungryong Kim 57 9 0 05 Feb 2024
ViewFusion: Learning Composable Diffusion Models for Novel View Synthesis Bernard Spiegl Andrea Perin Stéphane Deny Alexander Ilin DiffM 16 2 0 05 Feb 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 55 40 0 31 Jan 2024
FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Models Feihong He Gang Li Mengyuan Zhang Leilei Yan Hui Xiong Fanzhang Li Li Shen DiffM 26 15 0 28 Jan 2024
DITTO: Diffusion Inference-Time T-Optimization for Music Generation Zachary Novack Julian McAuley Taylor Berg-Kirkpatrick Nicholas J. Bryan DiffM 34 33 0 22 Jan 2024
Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM Zhenzhen Weng Jingyuan Liu Hao Tan Zhan Xu Yang Zhou Serena Yeung-Levy Jimei Yang 3DH 40 8 0 22 Jan 2024
HexaGen3D: StableDiffusion is just one step away from Fast and Diverse Text-to-3D Generation Antoine Mercier Ramin Nakhli Mahesh Reddy R. Yasarla Hong Cai Fatih Porikli Guillaume Berger DiffM 35 15 0 15 Jan 2024
SIGNeRF: Scene Integrated Generation for Neural Radiance Fields Jan-Niklas Dihlmann Andreas Engelhardt Hendrik P. A. Lensch DiffM VGen 24 4 0 03 Jan 2024
GD^2-NeRF: Generative Detail Compensation via GAN and Diffusion for One-shot Generalizable Neural Radiance Fields X. Pan Zongxin Yang Shuai Bai Yi Yang DiffM OffRL 30 1 0 01 Jan 2024
iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views Chin-Hsuan Wu Yen-Chun Chen Bolivar Solarte Lu Yuan Min Sun 24 9 0 28 Dec 2023
4DGen: Grounded 4D Content Generation with Spatial-temporal Consistency Yuyang Yin Dejia Xu Zhangyang Wang Yao-Min Zhao Yunchao Wei 3DGS 54 72 0 28 Dec 2023