SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion

18 March 2024

Mark Boss

Papers citing "SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion"

44 / 144 papers shown

Title
Scene123: One Prompt to 3D Scene Generation via Video-Assisted and Consistency-Enhanced MAE Yiying Yang Fukun Yin Jiayuan Fan Xin Chen Wanzhang Li Gang Yu VGen 46 0 0 10 Aug 2024
Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamics Ruining Li Chuanxia Zheng Christian Rupprecht Andrea Vedaldi DiffM VGen 38 9 0 08 Aug 2024
SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglement Mark Boss Zixuan Huang Aaryaman Vasishta Varun Jampani 3DGS 82 31 0 01 Aug 2024
CityX: Controllable Procedural Content Generation for Unbounded 3D Cities Shougao Zhang Mengqi Zhou Yuxi Wang Chuanchen Luo Rongyu Wang Yiwei Li Xucheng Yin Zhaoxiang Zhang Junran Peng 43 7 0 24 Jul 2024
SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency Yiming Xie Chun-Han Yao Vikram S. Voleti Huaizu Jiang Varun Jampani VGen 75 39 0 24 Jul 2024
Not All Noises Are Created Equally:Diffusion Noise Selection and Optimization Zipeng Qi Lichen Bai Haoyi Xiong Zeke Xie DiffM 39 18 0 19 Jul 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 88 42 0 17 Jul 2024
Animate3D: Animating Any 3D Model with Multi-view Video Diffusion Yanqin Jiang Chaohui Yu Chenjie Cao Fan Wang Weiming Hu Jin Gao VGen 54 16 0 16 Jul 2024
Exploring the Potentials and Challenges of Deep Generative Models in Product Design Conception Phillip Mueller Lars Mikelsons AI4CE 41 1 0 15 Jul 2024
HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Model Hieu T. Nguyen Yiwen Chen Vikram S. Voleti Varun Jampani Huaizu Jiang 51 0 0 28 Jun 2024
GeoLRM: Geometry-Aware Large Reconstruction Model for High-Quality 3D Gaussian Generation Chubin Zhang Hongliang Song Yi Wei Yu Chen Jiwen Lu Yansong Tang 3DGS 3DV 33 17 0 21 Jun 2024
Neural Residual Diffusion Models for Deep Scalable Vision Generation Zhiyuan Ma Liangliang Zhao Biqing Qi Bowen Zhou DiffM 64 2 0 19 Jun 2024
HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors Panwang Pan Zhuo Su Chenguo Lin Zhen Fan Yongjie Zhang Zeming Li Tingting Shen Yadong Mu Yebin Liu 3DGS 42 18 0 18 Jun 2024
Vid3D: Synthesis of Dynamic 3D Scenes using 2D Video Diffusion Rishab Parthasarathy Zachary Ankner Aaron Gokaslan DiffM VGen 42 0 0 17 Jun 2024
Training-free Camera Control for Video Generation Chen Hou Guoqiang Wei VGen DiffM 78 31 0 14 Jun 2024
Real3D: Scaling Up Large Reconstruction Models with Real-World Images Hanwen Jiang Qixing Huang Georgios Pavlakos OffRL 43 11 0 12 Jun 2024
Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models Yuxuan Xue Xianghui Xie R. Marin Gerard Pons-Moll 3DGS 49 7 0 12 Jun 2024
4Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models Heng Yu Chaoyang Wang Peiye Zhuang Willi Menapace Aliaksandr Siarohin Junli Cao László A. Jeni Sergey Tulyakov Hsin-Ying Lee VGen 45 23 0 11 Jun 2024
Generalizable Human Gaussians from Single-View Image Jinnan Chen Chen Li Jianfeng Zhang Lingting Zhu Buzhen Huang Hanlin Chen G. Lee DiffM 3DGS 62 10 0 10 Jun 2024
Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusion Hao Wen Zehuan Huang Yaohui Wang Xinyuan Chen Yu Qiao 105 7 0 05 Jun 2024
CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation Dejia Xu Weili Nie Chao Liu Sifei Liu Jan Kautz Zhangyang Wang Arash Vahdat DiffM VGen 81 52 0 04 Jun 2024
Bootstrap3D: Improving 3D Content Creation with Synthetic Data Zeyi Sun Tong Wu Pan Zhang Yuhang Zang Xiao-wen Dong Yuanjun Xiong Dahua Lin Jiaqi Wang 47 0 0 31 May 2024
Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabrication Yunuo Chen Tianyi Xie Zeshun Zong Xuan Li Feng Gao Yin Yang Yingnian Wu Chenfanfu Jiang 49 6 0 28 May 2024
EG4D: Explicit Generation of 4D Object without Score Distillation Qi Sun Zhiyang Guo Bo Liu Jing Nathan Yan Shengming Yin Wen-gang Zhou Jing Liao Houqiang Li VGen 3DGS 40 13 0 28 May 2024
Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability Shenyuan Gao Jiazhi Yang Li Chen Kashyap Chitta Yihang Qiu Andreas Geiger Jun Zhang Hongyang Li 71 75 0 27 May 2024
PivotMesh: Generic 3D Mesh Generation via Pivot Vertices Guidance Haohan Weng Yikai Wang Tong Zhang Chong Chen Jun Zhu 40 14 0 27 May 2024
Vidu4D: Single Generated Video to High-Fidelity 4D Reconstruction with Dynamic Gaussian Surfels Yikai Wang Xinzhou Wang Zilong Chen Zhengyi Wang Gang Hua Jun Zhu 3DGS VGen 40 14 0 27 May 2024
Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Models Hanwen Liang Yuyang Yin Dejia Xu Hanxue Liang Zhangyang Wang Konstantinos N. Plataniotis Yao Zhao Yunchao Wei VGen 61 38 0 26 May 2024
LAM3D: Large Image-Point-Cloud Alignment Model for 3D Reconstruction from Single Image Ruikai Cui Xibin Song Weixuan Sun Senbo Wang Weizhe Liu ... Taizhang Shang Yang Li Nick Barnes Hongdong Li Pan Ji 3DV 53 5 0 24 May 2024
NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer Meng You Zhiyu Zhu Hui Liu Junhui Hou VGen DiffM 31 23 0 24 May 2024
Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis Basile Van Hoorick Rundi Wu Ege Ozguroglu Kyle Sargent Ruoshi Liu P. Tokmakov Achal Dave Changxi Zheng Carl Vondrick DiffM VGen 58 29 0 23 May 2024
Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attention Peng Li Yuan Liu Xiaoxiao Long Feihu Zhang Cheng Lin ... Wenhan Luo Ping Tan Wenping Wang Qi-fei Liu Yi-Ting Guo VGen 83 41 0 19 May 2024
OneTo3D: One Image to Re-editable Dynamic 3D Model and Video Generation Jinwei Lin VGen DiffM 33 1 0 10 May 2024
Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers Peng Gao Le Zhuo Ziyi Lin Ruoyi Du Xu Luo ... Weicai Ye He Tong Jingwen He Yu Qiao Hongsheng Li VGen 37 84 0 09 May 2024
X-Ray: A Sequential 3D Representation For Generation Tao Hu Wenhang Ge Yuyang Zhao Gim Hee Lee MedIm 24 4 0 22 Apr 2024
InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models Jiale Xu Weihao Cheng Yiming Gao Xintao Wang Shenghua Gao Ying Shan 3DGS 46 183 0 10 Apr 2024
Idea-2-3D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs Junhao Chen Xiang Li Xiaojun Ye Chao Li Zhaoxin Fan Hao Zhao VGen 3DV 208 4 0 05 Apr 2024
TC4D: Trajectory-Conditioned Text-to-4D Generation Sherwin Bahmani Xian Liu Yifan Wang Ivan Skorokhodov Victor Rong ... Jeong Joon Park Sergey Tulyakov Gordon Wetzstein Andrea Tagliasacchi David B. Lindell 105 35 0 26 Mar 2024
VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Models Junlin Han Filippos Kokkinos Philip Torr VGen 80 40 0 18 Mar 2024
EscherNet: A Generative Model for Scalable View Synthesis Xin Kong Shikun Liu Xiaoyang Lyu Marwan Taher Xiaojuan Qi Andrew J. Davison DiffM 86 42 0 06 Feb 2024
Free3D: Consistent Novel View Synthesis without 3D Representation Chuanxia Zheng Andrea Vedaldi 3DV 42 48 0 07 Dec 2023
ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models Jeong-gi Kwak Erqun Dong Yuhe Jin Hanseok Ko Shweta Mahajan Kwang Moo Yi DiffM VGen 72 38 0 03 Dec 2023
Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets A. Blattmann Tim Dockhorn Sumith Kulal Daniel Mendelevitch Maciej Kilian ... Zion English Vikram S. Voleti Adam Letts Varun Jampani Robin Rombach VGen 172 1,019 0 25 Nov 2023
SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collections Mark Boss Andreas Engelhardt Abhishek Kar Yuanzhen Li Deqing Sun Jonathan T. Barron Hendrik P. A. Lensch Varun Jampani 93 80 0 31 May 2022