Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv (abs)PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 459 papers shown

Title
GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers Lorenza Prospero Abdullah Hamdi João F. Henriques Christian Rupprecht 3DGS 122 3 0 06 Sep 2024
MeshUp: Multi-Target Mesh Deformation via Blended Score Distillation Hyunwoo Kim Itai Lang Noam Aigerman Thibault Groueix Vladimir G. Kim Rana Hanocka AI4CE 129 3 0 27 Aug 2024
Pixel-Aligned Multi-View Generation with Depth Guided Decoder Z-H. Tang Peiye Zhuang Chaoyang Wang Aliaksandr Siarohin Yash Kant Alexander Schwing Sergey Tulyakov Hsin-Ying Lee 84 1 0 26 Aug 2024
Atlas Gaussians Diffusion for 3D Generation Haitao Yang Yuan Dong Hanwen Jiang Dejia Xu Georgios Pavlakos Qixing Huang 3DGS 203 3 0 23 Aug 2024
MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Model Minghua Liu Chong Zeng Xinyue Wei Ruoxi Shi Linghao Chen ... Zhaoning Wang Xiaoshuai Zhang Isabella Liu Hongzhi Wu Hao Su 162 26 0 19 Aug 2024
SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views Chao Xu Ang Li Linghao Chen Yulin Liu Ruoxi Shi Hao Su Minghua Liu 3DGS 107 22 0 19 Aug 2024
MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editing Chenjie Cao Chaohui Yu Yanwei Fu Fan Wang Xiangyang Xue VGen 115 10 0 15 Aug 2024
Scene123: One Prompt to 3D Scene Generation via Video-Assisted and Consistency-Enhanced MAE Yiying Yang Fukun Yin Jiayuan Fan Xin Chen Wanzhang Li Gang Yu VGen 104 1 0 10 Aug 2024
FlowDreamer: exploring high fidelity text-to-3D generation via rectified flow Hangyu Li Xiangxiang Chu Dingyuan Shi Lin Wang 89 3 0 09 Aug 2024
SceneMotifCoder: Example-driven Visual Program Learning for Generating 3D Object Arrangements Hou In Ivan Tam Hou In Derek Pun Austin T. Wang Angel X. Chang Manolis Savva 145 11 0 05 Aug 2024
Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attention Mengkang Hu DiffM 130 10 0 01 Aug 2024
Localized Gaussian Splatting Editing with Contextual Awareness Hanyuan Xiao Yingshu Chen Huajian Huang Haolin Xiong Jing Yang P. Prasad Yajie Zhao 3DGS DiffM 103 4 0 31 Jul 2024
SceneTeller: Language-to-3D Scene Generation Basak Melis Öcal Maxim Tatarchenko Sezer Karaoglu Theo Gevers 96 9 0 30 Jul 2024
Floating No More: Object-Ground Reconstruction from a Single Image Yunze Man Yichen Sheng Jianming Zhang Liangyan Gui Yu-Xiong Wang 103 2 0 26 Jul 2024
DreamCar: Leveraging Car-specific Prior for in-the-wild 3D Car Reconstruction Xiaobiao Du Haiyang Sun Jiaying Ying Tianqing Zhu Xin Yu 95 2 0 24 Jul 2024
DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priors Zizheng Yan Jiapeng Zhou Fanpeng Meng Yushuang Wu Lingteng Qiu Zisheng Ye Shuguang Cui Guanying Chen Xiaoguang Han DiffM 92 5 0 23 Jul 2024
HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions Haiyang Zhou Xinhua Cheng Wangbo Yu Yonghong Tian Li-ming Yuan 3DGS DiffM 112 11 0 21 Jul 2024
Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusion Boyang Deng Richard Tucker Zhengqi Li Leonidas Guibas Noah Snavely Gordon Wetzstein VGen 3DGS DiffM 107 14 0 18 Jul 2024
Connecting Consistency Distillation to Score Distillation for Text-to-3D Generation Zong-Han Li Minghui Hu Qian Zheng Xudong Jiang DiffM 86 7 0 18 Jul 2024
DiffuX2CT: Diffusion Learning to Reconstruct CT Images from Biplanar X-Rays Xuhui Liu Zhi Qiao Runkun Liu Hong Li Juan Zhang Xiantong Zhen Zhen Qian Baochang Zhang MedIm 90 2 0 18 Jul 2024
GenRC: Generative 3D Room Completion from Sparse Image Collections Ming-feng Li Yueh-Feng Ku Hong-Xuan Yen Chi Liu Yu-Lun Liu Albert Y. C. Chen Cheng-Hao Kuo Min Sun 3DV VGen 95 4 0 17 Jul 2024
SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flow Yuanzhi Zhu Xingchao Liu Qiang Liu 90 10 0 17 Jul 2024
4Dynamic: Text-to-4D Generation with Hybrid Priors Yu-Jie Yuan Leif Kobbelt Jiwen Liu Yuan Zhang Pengfei Wan Yu-kun Lai Lin Gao 98 6 0 17 Jul 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 212 50 0 17 Jul 2024
Animate3D: Animating Any 3D Model with Multi-view Video Diffusion Yanqin Jiang Chaohui Yu Chenjie Cao Fan Wang Weiming Hu Jin Gao VGen 80 19 0 16 Jul 2024
Tree-D Fusion: Simulation-Ready Tree Dataset from Single Images with Diffusion Priors Jae Joong Lee Bosheng Li Sara Beery Jonathan Huang Songlin Fei Raymond A. Yeh Bedrich Benes 97 6 0 14 Jul 2024
VividDreamer: Invariant Score Distillation For Hyper-Realistic Text-to-3D Generation Wenjie Zhuo Fan Ma Hehe Fan Yi Yang DiffM 98 8 0 13 Jul 2024
Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Images Zhangyang Qi Yunhan Yang Mengchen Zhang Long Xing Xiaoyang Wu Tong Wu Dahua Lin Xihui Liu Jiaqi Wang Hengshuang Zhao DiffM 99 10 0 08 Jul 2024
VEGS: View Extrapolation of Urban Scenes in 3D Gaussian Splatting using Learned Priors Sungwon Hwang Min-Jung Kim Taewoong Kang Jayeon Kang Jaegul Choo 3DGS 143 11 0 03 Jul 2024
Meta 3D Gen Raphael Bensadoun Tom Monnier Yanir Kleiman Filippos Kokkinos Yawar Siddiqui ... Antoine Toisoul David Novotny Oran Gafni Natalia Neverova Andrea Vedaldi 91 1 0 02 Jul 2024
Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materials Yawar Siddiqui Tom Monnier Filippos Kokkinos Mahendra Kariya Yanir Kleiman ... Oran Gafni Natalia Neverova Andrea Vedaldi Roman Shapovalov David Novotny 144 37 0 02 Jul 2024
ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillation Zhiyuan Ma Yuxiang Wei Yabin Zhang Xiangyu Zhu Zhen Lei Lei Zhang DiffM 106 15 0 02 Jul 2024
TrAME: Trajectory-Anchored Multi-View Editing for Text-Guided 3D Gaussian Splatting Manipulation Chaofan Luo Donglin Di Xun Yang Yongjia Ma Zhou Xue Chen Wei Yebin Liu 3DGS 90 9 0 02 Jul 2024
OccFusion: Rendering Occluded Humans with Generative Diffusion Priors Adam Sun Tiange Xiang Scott Delp Li Fei-Fei Ehsan Adeli 111 2 0 29 Jun 2024
From Efficient Multimodal Models to World Models: A Survey Xinji Mai Zeng Tao Junxiong Lin Haoran Wang Yang Chang Yanlan Kang Yan Wang Wenqiang Zhang 109 6 0 27 Jun 2024
GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly Enhanced Quality Taoran Yi Jiemin Fang Zanwei Zhou Junjie Wang Guanjun Wu Lingxi Xie Xiaopeng Zhang Wenyu Liu Xinggang Wang Qi Tian 3DGS 105 8 0 26 Jun 2024
Director3D: Real-world Camera Trajectory and 3D Scene Generation from Text Xinyang Li Zhangyu Lai Linning Xu Yansong Qu Liujuan Cao Shengchuan Zhang Bo Dai Rongrong Ji VGen 136 10 0 25 Jun 2024
Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modeling Min-Seop Kwak Donghoon Ahn Ines Hyeonsu Kim Jin-Hwa Kim Seungryong Kim 70 2 0 24 Jun 2024
YouDream: Generating Anatomically Controllable Consistent Text-to-3D Animals Sandeep Mishra Oindrila Saha A. Bovik 104 0 0 24 Jun 2024
Text-based Transfer Function Design for Semantic Volume Rendering S. Jeong Jixian Li Christopher Johnson Shusen Liu Matthew Berger 87 2 0 21 Jun 2024
GeoLRM: Geometry-Aware Large Reconstruction Model for High-Quality 3D Gaussian Generation Chubin Zhang Hongliang Song Yi Wei Yu Chen Jiwen Lu Yansong Tang 3DGS 3DV 115 19 0 21 Jun 2024
A3D: Does Diffusion Dream about 3D Alignment? Savva Ignatyev Nina Konovalova Daniil Selikhanovych Nikolay Patakin Nikolay Patakin ... Anton Konushin Peter Wonka Alexander Filippov Peter Wonka Evgeny Burnaev DiffM 201 1 0 21 Jun 2024
Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models Paul Henderson Melonie de Almeida D. Ivanova Titas Anciukevicius 3DGS 134 4 0 18 Jun 2024
HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors Panwang Pan Zhuo Su Chenguo Lin Zhen Fan Yongjie Zhang Zeming Li Tingting Shen Yadong Mu Yebin Liu 3DGS 122 21 0 18 Jun 2024
GenMM: Geometrically and Temporally Consistent Multimodal Data Generation for Video and LiDAR Bharat Singh Viveka Kulharia Luyu Yang Avinash Ravichandran Ambrish Tyagi Ashish Shrivastava VGen 104 2 0 15 Jun 2024
OrientDream: Streamlining Text-to-3D Generation with Explicit Orientation Control Yuzhong Huang Zhong Li Zhang Chen Zhiyuan Ren Guosheng Lin Fred Morstatter Yi Tian Xu 111 1 0 14 Jun 2024
Rethinking Score Distillation as a Bridge Between Image Distributions David McAllister Songwei Ge Jia-Bin Huang David W. Jacobs Alexei A. Efros Aleksander Holyñski Angjoo Kanazawa DiffM 102 15 0 13 Jun 2024
Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Models Ziyi Wu Yulia Rubanova Rishabh Kabra Drew A. Hudson Igor Gilitschenski Yusuf Aytar Sjoerd van Steenkiste Kelsey R. Allen Thomas Kipf VGen DiffM 119 9 0 13 Jun 2024
Preserving Identity with Variational Score for General-purpose 3D Editing Duong H. Le Tuan Pham Aniruddha Kembhavi Stephan Mandt Wei-Chiu Ma Jiasen Lu 89 0 0 13 Jun 2024
C3DAG: Controlled 3D Animal Generation using 3D pose guidance Sandeep Mishra Oindrila Saha A. Bovik 78 0 0 11 Jun 2024