Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv (abs)PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 459 papers shown

Title
EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion Zehuan Huang Hao Wen Junting Dong Yaohui Wang Yangguang Li ... Yan-Pei Cao Ding Liang Yu Qiao Bo Dai Lu Sheng 108 37 0 11 Dec 2023
Large Scale Foundation Models for Intelligent Manufacturing Applications: A Survey Haotian Zhang S. D. Semujju Zhicheng Wang Xianwei Lv Kang Xu ... Jing Wu Zhuo Long Wensheng Liang Xiaoguang Ma Ruiyan Zhuang UQCV AI4TS AI4CE 107 4 0 11 Dec 2023
Optimized View and Geometry Distillation from Multi-view Diffuser Youjia Zhang Zikai Song Junqing Yu Yawei Luo Wei Yang 182 0 0 11 Dec 2023
SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation Thuan Hoang Nguyen Anh Tran DiffM 124 66 0 08 Dec 2023
Disentangled Clothed Avatar Generation from Text Descriptions Jiong-Qi Wang Yuan Liu Zhiyang Dou Zhengming Yu Yongqing Liang Xin Li Wenping Wang Rong Xie Li Song 80 23 0 08 Dec 2023
ControlRoom3D: Room Generation using Semantic Proxy Rooms Jonas Schult Sam S. Tsai Lukas Höllein Bichen Wu Jialiang Wang ... Zijian He Peizhao Zhang Bastian Leibe Peter Vajda Ji Hou 88 34 0 08 Dec 2023
Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting Xiaofeng Yang Yiwen Chen Cheng Chen Chi Zhang Yi Tian Xu Xulei Yang Fayao Liu Guosheng Lin 3DGS DiffM 70 18 0 08 Dec 2023
RL Dreams: Policy Gradient Optimization for Score Distillation based 3D Generation Aradhya Neeraj Mathur Phu-Cuong Pham Aniket Bera Ojaswa Sharma 71 0 0 08 Dec 2023
NeuSD: Surface Completion with Multi-View Text-to-Image Diffusion Savva Ignatyev Daniil Selikhanovych Oleg Voynov Yiqun Wang Peter Wonka Stamatios Lefkimmiatis Evgeny Burnaev 71 0 0 07 Dec 2023
NeRFiller: Completing Scenes via Generative 3D Inpainting Ethan Weber Aleksander Holyñski Varun Jampani Saurabh Saxena Noah Snavely Abhishek Kar Angjoo Kanazawa 106 32 0 07 Dec 2023
Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Views Yabo Chen Jiemin Fang Yuyang Huang Taoran Yi Xiaopeng Zhang Lingxi Xie Xinggang Wang Wenrui Dai Hongkai Xiong Qi Tian DiffM 99 21 0 07 Dec 2023
Text-to-3D Generation with Bidirectional Diffusion using both 2D and 3D priors Lihe Ding Shaocong Dong Zhanpeng Huang Zibin Wang Yiyuan Zhang Kaixiong Gong Dan Xu Tianfan Xue 78 17 0 07 Dec 2023
Resolution Chromatography of Diffusion Models Juno Hwang Yong-Hyun Park Junghyo Jo DiffM 55 1 0 07 Dec 2023
Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion Kira Prabhu Jane Wu Lynn Tsai Peter Hedman Dan B. Goldman Ben Poole Michael Broxton DiffM 78 8 0 06 Dec 2023
DreamComposer: Controllable 3D Object Generation via Multi-View Conditions Yu-nuo Yang Yukun Huang Xiaoyang Wu Yuanchen Guo Song-Hai Zhang Hengshuang Zhao Tong He Xihui Liu DiffM 98 12 0 06 Dec 2023
AnimatableDreamer: Text-Guided Non-rigid 3D Model Generation and Reconstruction with Canonical Score Distillation Xinzhou Wang Yikai Wang Junliang Ye Zhengyi Wang Gang Hua Pengkun Liu Ling Wang Kai Sun Xintong Wang Bin He DiffM 101 19 0 06 Dec 2023
ReconFusion: 3D Reconstruction with Diffusion Priors Rundi Wu B. Mildenhall Philipp Henzler Keunhong Park Ruiqi Gao ... Pratul P. Srinivasan Dor Verbin Jonathan T. Barron Ben Poole Aleksander Holynski 187 191 0 05 Dec 2023
Alchemist: Parametric Control of Material Properties with Diffusion Models Prafull Sharma Varun Jampani Yuanzhen Li Xuhui Jia Dmitry Lagun Frédo Durand William T. Freeman Mark J. Matthews DiffM 130 26 0 05 Dec 2023
AmbiGen: Generating Ambigrams from Pre-trained Diffusion Model Boheng Zhao Rana Hanocka Raymond A. Yeh DiffM 70 1 0 05 Dec 2023
DreaMo: Articulated 3D Reconstruction From A Single Casual Video Tao Tu Ming-feng Li C. Lin Yen-Chi Cheng Min Sun Ming-Hsuan Yang 114 5 0 05 Dec 2023
Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training Runze He Shaofei Huang Xuecheng Nie Tianrui Hui Luoqi Liu Jiao Dai Jizhong Han Guanbin Li Si Liu DiffM 64 8 0 04 Dec 2023
ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models Jeong-gi Kwak Erqun Dong Yuhe Jin Hanseok Ko Shweta Mahajan Kwang Moo Yi DiffM VGen 115 41 0 03 Dec 2023
ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation Peng Wang Yichun Shi 93 183 0 02 Dec 2023
StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D Pengsheng Guo Hans Hao Adam Caccavale Zhongzheng Ren Edward Zhang Qi Shan Aditya Sankar Alex Schwing Alex Colburn Fangchang Ma DiffM 3DGS 96 7 0 02 Dec 2023
MorpheuS: Neural Dynamic 360° Surface Reconstruction from Monocular RGB-D Video Hengyi Wang Jingwen Wang Lourdes Agapito 3DH 99 1 0 01 Dec 2023
Adversarial Score Distillation: When score distillation meets GAN Min Wei Jingkai Zhou Junyao Sun Xuesong Zhang DiffM 74 8 0 01 Dec 2023
Lasagna: Layered Score Distillation for Disentangled Object Relighting D. Bashkirova Arijit Ray Rupayan Mallick Sarah Adel Bargal Jianming Zhang Ranjay Krishna Kate Saenko 88 4 0 30 Nov 2023
GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphs Gege Gao Weiyang Liu Anpei Chen Andreas Geiger Bernhard Schölkopf DiffM 117 52 0 30 Nov 2023
LucidDreaming: Controllable Object-Centric 3D Generation Zhaoning Wang Ming Li Chong Chen 139 10 0 30 Nov 2023
X-Dreamer: Creating High-quality 3D Content by Bridging the Domain Gap Between Text-to-2D and Text-to-3D Generation Yiwei Ma Yijun Fan Jiayi Ji Haowei Wang Xiaoshuai Sun Guannan Jiang Annan Shu Rongrong Ji 108 7 0 30 Nov 2023
Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Models Daniel Geng Inbum Park Andrew Owens DiffM 108 30 0 29 Nov 2023
4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling Sherwin Bahmani Ivan Skorokhodov Victor Rong Gordon Wetzstein Leonidas Guibas Peter Wonka Sergey Tulyakov Jeong Joon Park Andrea Tagliasacchi David B. Lindell DiffM 152 113 0 29 Nov 2023
Spice-E : Structural Priors in 3D Diffusion using Cross-Entity Attention Etai Sella Gal Fiebelman Noam Atia Hadar Averbuch-Elor DiffM 90 2 0 29 Nov 2023
GeoDream: Disentangling 2D and Geometric Priors for High-Fidelity and Consistent 3D Generation Baorui Ma Haoge Deng Junsheng Zhou Yu-Shen Liu Tiejun Huang Xinlong Wang DiffM 95 29 0 29 Nov 2023
SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors Dave Zhenyu Chen Haoxuan Li Hsin-Ying Lee Sergey Tulyakov Matthias Nießner DiffM 84 29 0 28 Nov 2023
HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting Xian Liu Xiaohang Zhan Jiaxiang Tang Ying Shan Gang Zeng Dahua Lin Xihui Liu Ziwei Liu 3DGS 138 77 0 28 Nov 2023
Adversarial Diffusion Distillation Axel Sauer Dominik Lorenz A. Blattmann Robin Rombach 237 389 0 28 Nov 2023
HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion Jingbo Zhang Xiaoyu Li Qi Zhang Yan-Pei Cao Ying Shan Jing Liao 93 8 0 28 Nov 2023
RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3D Lingteng Qiu Guanying Chen Xiaodong Gu Qi Zuo Mutian Xu Yushuang Wu Weihao Yuan Zilong Dong Liefeng Bo Xiaoguang Han 96 123 0 28 Nov 2023
A Unified Approach for Text- and Image-guided 4D Scene Generation Yufeng Zheng Xueting Li Koki Nagano Sifei Liu Karsten Kreis Otmar Hilliges Shalini De Mello 133 49 0 28 Nov 2023
DreamPropeller: Supercharge Text-to-3D Generation with Parallel Sampling Linqi Zhou Andy Shih Minh-Tuan Tran Dinh Q. Phung DiffM 111 14 0 28 Nov 2023
Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusion Yuanxun Lu Jingyang Zhang Shiwei Li Tian Fang David McKinnon Yanghai Tsin Long Quan Xun Cao Yao Yao 91 37 0 27 Nov 2023
SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion Hsuan-I Ho Mingli Song Otmar Hilliges DiffM 91 36 0 27 Nov 2023
ET3D: Efficient Text-to-3D Generation via Multi-View Distillation Yiming Chen Zhiqi Li Peidong Liu 85 6 0 27 Nov 2023
Animate124: Animating One Image to 4D Dynamic Scene Yuyang Zhao Zhiwen Yan Enze Xie Lanqing Hong Zhenguo Li Gim Hee Lee VGen 115 66 0 24 Nov 2023
MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation Zhiqi Li Yiming Chen Lingzhe Zhao Peidong Liu 106 8 0 24 Nov 2023
GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence Van Nguyen Nguyen Thibault Groueix Mathieu Salzmann Vincent Lepetit 3DPC 3DH 128 59 0 23 Nov 2023
Posterior Distillation Sampling Juil Koo Chanho Park Minhyuk Sung DiffM 127 30 0 23 Nov 2023
WildFusion: Learning 3D-Aware Latent Diffusion Models in View Space Katja Schwarz Seung Wook Kim Jun Gao Sanja Fidler Andreas Geiger Karsten Kreis 111 6 0 22 Nov 2023
Applications of Large Scale Foundation Models for Autonomous Driving Yu Huang Yue Chen Zhu Li ELM AI4CE LRM ALM LM&Ro 220 16 0 20 Nov 2023