Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 454 papers shown

Title
Noise-Free Score Distillation Oren Katzir Or Patashnik Daniel Cohen-Or Dani Lischinski DiffM 21 70 0 26 Oct 2023
HyperFields: Towards Zero-Shot Generation of NeRFs from Text Sudarshan Babu Richard Liu Avery Zhou Michael Maire Greg Shakhnarovich Rana Hanocka AI4CE 32 11 0 26 Oct 2023
DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior Jingxiang Sun Bo Zhang Ruizhi Shao Lizhen Wang Wen Liu Zhenda Xie Yebin Liu 51 132 0 25 Oct 2023
Wonder3D: Single Image to 3D using Cross-Domain Diffusion Xiaoxiao Long Yuanchen Guo Cheng Lin Yuan Liu Zhiyang Dou ... Yuexin Ma Song-Hai Zhang Marc Habermann Christian Theobalt Wenping Wang 45 409 0 23 Oct 2023
MAS: Multi-view Ancestral Sampling for 3D motion generation using 2D diffusion Roy Kapon Guy Tevet Daniel Cohen-Or Amit H. Bermano DiffM 39 19 0 23 Oct 2023
TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models Tianshi Cao Karsten Kreis Sanja Fidler Nicholas Sharp Kangxue Yin 38 74 0 20 Oct 2023
Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts Xinhua Cheng Tianyu Yang Jianan Wang Yu Li Lei Zhang Jian Zhang Li-ming Yuan DiffM 31 43 0 18 Oct 2023
GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models Taoran Yi Jiemin Fang Junjie Wang Guanjun Wu Lingxi Xie Xiaopeng Zhang Wenyu Liu Qi Tian Xinggang Wang 3DGS 46 128 0 12 Oct 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 38 103 0 11 Oct 2023
HiFi-123: Towards High-fidelity One Image to 3D Content Generation Wangbo Yu Li-ming Yuan Yan-Pei Cao Xiangjun Gao Xiaoyu Li Wenbo Hu Long Quan Ying Shan Yonghong Tian DiffM 42 29 0 10 Oct 2023
Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraints Chuan Fang Yuan Dong Kunming Luo Xiaotao Hu Rakesh Shrestha Ping Tan DiffM 36 35 0 05 Oct 2023
T $^3$ Bench: Benchmarking Current Progress in Text-to-3D Generation Yuze He Yushi Bai Matthieu Lin Wang Zhao Yubin Hu Jenny Sheng Ran Yi Juanzi Li Yong Liu 44 31 0 04 Oct 2023
SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D Weiyu Li Rui Chen Xuelin Chen Ping Tan 18 115 0 04 Oct 2023
AI-Generated Images as Data Source: The Dawn of Synthetic Era Zuhao Yang Fangneng Zhan Kunhao Liu Muyu Xu Shijian Lu EGVM 36 18 0 03 Oct 2023
DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation Jiaxiang Tang Jiawei Ren Hang Zhou Ziwei Liu Gang Zeng 3DGS 62 595 0 28 Sep 2023
Text-to-3D using Gaussian Splatting Manish Sharma Moitreya Chatterjee Yikai Wang Huaping Liu 3DGS 39 229 0 28 Sep 2023
Progressive Text-to-3D Generation for Automatic 3D Prototyping Han Yi Zhedong Zheng Xiangyu Xu Tat-Seng Chua 45 9 0 26 Sep 2023
Generative Escher Meshes Noam Aigerman Thibault Groueix DiffM 37 4 0 25 Sep 2023
DreamLLM: Synergistic Multimodal Comprehension and Creation Runpei Dong Chunrui Han Yuang Peng Zekun Qi Zheng Ge ... Hao-Ran Wei Xiangwen Kong Xiangyu Zhang Kaisheng Ma Li Yi MLLM 50 176 0 20 Sep 2023
Viewpoint Textual Inversion: Unleashing Novel View Synthesis with Pretrained 2D Diffusion Models James Burgess Kuan-Chieh Wang Serena Yeung-Levy DiffM 46 6 0 14 Sep 2023
Text-Guided Generation and Editing of Compositional 3D Avatars Hao Zhang Yao Feng Peter Kulits Yandong Wen Justus Thies Michael J. Black 33 32 0 13 Sep 2023
Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clips Yufei Ye Poorvi Hebbar Abhinav Gupta Shubham Tulsiani DiffM 50 42 0 11 Sep 2023
Chasing Consistency in Text-to-3D Generation from a Single Image Yichen Ouyang Wenhao Chai Jiayi Ye Dapeng Tao Yibing Zhan Gaoang Wang DiffM 27 15 0 07 Sep 2023
SyncDreamer: Generating Multiview-consistent Images from a Single-view Image Yuan Liu Chu-Hsing Lin Zijiao Zeng Xiaoxiao Long Lingjie Liu Taku Komura Wenping Wang DiffM 52 416 0 07 Sep 2023
MVDream: Multi-view Diffusion for 3D Generation Yichun Shi Peng Wang Jianglong Ye Mai Long Kejie Li Xiaohu Yang 27 590 0 31 Aug 2023
Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views Zi-Xin Zou Weihao Cheng Yan-Pei Cao Shi-Sheng Huang Ying Shan Songiie Zhang DiffM 38 23 0 27 Aug 2023
IT3D: Improved Text-to-3D Generation with Explicit View Synthesis Yiwen Chen Chi Zhang Xiaofeng Yang Zhongang Cai Gang Yu Lei Yang Guo-Shing Lin DiffM 37 62 0 22 Aug 2023
Guide3D: Create 3D Avatars from Text and Image Guidance Yukang Cao Yan-Pei Cao Kai Han Ying Shan Kwan-Yee K. Wong DiffM 43 10 0 18 Aug 2023
O $^2$ -Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Model Yubin Hu Sheng Ye Wang Zhao Matthieu Lin Yuze He Yu-Hui Wen Ying He Yong Liu DiffM 35 4 0 18 Aug 2023
TeCH: Text-guided Reconstruction of Lifelike Clothed Humans Yangyi Huang Hongwei Yi Yuliang Xiu Tingting Liao Jiaxiang Tang Deng Cai Justus Thies DiffM 63 81 0 16 Aug 2023
VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representation Zekun Qi Muzhou Yu Runpei Dong Kaisheng Ma 3DPC 26 11 0 28 Jul 2023
Points-to-3D: Bridging the Gap between Sparse Points and Shape-Controllable Text-to-3D Generation Chaohui Yu Qiang-feng Zhou Jingliang Li Zhe Zhang Zhibin Wang Fan Wang DiffM 30 38 0 26 Jul 2023
TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition Shilin Lu Yanzhu Liu A. Kong 43 93 0 24 Jul 2023
OBJECT 3DIT: Language-guided 3D-aware Image Editing Oscar Michel Anand Bhattad Eli VanderBilt Ranjay Krishna Aniruddha Kembhavi Tanmay Gupta DiffM 37 38 0 20 Jul 2023
Objaverse-XL: A Universe of 10M+ 3D Objects Matt Deitke Ruoshi Liu Matthew Wallingford Huong Ngo Oscar Michel ... Carl Vondrick Georgia Gkioxari Kiana Ehsani Ludwig Schmidt Ali Farhadi 36 386 0 11 Jul 2023
Efficient 3D Articulated Human Generation with Layered Surface Volumes Yinghao Xu Wang Yifan Alexander W. Bergman Menglei Chai Bolei Zhou Gordon Wetzstein 3DV 3DH 42 9 0 11 Jul 2023
Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models Alexander W. Bergman Wang Yifan Gordon Wetzstein DiffM 40 6 0 10 Jul 2023
Enhancing Adversarial Robustness via Score-Based Optimization Boya Zhang Weijian Luo Zhihua Zhang DiffM 34 13 0 10 Jul 2023
Blocks2World: Controlling Realistic Scenes with Editable Primitives Vaibhav Vavilala Seemandhar Jain R. Vasanth Anand Bhattad David A. Forsyth VGen 35 4 0 07 Jul 2023
Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors Guocheng Qian Jinjie Mai Abdullah Hamdi Jian Ren Aliaksandr Siarohin ... Hsin-Ying Lee Ivan Skorokhodov Peter Wonka Sergey Tulyakov Guohao Li DiffM 38 355 0 30 Jun 2023
FlipNeRF: Flipped Reflection Rays for Few-shot Novel View Synthesis Seunghyeon Seo Yeonjin Chang Nojun Kwak 23 27 0 30 Jun 2023
One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization Minghua Liu Chao Xu Haian Jin Ling-Hao Chen T. MukundVarma Zexiang Xu Hao Su 45 443 0 29 Jun 2023
DreamEditor: Text-Driven 3D Scene Editing with Neural Fields Jingyu Zhuang Chen Wang Lingjie Liu Liang Lin Guanbin Li DiffM 13 129 0 23 Jun 2023
Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields Ori Gordon Omri Avrahami Dani Lischinski DiffM 37 22 0 22 Jun 2023
DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation Yukun Huang Jianan Wang Yukai Shi Zhengjun Zha Xianbiao Qi Lei Zhang 51 63 0 21 Jun 2023
AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation Yifei Zeng Yuanxun Lu Xinya Ji Yao Yao Hao Zhu Xun Cao DiffM 45 29 0 16 Jun 2023
R2-Diff: Denoising by diffusion as a refinement of retrieved motion for image-based motion prediction Takeru Oba Norimichi Ukita DiffM 40 1 0 15 Jun 2023
Generative Proxemics: A Prior for 3D Social Interaction from Images Lea Müller Vickie Ye Georgios Pavlakos Michael J. Black Angjoo Kanazawa DiffM 41 29 0 15 Jun 2023
Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data Stanislaw Szymanowicz Christian Rupprecht Andrea Vedaldi 44 99 0 13 Jun 2023
Beyond Surface Statistics: Scene Representations in a Latent Diffusion Model Yida Chen Fernanda Viégas Martin Wattenberg DiffM 14 22 0 09 Jun 2023