Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv (abs)PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 459 papers shown

Title
GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noise Xinhai Li Huaibin Wang Kuo-Kun Tseng 3DGS 131 29 0 19 Nov 2023
MetaDreamer: Efficient Text-to-3D Creation With Disentangling Geometry and Texture Lincong Feng Muyu Wang Maoyu Wang Kuo Xu Xiaoli Liu 58 4 0 16 Nov 2023
3D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillation Dale Decatur Itai Lang Kfir Aberman Rana Hanocka 91 17 0 16 Nov 2023
Single-Image 3D Human Digitization with Shape-Guided Diffusion Badour Albahar Shunsuke Saito Hung-Yu Tseng Changil Kim Johannes Kopf Jia-Bin Huang DiffM 94 33 0 15 Nov 2023
DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model Yinghao Xu Hao Tan Fujun Luan Sai Bi Peng Wang ... Zifan Shi Kalyan Sunkavalli Gordon Wetzstein Zexiang Xu Kai Zhang 123 167 0 15 Nov 2023
Instant3D: Instant Text-to-3D Generation Ming Li Pan Zhou Jia-Wei Liu Jussi Keppo Min Lin Shuicheng Yan Xiangyu Xu 157 34 0 14 Nov 2023
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion Minghua Liu Ruoxi Shi Linghao Chen Zhuoyang Zhang Chao Xu Xinyue Wei Hansheng Chen Chong Zeng Jiayuan Gu Hao Su 149 207 0 14 Nov 2023
Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model Jiahao Li Hao Tan Kai Zhang Zexiang Xu Fujun Luan Yinghao Xu Yicong Hong Kalyan Sunkavalli Greg Shakhnarovich Sai Bi 168 274 0 10 Nov 2023
Consistent4D: Consistent 360° Dynamic Object Generation from Monocular Video Yanqin Jiang Li Zhang Jin Gao Weiming Hu Yao Yao VGen 96 63 0 06 Nov 2023
Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture Yixin Chen Junfeng Ni Nan Jiang Yaowei Zhang Yixin Zhu Siyuan Huang 3DV 106 23 0 01 Nov 2023
Text-to-3D with Classifier Score Distillation Xin Yu Yuanchen Guo Yangguang Li Ding Liang Song-Hai Zhang Xiaojuan Qi DiffM 132 87 0 30 Oct 2023
Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models Pushkal Katara Zhou Xian Katerina Fragkiadaki LM&Ro 142 44 0 27 Oct 2023
ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image Kyle Sargent Zizhang Li Tanmay Shah Charles Herrmann Hong-Xing Yu ... Eric Ryan Chan Dmitry Lagun Fei-Fei Li Deqing Sun Jiajun Wu DiffM VGen 127 43 0 27 Oct 2023
Noise-Free Score Distillation Oren Katzir Or Patashnik Daniel Cohen-Or Dani Lischinski DiffM 131 71 0 26 Oct 2023
HyperFields: Towards Zero-Shot Generation of NeRFs from Text Sudarshan Babu Richard Liu Avery Zhou Michael Maire Greg Shakhnarovich Rana Hanocka AI4CE 111 11 0 26 Oct 2023
DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior Jingxiang Sun Bo Zhang Ruizhi Shao Lizhen Wang Wen Liu Zhenda Xie Yebin Liu 113 137 0 25 Oct 2023
Wonder3D: Single Image to 3D using Cross-Domain Diffusion Xiaoxiao Long Yuanchen Guo Cheng Lin Yuan Liu Zhiyang Dou ... Yuexin Ma Song-Hai Zhang Marc Habermann Christian Theobalt Wenping Wang 175 441 0 23 Oct 2023
MAS: Multi-view Ancestral Sampling for 3D motion generation using 2D diffusion Roy Kapon Guy Tevet Daniel Cohen-Or Amit H. Bermano DiffM 104 21 0 23 Oct 2023
TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models Tianshi Cao Karsten Kreis Sanja Fidler Nicholas Sharp Kangxue Yin 94 79 0 20 Oct 2023
Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts Xinhua Cheng Tianyu Yang Jianan Wang Yu Li Lei Zhang Jian Zhang Li-ming Yuan DiffM 98 43 0 18 Oct 2023
GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models Taoran Yi Jiemin Fang Junjie Wang Guanjun Wu Lingxi Xie Xiaopeng Zhang Wenyu Liu Qi Tian Xinggang Wang 3DGS 146 143 0 12 Oct 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 138 111 0 11 Oct 2023
HiFi-123: Towards High-fidelity One Image to 3D Content Generation Wangbo Yu Li-ming Yuan Yan-Pei Cao Xiangjun Gao Xiaoyu Li Wenbo Hu Long Quan Ying Shan Yonghong Tian DiffM 98 31 0 10 Oct 2023
Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraints Chuan Fang Yuan Dong Kunming Luo Xiaotao Hu Rakesh Shrestha Ping Tan DiffM 162 37 0 05 Oct 2023
T $^3$ Bench: Benchmarking Current Progress in Text-to-3D Generation Yuze He Yushi Bai Matthieu Lin Wang Zhao Yubin Hu Jenny Sheng Ran Yi Juanzi Li Yong Liu 141 33 0 04 Oct 2023
SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D Weiyu Li Rui Chen Xuelin Chen Ping Tan 104 120 0 04 Oct 2023
AI-Generated Images as Data Source: The Dawn of Synthetic Era Zuhao Yang Fangneng Zhan Kunhao Liu Muyu Xu Shijian Lu EGVM 122 20 0 03 Oct 2023
DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation Jiaxiang Tang Jiawei Ren Hang Zhou Ziwei Liu Gang Zeng 3DGS 219 633 0 28 Sep 2023
Text-to-3D using Gaussian Splatting Manish Sharma Moitreya Chatterjee Yikai Wang Huaping Liu 3DGS 133 244 0 28 Sep 2023
Progressive Text-to-3D Generation for Automatic 3D Prototyping Han Yi Zhedong Zheng Xiangyu Xu Tat-Seng Chua 108 9 0 26 Sep 2023
Generative Escher Meshes Noam Aigerman Thibault Groueix DiffM 87 4 0 25 Sep 2023
DreamLLM: Synergistic Multimodal Comprehension and Creation Runpei Dong Chunrui Han Yuang Peng Zekun Qi Zheng Ge ... Hao-Ran Wei Xiangwen Kong Xiangyu Zhang Kaisheng Ma Li Yi MLLM 120 199 0 20 Sep 2023
Viewpoint Textual Inversion: Unleashing Novel View Synthesis with Pretrained 2D Diffusion Models James Burgess Kuan-Chieh Wang Serena Yeung-Levy DiffM 83 6 0 14 Sep 2023
Text-Guided Generation and Editing of Compositional 3D Avatars Hao Zhang Yao Feng Peter Kulits Yandong Wen Justus Thies Michael J. Black 78 33 0 13 Sep 2023
Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clips Yufei Ye Poorvi Hebbar Abhinav Gupta Shubham Tulsiani DiffM 107 46 0 11 Sep 2023
Chasing Consistency in Text-to-3D Generation from a Single Image Yichen Ouyang Wenhao Chai Jiayi Ye Dapeng Tao Yibing Zhan Gaoang Wang DiffM 87 15 0 07 Sep 2023
SyncDreamer: Generating Multiview-consistent Images from a Single-view Image Yuan Liu Chu-Hsing Lin Zijiao Zeng Xiaoxiao Long Lingjie Liu Taku Komura Wenping Wang DiffM 132 444 0 07 Sep 2023
MVDream: Multi-view Diffusion for 3D Generation Yichun Shi Peng Wang Jianglong Ye Mai Long Kejie Li Xiaohu Yang 119 631 0 31 Aug 2023
Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views Zi-Xin Zou Weihao Cheng Yan-Pei Cao Shi-Sheng Huang Ying Shan Songiie Zhang DiffM 111 23 0 27 Aug 2023
IT3D: Improved Text-to-3D Generation with Explicit View Synthesis Yiwen Chen Chi Zhang Xiaofeng Yang Zhongang Cai Gang Yu Lei Yang Guo-Shing Lin DiffM 103 64 0 22 Aug 2023
Guide3D: Create 3D Avatars from Text and Image Guidance Yukang Cao Yan-Pei Cao Kai Han Ying Shan Kwan-Yee K. Wong DiffM 79 10 0 18 Aug 2023
O $^2$ -Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Model Yubin Hu Sheng Ye Wang Zhao Matthieu Lin Yuze He Yu-Hui Wen Ying He Yang Liu DiffM 94 4 0 18 Aug 2023
TeCH: Text-guided Reconstruction of Lifelike Clothed Humans Yangyi Huang Hongwei Yi Yuliang Xiu Tingting Liao Jiaxiang Tang Deng Cai Justus Thies DiffM 132 86 0 16 Aug 2023
VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representation Zekun Qi Muzhou Yu Runpei Dong Kaisheng Ma 3DPC 84 15 0 28 Jul 2023
Points-to-3D: Bridging the Gap between Sparse Points and Shape-Controllable Text-to-3D Generation Chaohui Yu Qiang-feng Zhou Jingliang Li Zhe Zhang Zhibin Wang Fan Wang DiffM 99 41 0 26 Jul 2023
TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition Shilin Lu Yanzhu Liu A. Kong 174 102 0 24 Jul 2023
OBJECT 3DIT: Language-guided 3D-aware Image Editing Oscar Michel Anand Bhattad Eli VanderBilt Ranjay Krishna Aniruddha Kembhavi Tanmay Gupta DiffM 102 38 0 20 Jul 2023
Objaverse-XL: A Universe of 10M+ 3D Objects Matt Deitke Ruoshi Liu Matthew Wallingford Huong Ngo Oscar Michel ... Carl Vondrick Georgia Gkioxari Kiana Ehsani Ludwig Schmidt Ali Farhadi 125 423 0 11 Jul 2023
Efficient 3D Articulated Human Generation with Layered Surface Volumes Yinghao Xu Wang Yifan Alexander W. Bergman Menglei Chai Bolei Zhou Gordon Wetzstein 3DV 3DH 80 9 0 11 Jul 2023
Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models Alexander W. Bergman Wang Yifan Gordon Wetzstein DiffM 77 6 0 10 Jul 2023