Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 454 papers shown

Title
ATT3D: Amortized Text-to-3D Object Synthesis Jonathan Lorraine Kevin Xie Fangyin Wei Chen-Hsuan Lin Towaki Takikawa Nicholas Sharp Nayeon Lee Xuan Li Sanja Fidler James Lucas DiffM 33 86 0 06 Jun 2023
Towards Visual Foundational Models of Physical Scenes Chethan Parameshwara Alessandro Achille Matthew Trager Xiaolong Li Jiawei Mo ... A. Swaminathan C. Taylor D. Venkatraman Xiaohan Fei Stefano Soatto DiffM 38 4 0 06 Jun 2023
HeadSculpt: Crafting 3D Head Avatars with Text Xiaoping Han Yukang Cao Kai Han Xiatian Zhu Jiankang Deng Yi-Zhe Song Tao Xiang Kwan-Yee K. Wong DiffM 27 46 0 05 Jun 2023
Efficient Text-Guided 3D-Aware Portrait Generation with Score Distillation Sampling on Distribution Yiji Cheng Fei Yin Xiaoke Huang Xintong Yu Jiaxiang Liu Shi Feng Yujiu Yang Yansong Tang DiffM 34 4 0 03 Jun 2023
Control4D: Efficient 4D Portrait Editing with Text Ruizhi Shao Jingxiang Sun Cheng Peng Zerong Zheng Boyao Zhou Hongwen Zhang Yebin Liu DiffM 37 23 0 31 May 2023
HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance Junzhe Zhu Peiye Zhuang Oluwasanmi Koyejo DiffM 29 73 0 30 May 2023
ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Image Zhenzhen Weng Zeyu Wang S. Yeung DiffM 33 20 0 25 May 2023
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation Zhengyi Wang Cheng Lu Yikai Wang Fan Bao Chongxuan Li Hang Su Jun Zhu DiffM 88 821 0 25 May 2023
Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedback Yiqi Lin Hao Wu Ruichen Wang H. Lu Xiaodong Lin Hui Xiong Lin Wang 3DV 48 12 0 25 May 2023
Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shape Rundi Wu Ruoshi Liu Carl Vondrick Changxi Zheng DiffM 29 24 0 24 May 2023
Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction Xinhang Liu Jiaben Chen Shiu-hong Kao Yu-Wing Tai Chi-Keung Tang DiffM 42 15 0 24 May 2023
Vision + Language Applications: A Survey Yutong Zhou N. Shimada VLM 35 6 0 24 May 2023
DirecT2V: Large Language Models are Frame-Level Directors for Zero-Shot Text-to-Video Generation Susung Hong Junyoung Seo Heeseong Shin Sung‐Jin Hong Seung Wook Kim DiffM VGen 31 34 0 23 May 2023
Text-guided 3D Human Generation from 2D Collections Tsu-Jui Fu Wenhan Xiong Yixin Nie Jingyu Liu Barlas Ouguz William Yang Wang 47 1 0 23 May 2023
DreamWaltz: Make a Scene with Complex 3D Animatable Avatars Yukun Huang Jianan Wang Ailing Zeng He Cao Xianbiao Qi Yukai Shi Zhengjun Zha Lei Zhang 34 70 0 21 May 2023
Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models Byungjun Kim Patrick Kwon K. Lee Myunggi Lee Sookwan Han Daesik Kim Hanbyul Joo DiffM 48 20 0 19 May 2023
Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields Jingbo Zhang Xiaoyu Li Bo Liu Can Wang Jing Liao VGen DiffM 24 85 0 19 May 2023
RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture Liangchen Song Liangliang Cao Hongyu Xu Kai Kang Feng Tang Junsong Yuan Yang Zhao VGen DiffM 34 44 0 18 May 2023
Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era Chenghao Li Chaoning Zhang Atish Waghwase Lik-Hang Lee François Rameau Yang Yang Sung-Ho Bae Choong Seon Hong 54 75 0 10 May 2023
Shap-E: Generating Conditional 3D Implicit Functions Heewoo Jun Alex Nichol DiffM 209 311 0 03 May 2023
TextDeformer: Geometry Manipulation using Text Guidance William Gao Noam Aigerman Thibault Groueix Vladimir G. Kim Rana Hanocka AI4CE 27 82 0 26 Apr 2023
Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFs Frederik Warburg Ethan Weber Matthew Tancik Aleksander Holynski Angjoo Kanazawa DiffM 40 55 0 20 Apr 2023
Anything-3D: Towards Single-view Anything Reconstruction in the Wild Qiuhong Shen Xingyi Yang Xinchao Wang DiffM 24 85 0 19 Apr 2023
Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Images Jiatao Gu Qingzhe Gao Shuangfei Zhai Baoquan Chen Lingjie Liu J. Susskind 46 29 0 13 Apr 2023
Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond Mohammadreza Armandpour A. Sadeghian Huangjie Zheng Amir Sadeghian Mingyuan Zhou DiffM 18 123 0 11 Apr 2023
A Comprehensive Survey on Knowledge Distillation of Diffusion Models Weijian Luo DiffM MedIm 57 33 0 09 Apr 2023
3D-aware Image Generation using 2D Diffusion Models Jianfeng Xiang Jiaolong Yang Binbin Huang Xin Tong DiffM 56 65 0 31 Mar 2023
Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversion Hiromichi Kamata Yuiko Sakuma Akio Hayakawa Masato Ishii T. Narihira DiffM 37 37 0 28 Mar 2023
Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generation Susung Hong Donghoon Ahn Seungryong Kim DiffM 33 23 0 27 Mar 2023
Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior Junshu Tang Tengfei Wang Bo Zhang Ting Zhang Ran Yi Lizhuang Ma Dong Chen DiffM 192 309 0 24 Mar 2023
CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout Haotian Bai Yiqi Lin Hui Xiong Sijia Li H. Lu Xiaodong Lin Lin Wang DiffM 45 42 0 24 Mar 2023
DreamBooth3D: Subject-Driven Text-to-3D Generation Amit Raj S. Kaza Ben Poole Michael Niemeyer Nataniel Ruiz ... Kfir Aberman Michael Rubinstein Jonathan T. Barron Yuanzhen Li Varun Jampani DiffM 24 220 0 23 Mar 2023
Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenes Dana Cohen-Bar Elad Richardson G. Metzer Raja Giryes Daniel Cohen-Or 79 54 0 23 Mar 2023
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions Ayaan Haque Matthew Tancik Alexei A. Efros Aleksander Holynski Angjoo Kanazawa VGen DiffM 56 361 0 22 Mar 2023
Compositional 3D Scene Generation using Locally Conditioned Diffusion Ryan Po Gordon Wetzstein DiffM 29 85 0 21 Mar 2023
Vox-E: Text-guided Voxel Editing of 3D Objects Etai Sella Gal Fiebelman Peter Hedman Hadar Averbuch-Elor DiffM 36 74 0 21 Mar 2023
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models Lukas Höllein Ang Cao Andrew Owens Justin Johnson Matthias Nießner DiffM 38 179 0 21 Mar 2023
Zero-1-to-3: Zero-shot One Image to 3D Object Ruoshi Liu Rundi Wu Basile Van Hoorick P. Tokmakov Sergey Zakharov Carl Vondrick DiffM 29 1,051 0 20 Mar 2023
SKED: Sketch-guided Text-based 3D Editing Aryan Mikaeili Or Perel Mehdi Safaee Daniel Cohen-Or Ali Mahdavi-Amiri DiffM 41 66 0 19 Mar 2023
Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation Junyoung Seo Wooseok Jang Minseop Kwak Ines Hyeonsu Kim Jaehoon Ko Junho Kim Jin-Hwa Kim Jiyoung Lee Seung Wook Kim DiffM 46 136 0 14 Mar 2023
To the Noise and Back: Diffusion for Shared Autonomy Takuma Yoneda Luzhe Sun Ge Yang Bradly C. Stadie Matthew R. Walter DiffM 32 27 0 23 Feb 2023
NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion Jiatao Gu Alex Trevithick Kai-En Lin J. Susskind Christian Theobalt Lingjie Liu R. Ramamoorthi DiffM VGen 51 170 0 20 Feb 2023
Text-driven Visual Synthesis with Latent Diffusion Prior Tingbo Liao Songwei Ge Yiran Xu Yao-Chih Lee Badour Albahar Jia-Bin Huang DiffM 32 6 0 16 Feb 2023
Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models Jiale Xu Xintao Wang Weihao Cheng Yan-Pei Cao Ying Shan Xiaohu Qie Shenghua Gao 188 161 0 28 Dec 2022
LoopDraw: a Loop-Based Autoregressive Model for Shape Synthesis and Editing Nam Anh Dinh Haochen Wang G. Shakhnarovich Rana Hanocka 21 2 0 09 Dec 2022
SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction Zhizhuo Zhou Shubham Tulsiani DiffM 43 210 0 01 Dec 2022
ReLU Fields: The Little Non-linearity That Could Animesh Karnewar Tobias Ritschel Oliver Wang Niloy J. Mitra 133 100 0 22 May 2022
AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars Fangzhou Hong Mingyuan Zhang Liang Pan Zhongang Cai Lei Yang Ziwei Liu CLIP 98 79 0 17 May 2022
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 226 353 0 06 Dec 2021
Label-Efficient Semantic Segmentation with Diffusion Models Dmitry Baranchuk Ivan Rubachev A. Voynov Valentin Khrulkov Artem Babenko DiffM VLM 195 521 0 06 Dec 2021