Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv (abs)PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 459 papers shown

Title
Enhancing Adversarial Robustness via Score-Based Optimization Boya Zhang Weijian Luo Zhihua Zhang DiffM 90 14 0 10 Jul 2023
Blocks2World: Controlling Realistic Scenes with Editable Primitives Vaibhav Vavilala Seemandhar Jain R. Vasanth Anand Bhattad David A. Forsyth VGen 89 4 0 07 Jul 2023
Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors Guocheng Qian Jinjie Mai Abdullah Hamdi Jian Ren Aliaksandr Siarohin ... Hsin-Ying Lee Ivan Skorokhodov Peter Wonka Sergey Tulyakov Guohao Li DiffM 186 365 0 30 Jun 2023
FlipNeRF: Flipped Reflection Rays for Few-shot Novel View Synthesis Seunghyeon Seo Yeonjin Chang Nojun Kwak 76 28 0 30 Jun 2023
One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization Minghua Liu Chao Xu Haian Jin Ling-Hao Chen T. MukundVarma Zexiang Xu Hao Su 155 469 0 29 Jun 2023
DreamEditor: Text-Driven 3D Scene Editing with Neural Fields Jingyu Zhuang Chen Wang Lingjie Liu Liang Lin Guanbin Li DiffM 90 130 0 23 Jun 2023
Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields Ori Gordon Omri Avrahami Dani Lischinski DiffM 80 22 0 22 Jun 2023
DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation Yukun Huang Jianan Wang Yukai Shi Zhengjun Zha Xianbiao Qi Lei Zhang 117 64 0 21 Jun 2023
AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation Yifei Zeng Yuanxun Lu Xinya Ji Yao Yao Hao Zhu Xun Cao DiffM 84 30 0 16 Jun 2023
R2-Diff: Denoising by diffusion as a refinement of retrieved motion for image-based motion prediction Takeru Oba Norimichi Ukita DiffM 88 2 0 15 Jun 2023
Generative Proxemics: A Prior for 3D Social Interaction from Images Lea Müller Vickie Ye Georgios Pavlakos Michael J. Black Angjoo Kanazawa DiffM 92 30 0 15 Jun 2023
Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data Stanislaw Szymanowicz Christian Rupprecht Andrea Vedaldi 112 104 0 13 Jun 2023
Beyond Surface Statistics: Scene Representations in a Latent Diffusion Model Yida Chen Fernanda Viégas Martin Wattenberg DiffM 79 24 0 09 Jun 2023
ATT3D: Amortized Text-to-3D Object Synthesis Jonathan Lorraine Kevin Xie Fangyin Wei Chen-Hsuan Lin Towaki Takikawa Nicholas Sharp Nayeon Lee Xuan Li Sanja Fidler James Lucas DiffM 106 89 0 06 Jun 2023
Towards Visual Foundational Models of Physical Scenes Chethan Parameshwara Alessandro Achille Matthew Trager Xiaolong Li Jiawei Mo ... A. Swaminathan C. Taylor D. Venkatraman Xiaohan Fei Stefano Soatto DiffM 67 4 0 06 Jun 2023
HeadSculpt: Crafting 3D Head Avatars with Text Xiaoping Han Yukang Cao Kai Han Xiatian Zhu Jiankang Deng Yi-Zhe Song Tao Xiang Kwan-Yee K. Wong DiffM 73 47 0 05 Jun 2023
Efficient Text-Guided 3D-Aware Portrait Generation with Score Distillation Sampling on Distribution Yiji Cheng Fei Yin Xiaoke Huang Xintong Yu Jiaxiang Liu Shi Feng Yujiu Yang Yansong Tang DiffM 78 5 0 03 Jun 2023
Control4D: Efficient 4D Portrait Editing with Text Ruizhi Shao Jingxiang Sun Cheng Peng Zerong Zheng Boyao Zhou Hongwen Zhang Yebin Liu DiffM 124 25 0 31 May 2023
HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance Junzhe Zhu Peiye Zhuang Oluwasanmi Koyejo DiffM 106 79 0 30 May 2023
ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Image Zhenzhen Weng Zeyu Wang S. Yeung DiffM 58 21 0 25 May 2023
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation Zhengyi Wang Cheng Lu Yikai Wang Fan Bao Chongxuan Li Hang Su Jun Zhu DiffM 184 876 0 25 May 2023
Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedback Yiqi Lin Hao Wu Ruichen Wang H. Lu Xiaodong Lin Hui Xiong Lin Wang 3DV 86 13 0 25 May 2023
Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shape Rundi Wu Ruoshi Liu Carl Vondrick Changxi Zheng DiffM 132 25 0 24 May 2023
Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction Xinhang Liu Jiaben Chen Shiu-hong Kao Yu-Wing Tai Chi-Keung Tang DiffM 79 15 0 24 May 2023
Vision + Language Applications: A Survey Yutong Zhou N. Shimada VLM 127 7 0 24 May 2023
DirecT2V: Large Language Models are Frame-Level Directors for Zero-Shot Text-to-Video Generation Susung Hong Junyoung Seo Heeseong Shin Sung‐Jin Hong Seung Wook Kim DiffM VGen 106 36 0 23 May 2023
Text-guided 3D Human Generation from 2D Collections Tsu-Jui Fu Wenhan Xiong Yixin Nie Jingyu Liu Barlas Ouguz William Yang Wang 96 2 0 23 May 2023
DreamWaltz: Make a Scene with Complex 3D Animatable Avatars Yukun Huang Jianan Wang Ailing Zeng He Cao Xianbiao Qi Yukai Shi Zhengjun Zha Lei Zhang 101 73 0 21 May 2023
Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models Byungjun Kim Patrick Kwon K. Lee Myunggi Lee Sookwan Han Daesik Kim Hanbyul Joo DiffM 106 20 0 19 May 2023
Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields Jingbo Zhang Xiaoyu Li Bo Liu Can Wang Jing Liao VGen DiffM 97 89 0 19 May 2023
RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture Liangchen Song Liangliang Cao Hongyu Xu Kai Kang Feng Tang Junsong Yuan Yang Zhao VGen DiffM 93 44 0 18 May 2023
Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era Chenghao Li Chaoning Zhang Atish Waghwase Lik-Hang Lee François Rameau Yang Yang Sung-Ho Bae Choong Seon Hong 104 78 0 10 May 2023
Shap-E: Generating Conditional 3D Implicit Functions Heewoo Jun Alex Nichol DiffM 315 322 0 03 May 2023
TextDeformer: Geometry Manipulation using Text Guidance William Gao Noam Aigerman Thibault Groueix Vladimir G. Kim Rana Hanocka AI4CE 118 86 0 26 Apr 2023
Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFs Frederik Warburg Ethan Weber Matthew Tancik Aleksander Holynski Angjoo Kanazawa DiffM 132 59 0 20 Apr 2023
Anything-3D: Towards Single-view Anything Reconstruction in the Wild Qiuhong Shen Xingyi Yang Xinchao Wang DiffM 82 88 0 19 Apr 2023
Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Images Jiatao Gu Qingzhe Gao Shuangfei Zhai Baoquan Chen Lingjie Liu J. Susskind 119 29 0 13 Apr 2023
Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond Mohammadreza Armandpour A. Sadeghian Huangjie Zheng Amir Sadeghian Mingyuan Zhou DiffM 99 128 0 11 Apr 2023
A Comprehensive Survey on Knowledge Distillation of Diffusion Models Weijian Luo DiffM MedIm 110 38 0 09 Apr 2023
3D-aware Image Generation using 2D Diffusion Models Jianfeng Xiang Jiaolong Yang Binbin Huang Xin Tong DiffM 99 67 0 31 Mar 2023
Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversion Hiromichi Kamata Yuiko Sakuma Akio Hayakawa Masato Ishii T. Narihira DiffM 92 40 0 28 Mar 2023
Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generation Susung Hong Donghoon Ahn Seungryong Kim DiffM 89 25 0 27 Mar 2023
Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior Junshu Tang Tengfei Wang Bo Zhang Ting Zhang Ran Yi Lizhuang Ma Dong Chen DiffM 311 317 0 24 Mar 2023
CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout Haotian Bai Yiqi Lin Hui Xiong Sijia Li H. Lu Xiaodong Lin Lin Wang DiffM 92 45 0 24 Mar 2023
DreamBooth3D: Subject-Driven Text-to-3D Generation Amit Raj S. Kaza Ben Poole Michael Niemeyer Nataniel Ruiz ... Kfir Aberman Michael Rubinstein Jonathan T. Barron Yuanzhen Li Varun Jampani DiffM 148 229 0 23 Mar 2023
Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenes Dana Cohen-Bar Elad Richardson G. Metzer Raja Giryes Daniel Cohen-Or 118 58 0 23 Mar 2023
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions Ayaan Haque Matthew Tancik Alexei A. Efros Aleksander Holynski Angjoo Kanazawa VGen DiffM 164 377 0 22 Mar 2023
Compositional 3D Scene Generation using Locally Conditioned Diffusion Ryan Po Gordon Wetzstein DiffM 124 89 0 21 Mar 2023
Vox-E: Text-guided Voxel Editing of 3D Objects Etai Sella Gal Fiebelman Peter Hedman Hadar Averbuch-Elor DiffM 109 75 0 21 Mar 2023
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models Lukas Höllein Ang Cao Andrew Owens Justin Johnson Matthias Nießner DiffM 137 182 0 21 Mar 2023