Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv (abs)PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 459 papers shown

Title
4Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models Heng Yu Chaoyang Wang Peiye Zhuang Willi Menapace Aliaksandr Siarohin Junli Cao László A. Jeni Sergey Tulyakov Hsin-Ying Lee VGen 103 29 0 11 Jun 2024
Generative Lifting of Multiview to 3D from Unknown Pose: Wrapping NeRF inside Diffusion Xin Yuan Rana Hanocka Michael Maire DiffM 70 0 0 11 Jun 2024
NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editing Ting-Hsuan Chen Jiewen Chan Hau-Shiang Shiu Shih-Han Yen Chang-Han Yeh Yu-Lun Liu VGen DiffM 118 3 0 10 Jun 2024
GTR: Improving Large 3D Reconstruction Models through Geometry and Texture Refinement Peiye Zhuang Songfang Han Chaoyang Wang Aliaksandr Siarohin Jiaxu Zou Michael Vasilkovsky V. Shakhrai Sergey Korolev Sergey Tulyakov Hsin-Ying Lee 3DV 122 7 0 09 Jun 2024
VP-LLM: Text-Driven 3D Volume Completion with Large Language Models through Patchification Jianmeng Liu Yichen Liu Yuyao Zhang Zeyuan Meng Yu-Wing Tai Chi-Keung Tang 96 0 0 08 Jun 2024
STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargeting Zenghao Chai Chen Tang Yongkang Wong Mohan Kankanhalli DiffM 123 9 0 07 Jun 2024
DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data Qihao Liu Yi Zhang Song Bai Adam Kortylewski Alan Yuille 117 11 0 06 Jun 2024
RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting Qi Wang Ruijie Lu Xudong Xu Jingbo Wang Michael Yu Wang Bo Dai Gang Zeng Dan Xu DiffM 88 6 0 04 Jun 2024
DreamPhysics: Learning Physical Properties of Dynamic 3D Gaussians with Video Diffusion Priors Tianyu Huang Yihan Zeng Hui Li Zhilu Zhang Rynson W. H. Lau Wangmeng Zuo Rynson W. H. Lau 3DGS VGen 109 5 0 03 Jun 2024
Freeplane: Unlocking Free Lunch in Triplane-Based Sparse-View Reconstruction Models Wenqiang Sun Zhengyi Wang Shuo Chen Yikai Wang Zilong Chen Jun Zhu Jun Zhang 118 1 0 02 Jun 2024
Lay-A-Scene: Personalized 3D Object Arrangement Using Text-to-Image Priors Ohad Rahamim Hilit Segev Idan Achituve Yuval Atzmon Yoni Kasten Gal Chechik 91 4 0 02 Jun 2024
Bootstrap3D: Improving 3D Content Creation with Synthetic Data Zeyi Sun Tong Wu Pan Zhang Yuhang Zang Xiao-wen Dong Yuanjun Xiong Dahua Lin Jiaqi Wang 97 0 0 31 May 2024
Amortizing intractable inference in diffusion models for vision, language, and control S. Venkatraman Moksh Jain Luca Scimeca Minsu Kim Marcin Sendera ... Alexandre Adam Jarrid Rector-Brooks Yoshua Bengio Glen Berseth Nikolay Malkin 195 32 0 31 May 2024
Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image Kailu Wu Fangfu Liu Zhihan Cai Runjie Yan Hanyang Wang Yating Hu Yueqi Duan Kaisheng Ma 117 64 0 30 May 2024
GECO: Generative Image-to-3D within a SECOnd Chen Wang Jiatao Gu Xiaoxiao Long Yuan Liu Lingjie Liu 89 5 0 30 May 2024
PLA4D: Pixel-Level Alignments for Text-to-4D Gaussian Splatting Qiaowei Miao Yawei Luo Yi Yang 3DGS DiffM 148 9 0 30 May 2024
TetSphere Splatting: Representing High-Quality Geometry with Lagrangian Volumetric Meshes Minghao Guo Bohan Wang Kaiming He Wojciech Matusik 3DGS 181 7 0 30 May 2024
REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignment Haonan Han Rui Yang Huan Liao Jiankai Xing Zunnan Xu Xiao-Qing Yu Junwei Zha Xiu Li Wanhua Li DiffM 111 8 0 28 May 2024
Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabrication Yunuo Chen Tianyi Xie Zeshun Zong Xuan Li Feng Gao Yin Yang Yingnian Wu Chenfanfu Jiang 119 7 0 28 May 2024
Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priors Soumava Paul Christopher Wewer Bernt Schiele J. E. Lenssen 3DGS 87 4 0 26 May 2024
Score Distillation via Reparametrized DDIM Artem Lukoianov Haitz Sáez de Ocáriz Borde Kristjan Greenewald Vitor Campagnolo Guizilini Timur M. Bagautdinov Vincent Sitzmann Justin Solomon DiffM 107 19 0 24 May 2024
NIVeL: Neural Implicit Vector Layers for Text-to-Vector Generation Vikas Thamizharasan Difan Liu Matthew Fisher Nanxuan Zhao E. Kalogerakis Michal Lukac DiffM 101 9 0 24 May 2024
Diff3DS: Generating View-Consistent 3D Sketch via Differentiable Curve Rendering Yibo Zhang Lihong Wang Changqing Zou Tieru Wu Rui Ma DiffM 123 4 0 24 May 2024
PuzzleAvatar: Assembling 3D Avatars from Personal Albums Yuliang Xiu Yufei Ye Zhen Liu Dimitrios Tzionas Michael J. Black 90 10 0 23 May 2024
Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis Basile Van Hoorick Rundi Wu Ege Ozguroglu Kyle Sargent Ruoshi Liu P. Tokmakov Achal Dave Changxi Zheng Carl Vondrick DiffM VGen 132 35 0 23 May 2024
Improved Distribution Matching Distillation for Fast Image Synthesis Tianwei Yin Michael Gharbi Taesung Park Richard Zhang Eli Shechtman Frédo Durand William T. Freeman DiffM 154 127 0 23 May 2024
Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attention Peng Li Yuan Liu Xiaoxiao Long Feihu Zhang Cheng Lin ... Wenhan Luo Ping Tan Wenping Wang Qi-fei Liu Yi-Ting Guo VGen 159 50 0 19 May 2024
Dreamer XL: Towards High-Resolution Text-to-3D Generation via Trajectory Score Matching Xingyu Miao Haoran Duan Varun Ojha Jun Song Tejal Shah Yang Long R. Ranjan 143 4 0 18 May 2024
ART3D: 3D Gaussian Splatting for Text-Guided Artistic Scenes Generation Pengzhi Li Chengshuai Tang Qinxuan Huang Zhiheng Li 3DGS 83 12 0 17 May 2024
Dual3D: Efficient and Consistent Text-to-3D Generation with Dual-mode Multi-view Latent Diffusion Xinyang Li Zhangyu Lai Linning Xu Jianfei Guo Liujuan Cao Shengchuan Zhang Bo Dai Rongrong Ji DiffM 97 9 0 16 May 2024
Flow Score Distillation for Diverse Text-to-3D Generation Runjie Yan Kailu Wu Kaisheng Ma 92 3 0 16 May 2024
A Survey On Text-to-3D Contents Generation In The Wild Chenhan Jiang 115 5 0 15 May 2024
DiffTF++: 3D-aware Diffusion Transformer for Large-Vocabulary 3D Generation Ziang Cao Fangzhou Hong Tong Wu Liang Pan Ziwei Liu 90 3 0 13 May 2024
Coin3D: Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioning Wenqi Dong Bangbang Yang Lin Ma Xiao Liu Liyuan Cui Hujun Bao Yuewen Ma Zhaopeng Cui DiffM 79 11 0 13 May 2024
X-Oscar: A Progressive Framework for High-quality Text-guided 3D Animatable Avatar Generation Yiwei Ma Zhekai Lin Jiayi Ji Yijun Fan Xiaoshuai Sun Rongrong Ji 115 7 0 02 May 2024
Learning to Compose: Improving Object Centric Learning by Injecting Compositionality Whie Jung Jaehoon Yoo Sungjin Ahn Seunghoon Hong OCL CoGe 105 5 0 01 May 2024
$MicroDreamer: Zero-shot 3D Generation in $\sim$20 Seconds by Score-based Iterative Reconstruction$ MicroDreamer: Zero-shot 3D Generation in $\sim$ 20 Seconds by Score-based Iterative Reconstruction Luxi Chen Zhengyi Wang Zihan Zhou Tingting Gao Hang Su Jun Zhu Chongxuan Li DiffM 3DGS 92 1 0 30 Apr 2024
Grounded Compositional and Diverse Text-to-3D with Pretrained Multi-View Diffusion Model Xiaolong Li Jiawei Mo Ying Wang Chethan Parameshwara Xiaohan Fei Ashwin Swaminathan C. Taylor Zhuowen Tu Paolo Favaro Stefano Soatto 108 4 0 28 Apr 2024
Interactive3D: Create What You Want by Interactive 3D Generation Shaocong Dong Lihe Ding Zhanpeng Huang Zibin Wang Tianfan Xue Dan Xu 65 10 0 25 Apr 2024
Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses Inhee Lee Byungjun Kim Hanbyul Joo 3DGS 116 6 0 22 Apr 2024
X-Ray: A Sequential 3D Representation For Generation Tao Hu Wenhang Ge Yuyang Zhao Gim Hee Lee MedIm 95 5 0 22 Apr 2024
G-HOP: Generative Hand-Object Prior for Interaction Reconstruction and Grasp Synthesis Yufei Ye Abhinav Gupta Kris Kitani Shubham Tulsiani 105 17 0 18 Apr 2024
Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinement Chi-Yin Wang Junming Huang Rong Zhang Qi Wang Haotian Yang Haibin Huang Chongyang Ma Weiwei Xu 3DH 79 2 0 15 Apr 2024
DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling Xuening Yuan Hongyu Yang Yueming Zhao Di Huang 3DGS 146 3 0 14 Apr 2024
Probing the 3D Awareness of Visual Foundation Models Mohamed El Banani Amit Raj Kevis-Kokitsi Maninis Abhishek Kar Yuanzhen Li Michael Rubinstein Deqing Sun Leonidas Guibas Justin Johnson Varun Jampani 109 86 0 12 Apr 2024
InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models Jiale Xu Weihao Cheng Yiming Gao Xintao Wang Shenghua Gao Ying Shan 3DGS 148 208 0 10 Apr 2024
Move Anything with Layered Scene Diffusion Jiawei Ren Mengmeng Xu Jui-Chieh Wu Ziwei Liu Tao Xiang Antoine Toisoul 83 10 0 10 Apr 2024
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion Jaidev Shriram Alex Trevithick Lingjie Liu Ravi Ramamoorthi DiffM 3DGS 167 59 0 10 Apr 2024
DreamView: Injecting View-specific Text Guidance into Text-to-3D Generation Junkai Yan Yipeng Gao Q. Yang Xihan Wei Xuansong Xie Ancong Wu Wei-Shi Zheng 82 2 0 09 Apr 2024
Hash3D: Training-free Acceleration for 3D Generation Xingyi Yang Xinchao Wang 3DGS 82 12 0 09 Apr 2024