Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv (abs)PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 459 papers shown

Title
Diffusion Time-step Curriculum for One Image to 3D Generation Xuanyu Yi Zike Wu Qingshan Xu Pan Zhou Joo-Hwee Lim Hanwang Zhang 140 20 0 06 Apr 2024
DATENeRF: Depth-Aware Text-based Editing of NeRFs Sara Rojas Julien Philip Kai Zhang Sai Bi Fujun Luan Guohao Li Kalyan Sunkavalli DiffM 81 3 0 06 Apr 2024
Idea-2-3D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs Junhao Chen Xiang Li Xiaojun Ye Chao Li Zhaoxin Fan Hao Zhao VGen 3DV 257 5 0 05 Apr 2024
SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfer Zijie Wu Chaohui Yu Yanqin Jiang Chenjie Cao Fan Wang Xiang Bai 3DGS 124 24 0 04 Apr 2024
MVD-Fusion: Single-view 3D via Depth-consistent Multi-view Generation Hanzhe Hu Zhizhuo Zhou Varun Jampani Shubham Tulsiani MDE 94 22 0 04 Apr 2024
The More You See in 2D, the More You Perceive in 3D Xinyang Han Zelin Gao Angjoo Kanazawa Shubham Goel Yossi Gandelsman DiffM 85 4 0 04 Apr 2024
AWOL: Analysis WithOut synthesis using Language Silvia Zuffi Michael J. Black 97 3 0 03 Apr 2024
MatAtlas: Text-driven Consistent Geometry Texturing and Material Assignment Duygu Ceylan Valentin Deschaintre Thibault Groueix Rosalie Martin C. Huang Romain Rouffet Vladimir G. Kim Gaetan Lassagne DiffM 73 12 0 03 Apr 2024
MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space Armand Comas Massague Di Qiu Menglei Chai Marcel C. Bühler Amit Raj ... Mark Matthews Paulo F. U. Gotardo Octavia Camps Sergio Orts Thabo Beeler 96 1 0 01 Apr 2024
FlexiDreamer: Single Image-to-3D Generation with FlexiCubes Ruowen Zhao Zhengyi Wang Yikai Wang Zihan Zhou Jun Zhu 107 9 0 01 Apr 2024
DiSR-NeRF: Diffusion-Guided View-Consistent Super-Resolution NeRF Jie Long Lee Chen Li Gim Hee Lee 84 9 0 01 Apr 2024
Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation Yujin Chen Yinyu Nie Benjamin Ummenhofer R. Birkl Michael Paulitsch Matthias Müller Matthias Nießner AI4CE 111 3 0 28 Mar 2024
TC4D: Trajectory-Conditioned Text-to-4D Generation Sherwin Bahmani Xian Liu Yifan Wang Ivan Skorokhodov Victor Rong ... Jeong Joon Park Sergey Tulyakov Gordon Wetzstein Andrea Tagliasacchi David B. Lindell 167 38 0 26 Mar 2024
GenesisTex: Adapting Image Denoising Diffusion to Texture Space Chenjian Gao Boyan Jiang Xinghui Li Yingpeng Zhang Qian Yu DiffM 113 11 0 26 Mar 2024
DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusion Yuanze Lin Ronald Clark Philip Torr 3DGS 92 11 0 25 Mar 2024
VP3D: Unleashing 2D Visual Prompt for Text-to-3D Generation Yang Chen Yingwei Pan Haibo Yang Ting Yao Tao Mei DiffM 97 20 0 25 Mar 2024
Comp4D: LLM-Guided Compositional 4D Scene Generation Dejia Xu Hanwen Liang N. Bhatt Hezhen Hu Hanxue Liang Konstantinos N. Plataniotis Zhangyang Wang 94 27 0 25 Mar 2024
Make-It-Vivid: Dressing Your Animatable Biped Cartoon Characters from Text Junshu Tang Yanhong Zeng Ke Fan Xuheng Wang Bo Dai Kai Chen Lizhuang Ma 82 7 0 25 Mar 2024
InterFusion: Text-Driven Generation of 3D Human-Object Interaction Sisi Dai Wenhao Li Haowen Sun Haibin Huang Chongyang Ma Hui Huang Kai Xu Ruizhen Hu 77 10 0 22 Mar 2024
LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesis Kevin Xie Jonathan Lorraine Tianshi Cao Jun Gao James Lucas Antonio Torralba Sanja Fidler Fangyin Wei DiffM 98 37 0 22 Mar 2024
DreamFlow: High-Quality Text-to-3D Generation by Approximating Probability Flow Kyungmin Lee Kihyuk Sohn Jinwoo Shin 80 19 0 22 Mar 2024
STAG4D: Spatial-Temporal Anchored Generative 4D Gaussians Yifei Zeng Yanqin Jiang Siyu Zhu Yuanxun Lu Youtian Lin Hao Zhu Weiming Hu Xun Cao Yao Yao 3DGS 133 52 0 22 Mar 2024
GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation Yinghao Xu Zifan Shi Wang Yifan Hansheng Chen Ceyuan Yang Sida Peng Yujun Shen Gordon Wetzstein 3DV 3DGS 163 177 0 21 Mar 2024
DreamReward: Text-to-3D Generation with Human Preference Junliang Ye Fangfu Liu Qixiu Li Zhengyi Wang Yikai Wang Xinzhou Wang Yueqi Duan Jun Zhu 119 29 0 21 Mar 2024
SyncTweedies: A General Generative Framework Based on Synchronized Diffusions Jaihoon Kim Juil Koo Kyeongmin Yeo Minhyuk Sung DiffM 3DGS 117 9 0 21 Mar 2024
Text-to-3D Shape Generation Han-Hung Lee Manolis Savva Angel X. Chang 93 13 0 20 Mar 2024
BAGS: Building Animatable Gaussian Splatting from a Monocular Video with Diffusion Priors Tingyang Zhang Qingzhe Gao Weiyu Li Libin Liu Baoquan Chen DiffM 3DGS VGen 99 11 0 18 Mar 2024
BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesis Lutao Jiang Lin Wang 3DGS 110 17 0 17 Mar 2024
3D-SceneDreamer: Text-Driven 3D-Consistent Scene Generation Frank Zhang Yibo Zhang Quan Zheng R. Ma W. Hua Hujun Bao Weiwei Xu Changqing Zou 105 11 0 14 Mar 2024
Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior Cheng Chen Xiaofeng Yang Fan Yang Chengzeng Feng Zhoujie Fu Chuan-Sheng Foo Guosheng Lin Fayao Liu 116 14 0 14 Mar 2024
Envision3D: One Image to 3D with Anchor Views Interpolation Yatian Pang Tanghui Jia Yujun Shi Zhenyu Tang Junwu Zhang Xinhua Cheng Xing Zhou Francis E. H. Tay Li-xin Yuan 109 11 0 13 Mar 2024
Fast Text-to-3D-Aware Face Generation and Manipulation via Direct Cross-modal Mapping and Geometric Regularization Jinlu Zhang Yiyi Zhou Qiancheng Zheng Xiaoxiong Du Gen Luo Jun Peng Xiaoshuai Sun Rongrong Ji 3DH 97 3 0 11 Mar 2024
3D-aware Image Generation and Editing with Multi-modal Conditions Bo Li Yike Li Zhien He Bin Liu Yu-Kun Lai 72 2 0 11 Mar 2024
Enhancing Texture Generation with High-Fidelity Using Advanced Texture Priors Kuo Xu Maoyu Wang Muyu Wang Lincong Feng Tianhui Zhang Xiaoli Liu 107 1 0 08 Mar 2024
CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model Zhengyi Wang Yikai Wang Yifei Chen Chendong Xiang Shuo Chen Dajiang Yu Chongxuan Li Hang Su Jun Zhu 115 136 0 08 Mar 2024
3DTextureTransformer: Geometry Aware Texture Generation for Arbitrary Mesh Topology K. Dharma Clayton T. Morrison 86 0 0 07 Mar 2024
3DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priors Fangzhou Hong Jiaxiang Tang Ziang Cao Min Shi Tong Wu ... Shuai Yang Tengfei Wang Liang Pan Dahua Lin Ziwei Liu 104 47 0 04 Mar 2024
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models Lukas Höllein Aljavz Bovzivc Norman Muller David Novotny Hung-Yu Tseng Christian Richardt Michael Zollhöfer Matthias Nießner DiffM 91 45 0 04 Mar 2024
HyperSDFusion: Bridging Hierarchical Structures in Language and Geometry for Enhanced 3D Text2Shape Generation Zhiying Leng Tolga Birdal Xiaohui Liang Federico Tombari 156 4 0 01 Mar 2024
ViewFusion: Towards Multi-View Consistency via Interpolated Denoising Xianghui Yang Yan Zuo Sameera Ramasinghe Loris Bazzani Gil Avraham Anton Van Den Hengel DiffM 85 7 0 29 Feb 2024
A Quantitative Evaluation of Score Distillation Sampling Based Text-to-3D Xiaohan Fei Chethan Parameshwara Jiawei Mo Xiaolong Li Ashwin Swaminathan C. Taylor Paolo Favaro Stefano Soatto DiffM EGVM 87 0 0 29 Feb 2024
CharacterGen: Efficient 3D Character Generation from Single Images with Multi-View Pose Canonicalization Haoyue Peng Jia-Peng Zhang Meng-Hao Guo Yan-Pei Cao Shi-Min Hu DiffM 108 15 0 27 Feb 2024
CharNeRF: 3D Character Generation from Concept Art Eddy Chu Yiyang Chen Chedy Raissi Anand Bhojan 3DH 42 1 0 27 Feb 2024
Disentangled 3D Scene Generation with Layout Learning Dave Epstein Ben Poole B. Mildenhall Alexei A. Efros Aleksander Holynski CoGe OCL 3DV 81 21 0 26 Feb 2024
MVD $^2$ : Efficient Multiview 3D Reconstruction for Multiview Diffusion Xin-Yang Zheng Hao Pan Yufeng Guo Xin Tong Yang Liu DiffM 96 23 0 22 Feb 2024
FlashTex: Fast Relightable Mesh Texturing with LightControlNet Kangle Deng Timothy Omernick Alexander Weiss Deva Ramanan Jun-Yan Zhu Tinghui Zhou Maneesh Agrawala 123 33 0 20 Feb 2024
GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering Abdullah Hamdi Luke Melas-Kyriazi Jinjie Mai Guocheng Qian Ruoshi Liu Carl Vondrick Guohao Li Andrea Vedaldi 3DGS 101 45 0 15 Feb 2024
GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting Xiaoyu Zhou Xingjian Ran Yajiao Xiong Jinlin He Zhiwei Lin Yongtao Wang Deqing Sun Ming-Hsuan Yang 3DGS 79 59 0 11 Feb 2024
HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting Zhen Zhou Fan Ma Hehe Fan Yi Yang 3DGS 96 24 0 09 Feb 2024
SPAD : Spatially Aware Multiview Diffusers Yash Kant Ziyi Wu Michael Vasilkovsky Guocheng Qian Jian Ren R. A. Guler Guohao Li Sergey Tulyakov Igor Gilitschenski Aliaksandr Siarohin DiffM 119 38 0 07 Feb 2024