Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv (abs)PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 459 papers shown

Title
CaPa: Carve-n-Paint Synthesis for Efficient 4K Textured Mesh Generation Hwan Heo Jangyeong Kim Seongyeong Lee Jeong A Wi Junyoung Choi Sangjun Ahn 120 0 0 17 Jan 2025
Hyper-3DG: Text-to-3D Gaussian Generation via Hypergraph Donglin Di Jiahui Yang Chaofan Luo Zhou Xue Wei Chen Xun Yang Yue Gao 3DGS 140 11 0 10 Jan 2025
SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images Zixuan Huang Mark Boss Aaryaman Vasishta James M. Rehg Varun Jampani 139 8 0 08 Jan 2025
Instructive3D: Editing Large Reconstruction Models with Text Instructions Kunal Kathare Ankit Dhiman K Vikas Gowda Siddharth Aravindan Shubham Monga Basavaraja Shanthappa Vandrotti Lokesh R. Boregowda DiffM 82 2 0 08 Jan 2025
Taming Feed-forward Reconstruction Models as Latent Encoders for 3D Generative Models Suttisak Wizadwongsa Jinfan Zhou Edward Li Jeong Joon Park 3DV 135 0 0 31 Dec 2024
GaussianPainter: Painting Point Cloud into 3D Gaussians with Normal Guidance Jingqiu Zhou Lue Fan Xuesong Chen Linjiang Huang Si Liu Hongsheng Li 3DGS 97 0 0 23 Dec 2024
Benchmarking and Learning Multi-Dimensional Quality Evaluator for Text-to-3D Generation Yujie Zhang Bingyang Cui Qi Yang Zhu Li Yiling Xu 121 1 0 15 Dec 2024
OFTSR: One-Step Flow for Image Super-Resolution with Tunable Fidelity-Realism Trade-offs Yuanzhi Zhu R. Wang Shilin Lu Junnan Li Hanshu Yan Peng Sun SupR 188 5 0 12 Dec 2024
SVGFusion: Scalable Text-to-SVG Generation via Vector Space Diffusion Ximing Xing Juncheng Hu Jing Zhang Dong Xu Qian Yu 220 4 0 11 Dec 2024
Diffusing Differentiable Representations Yash Savani Marc Finzi J. Zico Kolter DiffM 120 0 0 09 Dec 2024
MVReward: Better Aligning and Evaluating Multi-View Diffusion Models with Human Preferences Weitao Wang Haoran Xu Yuxiao Yang Zhifang Liu Jun Meng Haoqian Wang EGVM 139 3 0 09 Dec 2024
PrEditor3D: Fast and Precise 3D Shape Editing Ziya Erkoç Can Gümeli Chaoyang Wang Matthias Nießner Angela Dai Peter Wonka Hsin-Ying Lee Peiye Zhuang 158 3 0 09 Dec 2024
Birth and Death of a Rose Chen Geng Yunzhi Zhang Shangzhe Wu Jiajun Wu AI4CE 128 2 0 06 Dec 2024
4Real-Video: Learning Generalizable Photo-Realistic 4D Video Diffusion Chaoyang Wang Peiye Zhuang Tuan Duc Ngo Willi Menapace Aliaksandr Siarohin Michael Vasilkovsky Ivan Skorokhodov Sergey Tulyakov Peter Wonka Hsin-Ying Lee DiffM VGen 168 4 0 05 Dec 2024
Sharp-It: A Multi-view to Multi-view Diffusion Model for 3D Synthesis and Manipulation Yiftach Edelstein Or Patashnik Dana Cohen-Bar Lihi Zelnik-Manor 152 0 0 03 Dec 2024
InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillation Wenjie Zhuo Fan Ma Hehe Fan 114 1 0 27 Nov 2024
SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation Duc-Hai Pham Tung Do P. Nguyen Binh-Son Hua K. Nguyen Rang Nguyen MDE 149 3 0 27 Nov 2024
ModeDreamer: Mode Guiding Score Distillation for Text-to-3D Generation using Reference Image Prompts Uy Dieu Tran Minh Luu P. Nguyen K. Nguyen Binh-Son Hua DiffM 163 1 0 27 Nov 2024
SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis Hyojun Go Byeongjun Park Jiho Jang Jin-Young Kim Soonwoo Kwon Changick Kim 3DGS 250 3 0 25 Nov 2024
Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priors Soumava Paul Prakhar Kaushik Alan Yuille 3DGS DiffM 566 0 0 24 Nov 2024
TEXGen: a Generative Diffusion Model for Mesh Textures Xin Yu Ze Yuan Yu Guo Ying-Tian Liu Jing Liu Yangguang Li Yan-Pei Cao Ding Liang Xiaojuan Qi 105 17 0 22 Nov 2024
Novel View Extrapolation with Video Diffusion Priors Kunhao Liu Ling Shao Shijian Lu VGen 151 4 0 21 Nov 2024
MVLight: Relightable Text-to-3D Generation via Light-conditioned Multi-View Diffusion D. Shim Yichun Shi Kejie Li H. J. Kim Peng Wang 118 0 0 18 Nov 2024
ARM: Appearance Reconstruction Model for Relightable 3D Generation Xiang-Wei Feng Chang Yu Zoubin Bi Yintong Shang Feng Gao Hongzhi Wu Kun Zhou Chenfanfu Jiang Yifan Yang 3DH 97 1 0 16 Nov 2024
Edify 3D: Scalable High-Quality 3D Asset Generation Nvidia : Maciej Bala Huayu Chen Yin Cui ... Shuran Song Donglai Xiang Lyne Tchapmi Fangyin Wei Qinsheng Zhang 104 7 0 11 Nov 2024
ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuning David Junhao Zhang Roni Paiss Shiran Zada Nikhil Karnad David E. Jacobs Yael Pritch Inbar Mosseri Mike Zheng Shou Neal Wadhwa Nataniel Ruiz DiffM VGen 157 21 0 07 Nov 2024
SceneComplete: Open-World 3D Scene Completion in Cluttered Real World Environments for Robot Manipulation Aditya Agarwal Gaurav Singh Bipasha Sen Tomás Lozano-Pérez L. Kaelbling 3DV 93 3 0 31 Oct 2024
CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussians Chongjian Ge Chenfeng Xu Yuanfeng Ji C-T.John Peng Masayoshi Tomizuka Ping Luo Mingyu Ding Varun Jampani Weidong Zhan 3DGS 69 4 0 28 Oct 2024
Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Models Liulei Li Wenguan Wang Yue Yang 108 8 0 26 Oct 2024
Few-shot NeRF by Adaptive Rendering Loss Regularization Qingshan Xu Xuanyu Yi Jianyao Xu Wenbing Tao Yew-Soon Ong Hanwang Zhang 72 6 0 23 Oct 2024
DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Model Jingxiang Sun Cheng Peng Ruizhi Shao Y. Guo Xiaochen Zhao Yangguang Li Yanpei Cao Bo Zhang Yebin Liu 114 2 0 16 Oct 2024
ControLRM: Fast and Controllable 3D Generation via Large Reconstruction Model Hongbin Xu Weitao Chen Zhipeng Zhou Feng Xiao Baigui Sun Mike Zheng Shou Wenxiong Kang 102 2 0 12 Oct 2024
Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors Hritam Basak Hadi Tabatabaee Shreekant Gayaka Ming-feng Li Xin Yang Cheng-Hao Kuo Arnie Sen Min Sun Zhaozheng Yin 3DGS 71 0 0 12 Oct 2024
Semantic Score Distillation Sampling for Compositional Text-to-3D Generation L. Yang Zixiang Zhang Junlin Han Bohan Zeng Runjia Li Philip Torr Wentao Zhang 143 3 0 11 Oct 2024
SceneCraft: Layout-Guided 3D Scene Generation Xiuyu Yang Yunze Man Jun-Kun Chen Yu-Xiong Wang 3DV 191 9 0 11 Oct 2024
Diffusion Models in 3D Vision: A Survey Zhen Wang Dongyuan Li Xue Liu Tianyu He Jiang Bian Renhe Jiang MedIm 265 4 0 07 Oct 2024
LaGeM: A Large Geometry Model for 3D Representation Learning and Diffusion Biao Zhang Peter Wonka AI4CE 3DV DiffM 108 7 0 02 Oct 2024
GenesisTex2: Stable, Consistent and High-Quality Text-to-Texture Generation Jiawei Lu Yingpeng Zhang Zengjun Zhao He Wang Kun Zhou Tianjia Shao 131 4 0 27 Sep 2024
EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generation Jiaxiang Tang Zhaoshuo Li Jinwei Gu Xian Liu Gang Zeng Ming-Yu Liu Qinsheng Zhang 128 30 0 26 Sep 2024
DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion Yukun Huang Jianan Wang Ailing Zeng Zheng-Jun Zha Lei Zhang Xihui Liu 3DGS 95 7 0 25 Sep 2024
Blox-Net: Generative Design-for-Robot-Assembly Using VLM Supervision, Physics Simulation, and a Robot with Reset Andrew Goldberg Kavish Kondap Tianshuang Qiu Zehan Ma Letian Fu Justin Kerr Huang Huang Kaiyuan Chen Kuan Fang Ken Goldberg 79 4 0 25 Sep 2024
Single Image, Any Face: Generalisable 3D Face Generation Wenqing Wang Haosen Yang Josef Kittler Xiatian Zhu 3DH 161 0 0 25 Sep 2024
MaterialFusion: Enhancing Inverse Rendering with Material Diffusion Priors Yehonathan Litman Or Patashnik Kangle Deng Aviral Agrawal Rushikesh Zawar Fernando de la Torre Shubham Tulsiani 172 7 0 23 Sep 2024
Vista3D: Unravel the 3D Darkside of a Single Image Qiuhong Shen Xingyi Yang Michael Bi Mi Xinchao Wang CoGe 106 2 0 18 Sep 2024
DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors Thomas Hanwen Zhu Ruining Li Tomas Jakab DiffM 102 6 0 12 Sep 2024
DreamBeast: Distilling 3D Fantastical Animals with Part-Aware Knowledge Transfer Runjia Li Junlin Han Luke Melas-Kyriazi Chunyi Sun Zhaochong An Zhongrui Gui Shuyang Sun Philip Torr Tomas Jakab 88 1 0 12 Sep 2024
DreamMesh: Jointly Manipulating and Texturing Triangle Meshes for Text-to-3D Generation Haibo Yang Yang Chen Yingwei Pan Ting Yao Zhineng Chen Zuxuan Wu Yu-Gang Jiang Tao Mei 114 6 0 11 Sep 2024
MVGaussian: High-Fidelity text-to-3D Content Generation with Multi-View Guidance and Surface Densification Phu-Cuong Pham Aradhya Neeraj Mathur Ojaswa Sharma Aniket Bera 3DV 3DGS 44 1 0 10 Sep 2024
Neural MP: A Generalist Neural Motion Planner Murtaza Dalal Jiahui Yang Russell Mendonca Youssef Khaky Ruslan Salakhutdinov Deepak Pathak 81 7 0 09 Sep 2024
DreamMapping: High-Fidelity Text-to-3D Generation via Variational Distribution Mapping Zeyu Cai D. B. Wang Yixun Liang Zhijing Shao Ying-Cong Chen Xiaohang Zhan Zhaoxiang Wang DiffM 3DGS 144 1 0 08 Sep 2024