Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv (abs)PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 459 papers shown

Title
Denoising Diffusion via Image-Based Rendering Titas Anciukevicius Fabian Manhardt Federico Tombari Paul Henderson 140 13 0 05 Feb 2024
Retrieval-Augmented Score Distillation for Text-to-3D Generation Junyoung Seo Susung Hong Wooseok Jang Ines Hyeonsu Kim Minseop Kwak Doyup Lee Seungryong Kim 107 9 0 05 Feb 2024
ID-NeRF: Indirect Diffusion-guided Neural Radiance Fields for Generalizable View Synthesis Yaokun Li Chao Gou Guang Tan DiffM 90 1 0 02 Feb 2024
AToM: Amortized Text-to-Mesh using 2D Diffusion Guocheng Qian Junli Cao Aliaksandr Siarohin Yash Kant Chaoyang Wang ... Igor Gilitschenski Jian Ren Guohao Li Kfir Aberman Sergey Tulyakov DiffM 96 16 0 01 Feb 2024
Plug-and-Play image restoration with Stochastic deNOising REgularization Marien Renaud Jean Prost Arthur Leclaire Nicolas Papadakis DiffM 166 8 0 01 Feb 2024
ReplaceAnything3D:Text-Guided 3D Scene Editing with Compositional Neural Radiance Fields Edward Bartrum Thu Nguyen-Phuoc Christopher Xie Zhengqin Li Numair Khan A. Avetisyan Douglas Lanman Lei Xiao DiffM 89 4 0 31 Jan 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 170 43 0 31 Jan 2024
BoostDream: Efficient Refining for High-Quality Text-to-3D Generation from Multi-View Diffusion Yonghao Yu Shunan Zhu Huai Qin Haorui Li Jinglu Hu 96 8 0 30 Jan 2024
DressCode: Autoregressively Sewing and Generating Garments from Text Guidance Kai He Kaixin Yao Qixuan Zhang Jingyi Yu Lingjie Liu Lan Xu AI4CE 178 34 0 29 Jan 2024
Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generation Minglin Chen Weihao Yuan Yukun Wang Zhe Sheng Yisheng He Zilong Dong Liefeng Bo Yulan Guo DiffM 97 4 0 25 Jan 2024
TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion Yu-Ying Yeh Jia-Bin Huang Changil Kim Lei Xiao Thu Nguyen-Phuoc ... Cheng Zhang Manmohan Chandraker Carl S. Marshall Zhao Dong Zhengqin Li DiffM 108 36 0 17 Jan 2024
Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Prior Zike Wu Pan Zhou Xuanyu Yi Xiaoding Yuan Hanwang Zhang DiffM 97 41 0 17 Jan 2024
Diffusion Priors for Dynamic View Synthesis from Monocular Videos Chaoyang Wang Peiye Zhuang Aliaksandr Siarohin Junli Cao Guocheng Qian Hsin-Ying Lee Sergey Tulyakov VGen DiffM 89 13 0 10 Jan 2024
Score Distillation Sampling with Learned Manifold Corrective Thiemo Alldieck Nikos Kolotouros C. Sminchisescu DiffM 95 14 0 10 Jan 2024
GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation Tong Wu Guandao Yang Zhibing Li Kai Zhang Ziwei Liu Leonidas Guibas Dahua Lin Gordon Wetzstein EGVM VGen 150 96 0 08 Jan 2024
Latte: Latent Diffusion Transformer for Video Generation Xin Ma Yaohui Wang Gengyun Jia Xinyuan Chen Ziqiang Liu Yuan-Fang Li Cunjian Chen Yu Qiao DiffM VGen 313 280 0 05 Jan 2024
What You See is What You GAN: Rendering Every Pixel for High-Fidelity Geometry in 3D GANs Alex Trevithick Matthew Chan Towaki Takikawa Umar Iqbal Shalini De Mello Manmohan Chandraker Ravi Ramamoorthi Koki Nagano 3DV 131 8 0 04 Jan 2024
Image Sculpting: Precise Object Editing with 3D Geometry Control Jiraphon Yenphraphai Xichen Pan Sainan Liu Daniele Panozzo Saining Xie 92 22 0 02 Jan 2024
GD^2-NeRF: Generative Detail Compensation via GAN and Diffusion for One-shot Generalizable Neural Radiance Fields X. Pan Zongxin Yang Shuai Bai Yi Yang DiffM OffRL 94 1 0 01 Jan 2024
SteinDreamer: Variance Reduction for Text-to-3D Score Distillation via Stein Identity Peihao Wang Zhiwen Fan Dejia Xu Dilin Wang Sreyas Mohan ... Rakesh Ranjan Yilei Li Qiang Liu Zhangyang Wang Vikas Chandra 128 21 0 31 Dec 2023
Taming Mode Collapse in Score Distillation for Text-to-3D Generation Peihao Wang Dejia Xu Zhiwen Fan Dilin Wang Sreyas Mohan ... Rakesh Ranjan Yilei Li Qiang Liu Zhangyang Wang Vikas Chandra DiffM 121 29 0 31 Dec 2023
iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views Chin-Hsuan Wu Yen-Chun Chen Bolivar Solarte Lu Yuan Min Sun 93 9 0 28 Dec 2023
4DGen: Grounded 4D Content Generation with Spatial-temporal Consistency Yuyang Yin Dejia Xu Zhangyang Wang Yao-Min Zhao Yunchao Wei 3DGS 133 75 0 28 Dec 2023
SVGDreamer: Text Guided SVG Generation with Diffusion Model Ximing Xing Haitao Zhou Chuang Wang Jing Zhang Dong Xu Qian Yu DiffM 120 37 0 27 Dec 2023
HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3D Sangmin Woo Byeongjun Park Hyojun Go Jin-Young Kim Changick Kim 101 24 0 26 Dec 2023
Hyper-VolTran: Fast and Generalizable One-Shot Image to 3D Object Structure via HyperNetworks Christian Simon Sen He Juan-Manuel Perez-Rua Mengmeng Xu Amine Benhalloum Tao Xiang 105 2 0 24 Dec 2023
PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar Tzofi Klinghoffer Xiaoyu Xiang S. Somasundaram Yuchen Fan Christian Richardt Ramesh Raskar Rakesh Ranjan 94 7 0 21 Dec 2023
Carve3D: Improving Multi-view Reconstruction Consistency for Diffusion Models with RL Finetuning Desai Xie Jiahao Li Hao Tan Xin Sun Zhixin Shu Yi Zhou Sai Bi Soren Pirk Arie E. Kaufman 133 12 0 21 Dec 2023
Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models Huan Ling Seung Wook Kim Antonio Torralba Sanja Fidler Karsten Kreis DiffM 3DGS 97 123 0 21 Dec 2023
ZeroShape: Regression-based Zero-shot Shape Reconstruction Zixuan Huang Stefan Stojanov Anh Thai Varun Jampani James M. Rehg 3DV 92 27 0 21 Dec 2023
Repaint123: Fast and High-quality One Image to 3D Generation with Progressive Controllable 2D Repainting Junwu Zhang Zhenyu Tang Yatian Pang Xinhua Cheng Peng Jin Yida Wei Munan Ning Li-ming Yuan DiffM 3DGS 89 24 0 20 Dec 2023
ShowRoom3D: Text to High-Quality 3D Room Generation Using 3D Priors Weijia Mao Yan-Pei Cao Jia-Wei Liu Zhongcong Xu Mike Zheng Shou DiffM 100 5 0 20 Dec 2023
Text-Image Conditioned Diffusion for Consistent Text-to-3D Generation Yuze He Yushi Bai M. Lin Jenny Sheng Yubin Hu Qi Wang Yu-Hui Wen Yong-Jin Liu 80 1 0 19 Dec 2023
Scene-Conditional 3D Object Stylization and Composition Jinghao Zhou Tomas Jakab Philip Torr Christian Rupprecht DiffM 179 3 0 19 Dec 2023
Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Rendering Youwang Kim Tae-Hyun Oh Gerard Pons-Moll DiffM 111 53 0 18 Dec 2023
MVHuman: Tailoring 2D Diffusion with Multi-view Sampling For Realistic 3D Human Generation Suyi Jiang Haimin Luo Haoran Jiang Ziyu Wang Jingyi Yu Lan Xu 119 3 0 15 Dec 2023
Stable Score Distillation for High-Quality 3D Generation Boshi Tang Jianan Wang Zhiyong Wu Lei Zhang 74 17 0 14 Dec 2023
Text2Immersion: Generative Immersive Scene with 3D Gaussians Ouyang Hao Kathryn Heal Stephen Lombardi Tiancheng Sun 3DGS 80 29 0 14 Dec 2023
Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers Zi-Xin Zou Zhipeng Yu Yuanchen Guo Yangguang Li Ding Liang Yan-Pei Cao Song-Hai Zhang 3DGS 125 184 0 14 Dec 2023
PI3D: Efficient Text-to-3D Generation with Pseudo-Image Diffusion Ying-Tian Liu Yuanchen Guo Guan Luo Heyi Sun Wei Yin Song-Hai Zhang 81 20 0 14 Dec 2023
VaLID: Variable-Length Input Diffusion for Novel View Synthesis Shijie Li F. G. Zanjani H. Yahia Yuki M. Asano Juergen Gall A. Habibian DiffM 78 5 0 14 Dec 2023
Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Models Liangchen Song Liangliang Cao Jiatao Gu Yifan Jiang Junsong Yuan Hao Tang DiffM 98 15 0 13 Dec 2023
SceneWiz3D: Towards Text-guided 3D Scene Composition Qihang Zhang Chaoyang Wang Aliaksandr Siarohin Peiye Zhuang Yinghao Xu Ceyuan Yang Dahua Lin Bolei Zhou Sergey Tulyakov Hsin-Ying Lee 98 34 0 13 Dec 2023
SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearance Yuanyou Xu Zongxin Yang Yi Yang 86 27 0 13 Dec 2023
HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillation Hongyu Liu Xuan Wang Bo Liu Yujun Shen Yibing Song Jing Liao Qifeng Chen DiffM 118 17 0 12 Dec 2023
MinD-3D: Reconstruct High-quality 3D objects in Human Brain Jianxiong Gao Yu Fu Yun Wang Xuelin Qian Jianfeng Feng Yanwei Fu DiffM 99 6 0 12 Dec 2023
NVS-Adapter: Plug-and-Play Novel View Synthesis from a Single Image Yoonwoo Jeong Jinwoo Lee Chiheon Kim Minsu Cho Doyup Lee 59 4 0 12 Dec 2023
CAD: Photorealistic 3D Generation via Adversarial Distillation Bo Liu Despoina Paschalidou Ian Huang Hongyu Liu Bokui Shen Xiaoyu Xiang Jing Liao Leonidas Guibas DiffM 148 11 0 11 Dec 2023
UpFusion: Novel View Diffusion from Unposed Sparse View Observations Bharath Raj Nagoor Kani Hsin-Ying Lee Sergey Tulyakov Shubham Tulsiani 86 6 0 11 Dec 2023
Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior Fangfu Liu Diankun Wu Yi Wei Yongming Rao Yueqi Duan DiffM 81 24 0 11 Dec 2023